https://github.com/berriai/litellm/issues/30882 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDg4MiIsImhlYWRsaW5lIjoiIzMwODgyIFtCdWddOiBFeHRyYSBpbnB1dHMgYXJlIG5vdCBwZXJtaXR0ZWQgd2l0aCBtaXN0cmFsL21pc3RyYWwtbGFyZ2UtbGF0ZXN0Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEB6aWVkZGhmIiwiTGFiZWxzOiBidWcsIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIHRoZSBPcGVud2ViVUkgcGx1Z2luIFthc3luY19jb250ZXh0X2NvbXByZXNzaW9uXShodHRwczovL2dpdGh1Yi5jb20vRnUtSmllL29wZW53ZWJ1aS1leHRlbnNpb25zL2Jsb2IvbWFpbi9wbHVnaW5zL2ZpbHRlcnMvYXN5bmMtY29udGV4dC1jb21wcmVzc2lvbi9hc3luY19jb250ZXh0X2NvbXByZXNzaW9uLnB5KSBpcyBlbmFibGVkLCBtZXNzYWdlIGluIHRoZSByZXF1ZXN0IHBheWxvYWQgaW5jbHVkZXMgZXh0cmEgcGFyYW1zIHRoYXQgYXJlIGZvcmJpZGRlbiBieSBNaXN0cmFsIGlucHV0IHNjaGVtYS5cblxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cblNlbmQgYSBjaGF0IGNvbXBsZXRpb24gcmVxdWVzdCB3aGVyZSB0aGUgcmVxdWVzdCBpbmNsdWRlcyBgIFwidG9vbF9vdXRwdXRzX3RyaW1tZWRcIjogdHJ1ZWAsICBgXCJ0cmltbWVkX2J5XCI6IFwiYXN5bmNfY29udGV4dF9jb21wcmVzc2lvblwiYCA6XG5cbmBgYFxuY3VybCAtdiAtWCBQT1NUIFwiaHR0cHM6Ly88aG9zdD4vYXBpL2NoYXQvY29tcGxldGlvbnNcIiBcXFxuICAtSCBcIkF1dGhvcml6YXRpb246IEJlYXJlciA8dG9rZW4+XCIgXFxcbiAgLUggXCJDb250ZW50LVR5cGU6IGFwcGxpY2F0aW9uL2pzb25cIiAgIC1kICd7XG4gICAgXCJtb2RlbFwiOiBcIm1pc3RyYWwvbWlzdHJhbC1sYXJnZS1sYXRlc3RcIixcbiAgICBcIm1lc3NhZ2VzXCI6IFtcbiAgICAgIHsgICAgICAgICAgXG4gICAgICAgIFwicm9sZVwiOiBcInVzZXJcIixcbiAgICAgICAgXCJjb250ZW50XCI6IFwiY29udGVudFwiXG4gICAgICB9LCBcbiAgICAgIHsgICAgICAgICAgICAgICAgICAgICAgICAgICAgXG4gICAgICAgIFwicm9sZVwiOiBcImFzc2lzdGFudFwiLFxuICAgICAgICBcImNvbnRlbnRcIjogXCJjb250ZW50XCIsXG4gICAgICAgIFwibWV0YWRhdGFcIjogeyAgICAgICAgICAgICAgICAgICAgICAgICAgXG4gICAgICAgICAgXCJ0b29sX291dHB1dHNfdHJpbW1lZFwiOiB0cnVlLFxuICAgICAgICAgIFwidHJpbW1lZF9ieVwiOiBcImFzeW5jX2NvbnRleHRfY29tcHJlc3Npb25cIlxuICAgICAgICB9ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgXG4gICAgICB9XG4gICAgXVxuICB9J1xuYGBgXG5cblxuXG4j4oCmIn0=
```
}