https://github.com/berriai/litellm/issues/31977 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTk3NyIsImhlYWRsaW5lIjoiIzMxOTc3IFtCdWddOiBNQ1AgSldUIHNpZ25lciBvdmVyd3JpdGVzIE9BdXRoIEF1dGhvcml6YXRpb24gaGVhZGVyIGR1cmluZyB0b29scy9jYWxsIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBsZXZvbnRpa295YW4iLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBgbWNwX2p3dF9zaWduZXJgIGlzIGVuYWJsZWQgYXMgYSBgcHJlX21jcF9jYWxsYCBndWFyZHJhaWwsIE9BdXRoLWJhY2tlZCBNQ1Agc2VydmVycyBjYW4gbGlzdCB0b29scyBzdWNjZXNzZnVsbHksIGJ1dCBhY3R1YWwgYHRvb2xzL2NhbGxgIHJlcXVlc3RzIGZhaWwgYmVjYXVzZSB0aGUgc2lnbmVyIG92ZXJ3cml0ZXMgdGhlIHVzZXIncyBPQXV0aCBgQXV0aG9yaXphdGlvbmAgaGVhZGVyIHdpdGggYSBMaXRlTExNLXNpZ25lZCBKV1QuXG5cbkV4cGVjdGVkIGJlaGF2aW9yOlxuLSBPQXV0aC1iYWNrZWQgTUNQIHNlcnZlcnMgc2hvdWxkIHJlY2VpdmUgdGhlIHVzZXIncyBPQXV0aCBhY2Nlc3MgdG9rZW46XG4gIGBBdXRob3JpemF0aW9uOiBCZWFyZXIgPG9hdXRoX2FjY2Vzc190b2tlbj5gXG4tIGBtY3Bfand0X3NpZ25lcmAgc2hvdWxkIG5vdCBvdmVyd3JpdGUgT0F1dGggY3JlZGVudGlhbHMgZm9yIE9BdXRoIE1DUCBzZXJ2ZXJzLCBvciB0aGlzIHNob3VsZCBiZSBjb25maWd1cmFibGUgcGVyIE1DUCBzZXJ2ZXIvaGVhZGVyLlxuXG5BY3R1YWwgYmVoYXZpb3I6XG4tIGB0b29scy9saXN0YCB3b3Jrcy5cbi0gYHRvb2xzL2NhbGxgIHNlbmRzIHRoZSBMaXRlTExNIEpXVCBpbiBgQXV0aG9yaXphdGlvbmAgaW5zdGVhZCBvZiB0aGUgT0F1dGggYWNjZXNzIHRva2VuLlxuLSBVcHN0cmVhbSBPQXV0aCBNQ1Agc2VydmVycyByZWplY3QgdGhlIHJlcXVlc3QuXG5cblRoaXMgbG9va3MgaW5jb25zaXN0ZW50IHdpdGggdGhlIGV4aXN0aW5nIGB0b29scy9saXN0YCBwcm90ZWN0aW9uIGFkZGVkIGluL2Fyb3VuZCAjMjgyMjcuIFRoZSBgdG9vbHMvbGlzdGAgcGF0aCBza2lwcyBKV1QgaW5qZWN0aW9uIHdoZW4gQXV0aG9yaXphdGlvbiBhbHJlYWR5IGV4aXN0cywgd2l0aCBjb21tZW50cyBzYXlpbmcgcGVyLXVzZXIgT0F1dGggbXVzdCB0YWtlIHByZWNlZGVuY2UuIFRoZSBgdG9vbHMvY2FsbGAgcGF0aCBkb2VzIG5vdCBhcHBseSB0aGUgc2FtZSBwcm90ZWN0aW9uLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbjEuIENvbmZpZ3VyZSBgbWNwX2p3dF9zaWduZXJgIGFzIGEgZGVmYXVsdC3igKYifQ==
```
}