https://github.com/berriai/litellm/issues/31911 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTkxMSIsImhlYWRsaW5lIjoiIzMxOTExIFtCdWddOiBNQ1AgdG9vbCBhdXRvLWV4ZWN1dGlvbiBzaWxlbnRseSBza2lwcGVkIGZvciBvbGxhbWFfY2hhdC8gYmFzZSBtb2RlbHMg4oCUIHJhdyB0b29sX2NhbGxzIHJldHVybmVkIHRvIGNsaWVudCAod29ya3MgdmlhIG9wZW5haS8gcm91dGUgdG8gc2FtZSBPbGxhbWEgbW9kZWwpIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBncmFoYW10b24iLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5TZXJ2ZXItc2lkZSBNQ1AgdG9vbCBhdXRvLWV4ZWN1dGlvbiAoYHJlcXVpcmVfYXBwcm92YWw6IFwibmV2ZXJcImApIHdvcmtzIHdoZW4gdGhlIHVuZGVybHlpbmcgbW9kZWwgcm91dGVzIHRocm91Z2ggYSBjbG91ZCBwcm92aWRlciwgYnV0ICoqc2lsZW50bHkgZG9lcyBub3QgZXhlY3V0ZSoqIHdoZW4gdGhlIHVuZGVybHlpbmcgbW9kZWwgcm91dGVzIHRocm91Z2ggYG9sbGFtYV9jaGF0L2AuIFRoZSBtb2RlbCdzIHRvb2wgY2FsbCBpcyByZXR1cm5lZCByYXcgdG8gdGhlIGNsaWVudCB3aXRoIGBmaW5pc2hfcmVhc29uOiBcInRvb2xfY2FsbHNcImAgaW5zdGVhZCBvZiBiZWluZyBleGVjdXRlZCBieSB0aGUgcHJveHkncyBhdXRvLWV4ZWMgbG9vcC5cblxuVGhpcyBtYWtlcyBsb2NhbCBPbGxhbWEgbW9kZWxzIHVudXNhYmxlIGFzIHRoZSBiYXNlIGZvciBwcm94eS1tYW5hZ2VkIGFnZW50cyAoYGxpdGVsbG1fYWdlbnQvYCBtb2RlbHMgd2l0aCBNQ1AgdG9vbHMgYXR0YWNoZWQpOiBjaGF0IFVJcyBsaWtlIE9wZW4gV2ViVUkgcmVjZWl2ZSBhbiB1bmV4cGVjdGVkIHRvb2wgY2FsbCBmb3IgdG9vbHMgdGhleSBuZXZlciBzZW50IGFuZCByZW5kZXIgYW4gZW1wdHkgYXNzaXN0YW50IG1lc3NhZ2UuXG5cbiMjIyBBL0IgZXZpZGVuY2UgKHNhbWUgcmVxdWVzdCwgb25seSB0aGUgYmFzZSBtb2RlbCBkaWZmZXJzKVxuXG5BZ2VudCBkZWZpbmVkIHZpYSBgbGl0ZWxsbV9hZ2VudC88YmFzZT5gIHdpdGggYW4gTUNQIHNlcnZlciBhdHRhY2hlZCAoYHJlcXVpcmVfYXBwcm92YWw6IFwibmV2ZXJcImApLCBwcm9tcHQgcmVxdWlyaW5nIGEgd2ViIHNlYXJjaDpcblxufCBCYXNlIG1vZGVsIHJvdXRlIHwgUmVzdWx0IHxcbnwtLS18LS0tfFxufCBgYW50aHJvcGljL2NsYXVkZS1oYWlrdS00LTVgIHwgdG9vbHMgZXhlY3V0ZWQgc2VydmVyLXNpZGUsIGBmaW5pc2hfcmVhc29uOiBcInN0b3BcImAsIGZpbmFsIGdyb3VuZGVkIGFuc3dlciDinIUgfFxufCBgb2xsYW1hX2NoYXQvZ2VtbWE0OjEyYmAgKGBhcGlfYmFzZWAgPSBPbGxhbWEpIHwgYGZpbmlzaF9yZWFzb246IFwidG9vbF9jYWxsc1wiYCwgcmF3IGB0b29sX2NhbGzigKYifQ==
```
}