https://github.com/berriai/litellm/issues/31067 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA2NyIsImhlYWRsaW5lIjoiIzMxMDY3IFtCdWddOiBNaWQtc3RyZWFtIGZhbGxiYWNrIGNvbnRpbnVhdGlvbiBwcm9tcHQgY29ycnVwdHMgdG9vbC1jYWxsaW5nIGNvbnRleHQg4oCUIGZhbGxiYWNrIHJldHVybnMgcHJvc2UgaW5zdGVhZCBvZiB0b29sIGNhbGxzIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBlbHZpcy1jYWkiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiwgU0RLIl0sImV4Y2VycHQiOiIjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cblJlbGF0ZWQgdG8gIzI3OTY3ICh3aGljaCBjb3ZlcnMgYHByZWZpeD1UcnVlYCByZWplY3Rpb24gZm9yIGNsYXVkZS1zb25uZXQtNC02KS4gVGhpcyBpc3N1ZSBjb3ZlcnMgYSAqKmRpc3RpbmN0IHNpbGVudCBmYWlsdXJlIG1vZGUqKiB0aGF0IG9jY3VycyBldmVuIHdoZW4gdGhlIGZhbGxiYWNrIG1vZGVsIGFjY2VwdHMgdGhlIGNvbnRpbnVhdGlvbiB3aXRob3V0IGVycm9yLlxuXG4jIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIGEgc3RyZWFtaW5nIHJlcXVlc3QgdGhhdCBpbmNsdWRlcyBgdG9vbHNgIGZhaWxzIG1pZC1zdHJlYW0sIGBSb3V0ZXIuc3RyZWFtX3dpdGhfZmFsbGJhY2tzYCB1bmNvbmRpdGlvbmFsbHkgYXBwZW5kcyBhIGNvbnRpbnVhdGlvbiBwcm9tcHQgdG8gdGhlIGZhbGxiYWNrIHJlcXVlc3Q6XG5cbmBgYHB5dGhvblxuIyByb3V0ZXIucHkgKGFzeW5jIHBhdGggfmxpbmUgMTg0Miwgc3luYyBwYXRoIH5saW5lIDE5ODUpXG5pbml0aWFsX2t3YXJnc1tcIm1lc3NhZ2VzXCJdID0gbWVzc2FnZXMgKyBbXG4gICAge1wicm9sZVwiOiBcInN5c3RlbVwiLCBcImNvbnRlbnRcIjogXCIuLi5yZXNwb25kIGluIGNvbnRpbnVhdGlvbiBvZiB0aGlzIHRleHQ6IFwifSxcbiAgICB7XCJyb2xlXCI6IFwiYXNzaXN0YW50XCIsIFwiY29udGVudFwiOiBlLmdlbmVyYXRlZF9jb250ZW50LCBcInByZWZpeFwiOiBUcnVlfSxcbl1cbmBgYFxuXG5UaGlzIGNvbnRpbnVhdGlvbiBzdHJhdGVneSBpcyBkZXNpZ25lZCBmb3IgcHVyZSB0ZXh0IGdlbmVyYXRpb24uIFdoZW4gdGhlIG9yaWdpbmFsIHJlcXVlc3QgaW5jbHVkZWQgYHRvb2xzYCwgdGhlIGFwcGVuZGVkIGFzc2lzdGFudCBwYXJ0aWFsLXRleHQgbWVzc2FnZSBzaWduYWxzIHRvIHRoZSBmYWxsYmFjayBtb2RlbCB0aGF0IGl0IGlzIGFscmVhZHkgbWlkLXdheSB0aHJvdWdoIGEgdGV4dCByZXNwb25zZS4gVGhlIGZhbGxiYWNrIG1vZGVsICoqY29udGludWVzIGdlbmVyYXRpbmcgcHJvc2UgaW5zdGVhZCBvZiBpbnZva2luZyB0b29scyoqIOKAlCBldmVuIHRob3VnaCBgdG9vbHNgIGlzIHN0aWxsIHByZXNlbnQgaW4gYGluaXRpYWxfa3dhcmdzYC5cblxuVGhlIHJlc3VsdCBpcyBhICoqc2lsZW50IGNvcnJ1cHRpb24qKjogbm8gZXhjZXB0aW9uIGlzIHJhaXNlZCwgdGhlIHN0cmVhbSBjb21wbGV0ZXMgc3VjY2Vzc2Z1bGx5LCBidXQgdGhlIHJlc3BvbnNlIGNvbnRhaW5zIOKApiJ9
```
}