https://github.com/berriai/litellm/issues/31902 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTkwMiIsImhlYWRsaW5lIjoiIzMxOTAyIFtCdWddOiAgd2Vic2VhcmNoX2ludGVyY2VwdGlvbiBzaG9ydC1jaXJjdWl0IHVzZXMgbGFzdCB1c2VyIG1lc3NhZ2UgYXMgdGhlIHNlYXJjaCBxdWVyeSBpbnN0ZWFkIG9mIHRoZSBtb2RlbCdzIHdlYl9zZWFyY2ggdG9vbC1jYWxsIHF1ZXJ5IChDbGF1ZGUgQ29kZSByZXR1cm5zIFwiRGlkIDAgc2VhcmNoZXNcIiAvIG9mZi10b3BpYyByZXN1bHRzIHdpdGggZ2l0aHViX2NvcGlsb3QpIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBya2FnZSIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uLCBjbGF1ZGUgY29kZSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIENsYXVkZSBDb2RlJ3MgbmF0aXZlICoqV2ViU2VhcmNoKiogaXMgc2VydmVkIHRocm91Z2ggYHdlYnNlYXJjaF9pbnRlcmNlcHRpb25gXG5mb3IgYSBwcm92aWRlciB3aXRob3V0IG5hdGl2ZSBBbnRocm9waWMgTWVzc2FnZXMgc3VwcG9ydCAoZS5nLiBgZ2l0aHViX2NvcGlsb3RgKSxcbnRoZSBzaG9ydC1jaXJjdWl0IHBhdGggcnVucyB0aGUgc2VhcmNoIGFnYWluc3QgdGhlICoqdGV4dCBvZiB0aGUgbGFzdCB1c2VyXG5tZXNzYWdlKiogaW5zdGVhZCBvZiB0aGUgKipxdWVyeSB0aGUgbW9kZWwgcGxhY2VkIGluIHRoZSBgd2ViX3NlYXJjaGAgdG9vbCBjYWxsKiouXG5cblRoZSByZXN1bHQgaXMgdGhhdCBTZWFyWE5HL1RhdmlseS9ldGMuIGFyZSBxdWVyaWVkIHdpdGggdGhlIHdyb25nIHN0cmluZy4gVGhlXG5zZWFyY2ggYmFja2VuZCByZXR1cm5zIHZhbGlkLWJ1dC1pcnJlbGV2YW50IHJlc3VsdHMgKGUuZy4gZGljdGlvbmFyeSBkZWZpbml0aW9uc1xuZm9yIGEgc3RyYXkgd29yZCBpbiB0aGUgcHJvbXB0KSwgYW5kIENsYXVkZSBDb2RlIOKAlCByZWNlaXZpbmcgcmVzdWx0cyB0aGF0IGRvbid0XG5jb3JyZXNwb25kIHRvIHRoZSBxdWVyeSBpdCBhc2tlZCBmb3Ig4oCUIHJlcG9ydHMgKipcIkRpZCAwIHNlYXJjaGVzIGluIE5OTm1zXCIqKiBhbmRcbmRpc2NhcmRzIHRoZW0uXG5cblRoaXMgaXMgZGlzdGluY3QgZnJvbSAjMjk2NDkgKHdoaWNoIHJlcG9ydHMgdGhlIHNob3J0LWNpcmN1aXQgc2tpcHBpbmcgbW9kZWxcbipzeW50aGVzaXMqKS4gVGhpcyBpc3N1ZSBpcyB0aGF0IHRoZSAqKnNlYXJjaCBpbnB1dCBpdHNlbGYgaXMgd3JvbmcqKiwgdXBzdHJlYW1cbm9mIHN5bnRoZXNpcy4gVGhlIHR3byBzaGFyZSB0aGUgc2hvcnQtY2lyY3VpdCBjb2RlIHBhdGggYnV0IGhhdmUgZGlmZmVyZW50IHJvb3RcbmNhdXNlcy5cblxuIyMgUm9vdCBjYXVzZVxuXG5JbiBgdHJ5X3Nob3J0X2NpcmN1aXRfc2VhcmNoYCwgdGhlIHF1ZXJ5IGlzIGV4dHJhY3RlZCBmcm9tIHRoZSBsYXN0IHVzZXIgbWVzc2FnZTpcblxuYGhhbmRsZXIucHlgIChtYWluIFtMMTUxXShodHRwczovL2dpdGh1Yi5jb20vQmVycmlBSS9saXTigKYifQ==
```
}