https://github.com/berriai/litellm/issues/31316 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTMxNiIsImhlYWRsaW5lIjoiIzMxMzE2IFtCdWddOiB3ZWJfc2VhcmNoIHRvb2wgY29zdCBub3QgdHJhY2tlZCBmb3IgR1BULTUgbW9kZWxzIHZpYSBSZXNwb25zZXMgQVBJIChzZWFyY2hfY29udGV4dF9jb3N0X3Blcl9xdWVyeSBtaXNzaW5nIGZyb20gY29zdCBtYXApIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBib3Jvd2lzIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgc2VhcmNoZWQgZXhpc3RpbmcgaXNzdWVzLiAjMTY5OTYgKGNsb3NlZC9jb21wbGV0ZWQg4oCUIGFkZGVkIHRoZSB3ZWItc2VhcmNoIGNvc3QgKm1lY2hhbmlzbSopIGFuZCAjMjYyNTMgKHRoZSBpbnZlcnNlIGNhc2U6IEdlbWluaSBgdXJsX2NvbnRleHRgIG92ZXItYmlsbGVkIGFzIHdlYl9zZWFyY2gpIGFyZSByZWxhdGVkIGJ1dCBkbyBub3QgY292ZXIgdGhpcy4gSSBkaWQgbm90IGZpbmQgYW4gb3BlbiBpc3N1ZSBmb3IgR1BULTUgLyBSZXNwb25zZXMtQVBJIGB3ZWJfc2VhcmNoYCBiZWluZyBiaWxsZWQgYXQgJDAuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5UaGUgaG9zdGVkIGB3ZWJfc2VhcmNoYCB0b29sIGNvc3QgaXMgKipub3QqKiB0cmFja2VkIGZvciBHUFQtNSAoYW5kIEdQVC00bykgbW9kZWxzIHdoZW4gdXNlZCB2aWEgdGhlICoqUmVzcG9uc2VzIEFQSSoqIChgL3Jlc3BvbnNlc2ApLlxuXG5geC1saXRlbGxtLXJlc3BvbnNlLWNvc3RgIChhbmQgYHJlc3BvbnNlX2Nvc3RgIGluIGxvZ3MvY2FsbGJhY2tzKSBjb3ZlcnMgaW5wdXQvb3V0cHV0IHRva2VucyBvbmx5IOKAlCBpbmNsdWRpbmcgdGhlIG9mdGVuLWxhcmdlIHdlYi1zZWFyY2ggKnJlc3VsdCogdG9rZW5zIHRoYXQgYXJlIGZlZCBiYWNrIGFzIGlucHV0IOKAlCBidXQgKipvbWl0cyBPcGVuQUkncyBwZXItY2FsbCB3ZWJfc2VhcmNoIGZlZSoqLiBQZXIgW09wZW5BSSdzIHByaWNpbmddKGh0dHBzOi8vZGV2ZWxvcGVycy5vcGVuYWkuY29tL2FwaS9kb2NzL3ByaWNpbmcpLCB0aGUgaG9zdGVkIHdlYl9zZWFyY2ggdG9vbCBvbiByZWFzb25pbmcgbW9kZWxzIChncHQtNSwgby1zZXJpZXMpIGNvc3RzICoqJDEwLjAwIC8gMWsgY2FsbHMqKiAqcGx1cyogc2VhcmNoLWNvbnRlbnQgdG9rZW5zIGF0IG1vZGVsIHJhdGVzLiBMaXRlTExNIGNoYXJnZXMgdGhlIHRva2VucyBidXQgYmlsbHMgdGhlIHBlci1jYWxsIGZlZSBhcyAqKiQwKiouXG5cbioqUm9vdCBjYXVzZToqKiBgbW9kZWxfcHJpY2VzX2FuZF9jb250ZXh0X3dpbmRvdy5qc29uYCBoYXMgKipubyBgc2VhcmNoX2NvbnRleHRfY29zdF9wZXJfcXVlcnlgKiogZm9yIGFueSBgZ3B0LTUqYCBtb2RlbCAobm9yIGBncHQtNG9gKS4gT25seSB0aGUgZGVkaWNhdGVkIGAqLXNlYXJjaC1wcmV2aWV3YCBjaGF0IG1vZGVscyBoYXZlIGl0LCBzbyB0aGUgR0HigKYifQ==
```
}