https://github.com/berriai/litellm/issues/24004 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yNDAwNCIsImhlYWRsaW5lIjoiIzI0MDA0IFtCdWddOiBNaWQtc3RyZWFtIGZhbGxiYWNrIG5vdCBzdXBwb3J0ZWQgZm9yIGFudGhyb3BpY19tZXNzYWdlcyByb3V0ZSB0eXBlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBhYnJla2hvdiIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiB1c2luZyB0aGUgTGl0ZUxMTSBwcm94eSdzIGAvdjEvbWVzc2FnZXNgIGVuZHBvaW50ICh3aGljaCBnb2VzIHRocm91Z2ggdGhlIHJvdXRlciB2aWEgYGFudGhyb3BpY19tZXNzYWdlc2Agcm91dGUgdHlwZSksIG1pZC1zdHJlYW0gZXJyb3JzIGZyb20gQW50aHJvcGljIChlLmcuIGBvdmVybG9hZGVkX2Vycm9yYCwgYGludGVybmFsX3NlcnZlcl9lcnJvcmAgU1NFIGV2ZW50cykgYXJlIG5vdCBjYXVnaHQgYnkgdGhlIHJvdXRlcidzIGZhbGxiYWNrIHN5c3RlbS5cblxuIyMjIFJvb3QgQ2F1c2VcblxuVGhlIGBfYWdlbmVyaWNfYXBpX2NhbGxfd2l0aF9mYWxsYmFja3NfaGVscGVyYCBtZXRob2QgaW4gYHJvdXRlci5weWAgcmV0dXJucyB0aGUgc3RyZWFtaW5nIGBBc3luY0l0ZXJhdG9yYCBkaXJlY3RseSB3aXRob3V0IHdyYXBwaW5nIGl0IGluIGEgZmFsbGJhY2stYXdhcmUgd3JhcHBlci4gQ29tcGFyZSB3aXRoIHRoZSBgYWNvbXBsZXRpb25gIHBhdGggd2hpY2ggd3JhcHMgc3RyZWFtaW5nIHJlc3BvbnNlcyBpbiBgRmFsbGJhY2tTdHJlYW1XcmFwcGVyYCB2aWEgYF9hY29tcGxldGlvbl9zdHJlYW1pbmdfaXRlcmF0b3JgIChyb3V0ZXIucHk6MjE2Mi0yMTY3KS5cblxuRm9yIHRoZSBnZW5lcmljIHBhdGggYXQgcm91dGVyLnB5OjM4NTUsIHRoZSByZXNwb25zZSBpcyBzaW1wbHkgYHJldHVybiByZXNwb25zZWAgd2l0aCBubyBlcnJvciBkZXRlY3Rpb24gb3IgZmFsbGJhY2sgd3JhcHBpbmcuXG5cbiMjIyBFeHBlY3RlZCBCZWhhdmlvclxuXG5XaGVuIEFudGhyb3BpYyByZXR1cm5zIEhUVFAgMjAwIGFuZCBzdGFydHMgc3RyZWFtaW5nLCB0aGVuIHNlbmRzIGFuIFNTRSBlcnJvciBldmVudCAoYGV2ZW50OiBlcnJvcmAgd2l0aCBgb3ZlcmxvYWRlZF9lcnJvcmAgb3IgYGludGVybmFsX3NlcnZlcl9lcnJvcmApLCB0aGUgcm91dGVyIHNob3VsZCBkZXRlY3QgdGhpcyBtaWQtc3RyZWFtIGVycm9yIGFuZCBhdHRlbXB0IHRvIGZhbGwgYmFjayB0byBhIGNvbmZpZ3VyZWQgZmFsbGJhY2sgbW9kZWwgKGUuZy4gQmVkcm9jaykuXG5cbiMjIyBBY3R1YWwgQmVoYXZpb3JcblxuVGhlIFNTRSBlcnJvciBldmVudCBwYXNzZXMgdGhyb3VnaCBzaWxlbnRseSB0byB0aGUgY2xpZW50LiBUaGUgcmVxdWVzdCBpcyBsb2dnZWQgYXMgYHN0YXR1cz1zdWNjZXNzYCBpbiB0aGUgc3BlbmQgbG9ncy4gTm8gZmFsbGJh4oCmIn0=
```
}