https://github.com/berriai/litellm/issues/31959 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTk1OSIsImhlYWRsaW5lIjoiIzMxOTU5IFtCdWddOiBQcmVzaWRpbyBvdXRwdXRfcGFyc2VfcGlpIGdpdmVzIHRoZSBzYW1lIGVudGl0eSBkaWZmZXJlbnQgbnVtYmVyZWQgdG9rZW5zIGFjcm9zcyBtZXNzYWdlcyBpbiBvbmUgcmVxdWVzdCwgY29ycnVwdGluZyB1bm1hc2tpbmciLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHR1YW50cmFuZiIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbldpdGggYG91dHB1dF9wYXJzZV9waWk6IHRydWVgIGFuZCBhIGAvY2hhdC9jb21wbGV0aW9uc2AgcmVxdWVzdCB0aGF0IGhhcyBtb3JlIHRoYW4gb25lIG1lc3NhZ2UsIHRoZSBQcmVzaWRpbyBndWFyZHJhaWwgbnVtYmVycyBQSUkgcGxhY2Vob2xkZXJzIHBlciBtZXNzYWdlIGluc3RlYWQgb2YgcGVyIHJlcXVlc3QuIFRoZSBzZXF1ZW5jZSBjb3VudGVyIHJlc3RhcnRzIGF0IDEgZm9yIGV2ZXJ5IG1lc3NhZ2UsIHNvIHRoZSBzYW1lIGVudGl0eSB2YWx1ZSBnZXRzIGEgZGlmZmVyZW50IHRva2VuIGluIGRpZmZlcmVudCBtZXNzYWdlcywgYW5kIHVucmVsYXRlZCB2YWx1ZXMgY29sbGlkZSBvbnRvIHRoZSBzYW1lIHRva2VuXG5cblRoZSBwbGFjZWhvbGRlciBtYXAgdXNlZCBmb3IgdW5tYXNraW5nIGxpdmVzIGluIGByZXF1ZXN0X2RhdGFbXCJtZXRhZGF0YVwiXVtcInBpaV90b2tlbnNcIl1gIGFuZCBpcyBrZXllZCBieSB0aGUgdG9rZW4gc3RyaW5nLiBFdmVyeSBtZXNzYWdlIGlzIGFub255bWl6ZWQgYXMgaXRzIG93biBgY2hlY2tfcGlpYCB0YXNrIHNoYXJpbmcgdGhhdCBvbmUgZGljdCwgc28gd2hlbiB0d28gbWVzc2FnZXMgYm90aCBwcm9kdWNlIGA8UEVSU09OXzE+YCBmb3IgZGlmZmVyZW50IHBlb3BsZSwgdGhlIGxhdGVyIHdyaXRlIG92ZXJ3cml0ZXMgdGhlIGVhcmxpZXIgb25lIChsYXN0IHdyaXRlIHdpbnMpLiBPbiB0aGUgcmVzcG9uc2Ugc2lkZSB0aGUgdW5tYXNrZXIgdGhlbiByZXN0b3JlcyB0aGUgd3Jvbmcgb3JpZ2luYWwgdmFsdWUsIGFuZCBiZWNhdXNlIHRoZSBtZXNzYWdlcyBydW4gY29uY3VycmVudGx5IHZpYSBgYXN5bmNpby5nYXRoZXJgIHRoZSB3aW5uZXIgaXMgbm9uZGV0ZXJtaW5pc3RpYyBmcm9tIHJlcXVlc3QgdG8gcmVxdWVzdFxuXG5FeHBlY3RlZCBiZWhhdmlvcjogd2l0aGluIGEgc2luZ2xlIHJlcXVlc3QgZWFjaCB1bmlxdWUgZW50aXR5IHZhbHVlIG1hcHMgdG8gb25lIHN0YWJsZSB0b2tlbiBhY3Jvc3MgYWxsIG1lc3NhZ2VzLCBhbmQgdGhlIHRva2VuIHRvIHZhbHVlIG1hcCBzdGF5cyBvbmUtdG8tb25lIHNvIHVubWFza2luZyBhbHdheXMgcuKApiJ9
```
}