https://github.com/berriai/litellm/issues/31678 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTY3OCIsImhlYWRsaW5lIjoiIzMxNjc4IFtCdWddOiBlbmFibGVfd2VpZ2h0ZWRfZmFpbG92ZXIgZG9lcyBub3RoaW5nIG9uIHRoZSAvdjEvbWVzc2FnZXMgcGF0aCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAYWlkYW5hc2luZ2giLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgV2hhdCBoYXBwZW5lZD9cblxuZW5hYmxlX3dlaWdodGVkX2ZhaWxvdmVyIGlzIG1lYW50IHRvIGtlZXAgYSBmYWlsZWQgcmVxdWVzdCBpbnNpZGUgaXRzIG1vZGVsIGdyb3VwLiBJZiBvbmUgZGVwbG95bWVudCBpbiB0aGUgZ3JvdXAgZmFpbHMsIHRoZSByb3V0ZXIgc2hvdWxkIHRyeSBhIGhlYWx0aHkgc2libGluZyBpbiB0aGUgc2FtZSBncm91cCBiZWZvcmUgZmFsbGluZyBiYWNrIHRvIGEgZGlmZmVyZW50IG1vZGVsIGdyb3VwLiBPbiAvY2hhdC9jb21wbGV0aW9ucyBpdCBkb2VzIHRoaXMuIE9uIC92MS9tZXNzYWdlcyBpdCBkb2VzIG5vdC5cblxuVGhlIGltcGFjdCBpcyB0aGF0IGFueSBjbGllbnQgdXNpbmcgdGhlIEFudGhyb3BpYyAvdjEvbWVzc2FnZXMgZm9ybWF0IHNpbGVudGx5IGxvc2VzIHNhbWUtZ3JvdXAgZmFpbG92ZXIuIFBpY3R1cmUgYSBDbGF1ZGUgbW9kZWwgZ3JvdXAgd2l0aCBhIEJlZHJvY2sgZGVwbG95bWVudCBhbmQgYW4gQW50aHJvcGljIGRlcGxveW1lbnQgYXQgZXF1YWwgd2VpZ2h0LCBwbHVzIGEgdGVybWluYWwgQ2xhdWRlIHRvIEdQVCBmYWxsYmFjayBtZWFudCB0byBmaXJlIG9ubHkgd2hlbiBib3RoIENsYXVkZSBwcm92aWRlcnMgYXJlIGRvd24uIFdoZW4gdGhlIEFudGhyb3BpYyBkZXBsb3ltZW50IGZhaWxzLCB0aGUgcmVxdWVzdCBza2lwcyB0aGUgaGVhbHRoeSBCZWRyb2NrIHNpYmxpbmcgYW5kIGp1bXBzIHN0cmFpZ2h0IHRvIHRoZSBHUFQgZmFsbGJhY2suIFRoZSB1c2VyIGlzIGFuc3dlcmVkIGJ5IHRoZSB3cm9uZyBwcm92aWRlciwgcHJvbXB0IGNhY2hlIGxvY2FsaXR5IGlzIGxvc3QsIGFuZCBhIHByb21wdCB0dW5lZCBmb3IgQ2xhdWRlIGlzIHF1aWV0bHkgc2VydmVkIGJ5IEdQVC4gVGhlIHJlcXVlc3Qgc3RpbGwgcmV0dXJucyAyMDAsIHNvIGRhc2hib2FyZHMgc3RheSBncmVlbiBhbmQgbm9ib2R5IG5vdGljZXMgdGhlIGluLWdyb3VwIGZhaWxvdmVyIG5ldmVyIHJhbi4gVGhlIHNhbWUgY29uZmlnIG9uIC9jaGF0L2NvbXBsZXRpb25zIGJlaGF2ZXMgY29ycmVjdGx5LCB3aGljaCBtYWtlcyB0aGlzIGhhcmQgdG8gc3BvdC5cblxuVGhlIGNhdXNlIGlzIG5hcnJvdy4gV2VpZ2h0ZWQgZmFpbG92ZXIgb25seSB0cmlnZ2VycyB3aGVuIHRoZSBmYWlsaW5nIGV4Y2VwdGlvbiBjYXJyaWVzIGEgZmFpbGVkX2RlcGxveW1lbnRfaWQuIFRoZSBjaGF0IHBhdGggc2V0cyB0aGF0IGF04oCmIn0=
```
}