https://github.com/berriai/litellm/issues/31587 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU4NyIsImhlYWRsaW5lIjoiIzMxNTg3IFtCdWddOiAvdjEvc2tpbGxzIHJldHVybnMgNTAwIHdoZW4gQU5USFJPUElDX0FQSV9LRVkgaXMgbm90IGNvbmZpZ3VyZWQgb3IgaW52YWxpZCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAaWhhbm5zZW4iLCJMYWJlbHM6IHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IkNoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG5XaGF0IGhhcHBlbmVkP1xuV2hlbiBjYWxsaW5nIGBHRVQgL3YxL3NraWxsc2Agb24gdGhlIExpdGVMTE0gcHJveHkgKHYxLjkwLjApIHdpdGhvdXQgYSB2YWxpZCBBTlRIUk9QSUNfQVBJX0tFWSwgdGhlIGVuZHBvaW50IHJldHVybnMgSFRUUCA1MDAgd2l0aCBhIFB5ZGFudGljIFZhbGlkYXRpb25FcnJvciBpbnN0ZWFkIG9mIGdyYWNlZnVsbHkgcmV0dXJuaW5nIGFuIGVtcHR5IHNraWxscyBsaXN0LlxuXG5UaGUgZXJyb3Igb2NjdXJzIGluIHR3byBzY2VuYXJpb3M6XG4xLiBObyBBTlRIUk9QSUNfQVBJX0tFWSBzZXQ6IGBWYWx1ZUVycm9yOiBBTlRIUk9QSUNfQVBJX0tFWSBvciBBTlRIUk9QSUNfQVVUSF9UT0tFTiBpcyByZXF1aXJlZCBmb3IgU2tpbGxzIEFQSWBcbjIuIEludmFsaWQgQU5USFJPUElDX0FQSV9LRVkgc2V0OiBgcHlkYW50aWNfY29yZS5fcHlkYW50aWNfY29yZS5WYWxpZGF0aW9uRXJyb3I6IDEgdmFsaWRhdGlvbiBlcnJvciBmb3IgTGlzdFNraWxsc1Jlc3BvbnNlIGRhdGEgRmllbGQgcmVxdWlyZWRgXG5cblRoaXMgYnJlYWtzIGNsaWVudHMgdGhhdCBhdXRvbWF0aWNhbGx5IGNhbGwgYC92MS9za2lsbHNgIG9uIHN0YXJ0dXAgKGUuZy4sIHBpLWFnZW50IHdpdGggcGktcHJvdmlkZXItbGl0ZWxsbSkuXG5cblN0ZXBzIHRvIFJlcHJvZHVjZVxuMS4gU3RhcnQgTGl0ZUxMTSBwcm94eSBXSVRIT1VUIGBBTlRIUk9QSUNfQVBJX0tFWWAgc2V0IChvciB3aXRoIGEgZmFrZSBrZXkgbGlrZSBgc2stZHVtbXlgKVxuMi4gQ2FsbCBgR0VUIC92MS9za2lsbHNgIHdpdGggdmFsaWQgTGl0ZUxMTSBhdXRoXG4zLiBSZWNlaXZlIEhUVFAgNTAwXG5cblJlbGV2YW50IGxvZyBvdXRwdXRcbmBgYFxucHlkYW50aWNfY29yZS5fcHlkYW50aWNfY29yZS5WYWxpZGF0aW9uRXJyb3I6IDEgdmFsaWRhdGlvbiBlcnJvciBmb3IgTGlzdFNraWxsc1Jlc3BvbnNlXG5kYXRhIEZpZWxkIHJlcXVpcmVkIFt0eXBlPW1pc3NpbmcsIGlucHV0X3ZhbHVlPXsndHlwZSc6ICdlcnJvcicsICdlcnJvcicuLi59XVxuICBGaWxlIFwiL2FwcC8udmVudi9saWIvcHl0aG9uMy4xMy9zaXRlLXBhY2thZ2VzL2xpdGVsbG0vc2tpbGxzL21haW4ucHlcIiwgbGluZSAzMTYs4oCmIn0=
```
}