https://github.com/berriai/litellm/issues/31555 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU1NSIsImhlYWRsaW5lIjoiIzMxNTU1IFtGZWF0dXJlXTogT3B0aW9uYWwgTWFya292LUJhc2VkIFJvdXRpbmcgU3RyYXRlZ3kgZm9yIEFkYXB0aXZlIFRva2VuIENvc3QgQXJiaXRyYWdlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBUaWJvMjQwMyIsIkxhYmVsczogZW5oYW5jZW1lbnQiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgVGhlIEZlYXR1cmVcblxuSW50cm9kdWNlIGFuIG9wdGlvbmFsIHJvdXRpbmcgc3RyYXRlZ3kgYmFzZWQgb24gYSBNYXJrb3YgZGVjaXNpb24gcHJvY2VzcyB0aGF0IGNvbnRpbnVvdXNseSBhZGp1c3RzIHByb3ZpZGVyIHNlbGVjdGlvbiBhY2NvcmRpbmcgdG8gcmVhbC10aW1lIG9wZXJhdGlvbmFsIG1ldHJpY3MuXG5cbkluc3RlYWQgb2YgcmVseWluZyBzb2xlbHkgb24gc3RhdGljIHByaW9yaXRpZXMgb3IgcmVhY3RpdmUgZmFsbGJhY2tzLCB0aGUgcm91dGVyIHdvdWxkIGR5bmFtaWNhbGx5IGFkYXB0IHRyYW5zaXRpb24gcHJvYmFiaWxpdGllcyBiZXR3ZWVuIHByb3ZpZGVycyB1c2luZyBzaWduYWxzIHN1Y2ggYXM6XG5cbi0gdG9rZW4gY29zdFxuLSBsYXRlbmN5XG4tIGVycm9yIHJhdGVcbi0gcHJvdmlkZXIgaGVhbHRoXG4tIHF1b3RhIG9yIHJhdGUtbGltaXQgdXRpbGl6YXRpb25cbi0gb3B0aW9uYWwgcXVhbGl0eSBtZXRyaWNzXG5cbkFzIHByb3ZpZGVyIGNvbmRpdGlvbnMgZXZvbHZlLCB0cmFmZmljIHdvdWxkIG5hdHVyYWxseSBzaGlmdCB0b3dhcmQgcHJvdmlkZXJzIGRlbGl2ZXJpbmcgdGhlIGJlc3Qgb3ZlcmFsbCBjb3N0LXBlcmZvcm1hbmNlLXJlbGlhYmlsaXR5IGJhbGFuY2UuXG5cblRoZSBzdHJhdGVneSB3b3VsZCByZW1haW4gZW50aXJlbHkgb3B0LWluIGFuZCBkaXNhYmxlZCBieSBkZWZhdWx0LCBwcmVzZXJ2aW5nIGZ1bGwgYmFja3dhcmQgY29tcGF0aWJpbGl0eSB3aXRoIExpdGVMTE0ncyBleGlzdGluZyByb3V0aW5nIGJlaGF2aW9yLlxuXG4jIyMgTW90aXZhdGlvbiwgcGl0Y2hcblxuTGl0ZUxMTSBhbHJlYWR5IHByb3ZpZGVzIGV4Y2VsbGVudCByZXRyeSwgZmFsbGJhY2ssIGFuZCBsb2FkLWJhbGFuY2luZyBjYXBhYmlsaXRpZXMuIFRoZXNlIG1lY2hhbmlzbXMgYXJlIGhpZ2hseSBlZmZlY3RpdmUgb25jZSBhIHByb3ZpZGVyIGhhcyBmYWlsZWQgb3IgYmVjb21lIHVuYXZhaWxhYmxlLlxuXG5Ib3dldmVyLCBtYW55IHByb2R1Y3Rpb24gaXNzdWVzIGFyaXNlIGJlZm9yZSBhIHByb3ZpZGVyIGFjdHVhbGx5IGZhaWxzLlxuXG5Gb3IgZXhhbXBsZSwgYSBwcm92aWRlciBtYXkgZ3JhZHVhbGx5IGJlY29tZSBtb+KApiJ9
```
}