https://github.com/berriai/litellm/issues/31870 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTg3MCIsImhlYWRsaW5lIjoiIzMxODcwIGJ1Zyhha3RvLWd1YXJkcmFpbCk6IGR1cmluZ19jYWxsIG1vZGUgc2lsZW50bHkgbm8tb3BzOyBtaXNzaW5nIG1vZGVsLWdyb3VwIHNjb3BpbmcgYW5kIE8obl4yKSBzdHJlYW1pbmcgaW5nZXN0Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBkZWVwYW5zaHVsdWxsYSJdLCJleGNlcnB0IjoiIyMgU3VtbWFyeVxuXG5UaGUgQWt0byBndWFyZHJhaWwgaW50ZWdyYXRpb24gaGFzIHRocmVlIGlzc3VlcyBpbiBPU1MgMS45MS4wLlxuXG5GaXJzdCwgc2V0dGluZyBcXGBtb2RlOiBkdXJpbmdfY2FsbFxcYCBpbiB0aGUgZ3VhcmRyYWlscyBZQU1MIHByb2R1Y2VzIG5vIHZhbGlkYXRpb24gZWZmZWN0IGFuZCBubyBlcnJvci4gXFxgSE9PS19UT19JTlBVVFxcYCBhdCBsaW5lIDQ0IG9mIFxcYGFrdG8ucHlcXGAgb25seSBtYXBzIFxcYHByZV9jYWxsXFxgIGFuZCBcXGBwb3N0X2NhbGxcXGA7IFxcYGR1cmluZ19jYWxsXFxgIGlzIGFic2VudC4gQWRkaXRpb25hbGx5LCBcXGBzdXBwb3J0ZWRfZXZlbnRfaG9va3NcXGAgb25seSBsaXN0cyBcXGBwcmVfY2FsbFxcYCBhbmQgXFxgcG9zdF9jYWxsXFxgLCBzbyB0aGUgZnJhbWV3b3JrIHNraXBzIHRoZSBob29rIGVudGlyZWx5IGJlZm9yZSBcXGBhcHBseV9ndWFyZHJhaWxcXGAgaXMgZXZlciBjYWxsZWQuIEFueSBkZXBsb3ltZW50IGNvbmZpZ3VyZWQgd2l0aCBcXGBtb2RlOiBkdXJpbmdfY2FsbFxcYCByZWNlaXZlcyB6ZXJvIGd1YXJkcmFpbCBjb3ZlcmFnZS5cblxuU2Vjb25kLCB0aGVyZSBpcyBubyB3YXkgdG8gc2NvcGUgQWt0byBpbnZvY2F0aW9ucyB0byBzcGVjaWZpYyBtb2RlbCBncm91cHMuIE9wZXJhdG9ycyB3aG8gd2FudCB0byBydW4gQWt0byBvbmx5IGZvciBzb21lIG1vZGVsIGdyb3VwcyAoZS5nLiwgYnkgdGllciBvciBjb3N0KSBjYW5ub3QgZG8gc28gd2l0aG91dCBwYXRjaGluZyB0aGUgaW50ZWdyYXRpb24uXG5cblRoaXJkLCB0aGUgc3RyZWFtaW5nIHBvc3RfY2FsbCBwYXRoIGNhbGxzIHRoZSBBa3RvIGluZ2VzdCBlbmRwb2ludCBvbmNlIHBlciBldmVyeSA1dGggY2h1bmssIHNlcmlhbGl6aW5nIHRoZSBncm93aW5nIFxcYHJlc3BvbnNlc19zb19mYXJcXGAgYnVmZmVyIGVhY2ggdGltZS4gRm9yIGEgNTAwLWNodW5rIHN0cmVhbSB0aGlzIGlzIDEwMCBBa3RvIGNhbGxzLCBlYWNoIHNlcmlhbGl6aW5nIGEgbG9uZ2VyIGJ1ZmZlciwgcHJvZHVjaW5nIE8obl4yKSB3b3JrIHRoYXQgc3RhbGxzIHRoZSBhc3luY2lvIGV2ZW50IGxvb3AuIEFkZGl0aW9uYWxseSwgdHdvIGhvdC1wYXRoIGxvZyBzdGF0ZW1lbnRzIGVhZ2VybHkgZm9ybWF0IGxhcmdlIHJlc3BvbnNlIG9iamVjdHMgZXZlbiB3aGVuIERFQlVHIGxvZ2dpbmcgaXMgZGlzYWJsZWQuXG5cbiMjIFJlcHJvZHVjZVxuXG5gYGBweXRob25cbmZyb20gbGl0ZeKApiJ9
```
}