https://github.com/berriai/litellm/issues/31245 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTI0NSIsImhlYWRsaW5lIjoiIzMxMjQ1IFtCdWddOiBjbG9zZV9saXRlbGxtX2FzeW5jX2NsaWVudHMoKSBuZXZlciBjbG9zZXMgY2FjaGVkIEFzeW5jT3BlbkFJIGNsaWVudHMgKGxlYWtzIFwiVW5jbG9zZWQgY2xpZW50IHNlc3Npb25cIikiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG1wZ2VybGVrIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5gY2xvc2VfbGl0ZWxsbV9hc3luY19jbGllbnRzKClgIGlzIHN1cHBvc2VkIHRvIGNsb3NlIGV2ZXJ5IGNhY2hlZCBhc3luYyBIVFRQXG5jbGllbnQgYXQgc2h1dGRvd24uIEl0IG1pc3NlcyB0aGUgY2FjaGVkICoqT3BlbkFJIFNESyoqIGNsaWVudHMuXG5cbmxpdGVsbG0gY2FjaGVzIHRoZSBPcGVuQUkgY2xpZW50IGFzIGFuIGBvcGVuYWkuQXN5bmNPcGVuQUlgIG9iamVjdCAodmlhXG5gQmFzZU9wZW5BSUxMTS5zZXRfY2FjaGVkX29wZW5haV9jbGllbnRgIOKGkiBgaW5fbWVtb3J5X2xsbV9jbGllbnRzX2NhY2hlYCksIGFuZFxuYnVpbGRzIGl0IG9uIGxpdGVsbG0ncyBvd24gYWlvaHR0cCB0cmFuc3BvcnRcbihgT3BlbkFJQ2hhdENvbXBsZXRpb24uX2dldF9hc3luY19odHRwX2NsaWVudGAg4oaSXG5gQXN5bmNIVFRQSGFuZGxlci5fY3JlYXRlX2FzeW5jX3RyYW5zcG9ydGApLiBTbyBlYWNoIGNhY2hlZCBPcGVuQUkgY2xpZW50IG93bnMgYW5cbmFpb2h0dHAgYENsaWVudFNlc3Npb25gLlxuXG5CdXQgdGhlIGNsZWFudXAgbG9vcCBpbiBgYXN5bmNfY2xpZW50X2NsZWFudXAucHlgIGRpc3BhdGNoZXMgb24gdGhyZWUgc2hhcGVzOlxuXG5gYGBweXRob25cbmlmIGlzaW5zdGFuY2UoaGFuZGxlciwgQmFzZUxMTUFJT0hUVFBIYW5kbGVyKSBhbmQgaGFzYXR0cihoYW5kbGVyLCBcImNsb3NlXCIpOiAuLi5cbmVsaWYgaGFzYXR0cihoYW5kbGVyLCBcImNsaWVudFwiKTogICAgICAgICAgICAgICAgICAgICAgIyBBc3luY0hUVFBIYW5kbGVyXG4gICAgLi4uXG5lbGlmIGhhc2F0dHIoaGFuZGxlciwgXCJhY2xvc2VcIik6ICAgICAgICAgICAgICAgICAgICAgICMgXCJhbnkgb3RoZXIgb2JqZWN0c1wiXG4gICAgYXdhaXQgaGFuZGxlci5hY2xvc2UoKVxuYGBgXG5cbmBBc3luY09wZW5BSWAgbWF0Y2hlcyAqKm5vbmUqKiBvZiB0aGVzZTogaXQgaXMgbm90IGEgYEJhc2VMTE1BSU9IVFRQSGFuZGxlcmAsIGl0XG5oYXMgbm8gYC5jbGllbnRgIGF0dHJpYnV0ZSwgYW5kIGl0cyBhc3luYyB0ZWFyZG93biBpcyBuYW1lZCBgLmNsb3NlKClgLCAqKm5vdFxuYC5hY2xvc2UoKWAqKi4gU28gZXZlcnkgY2FjaGVkIE9wZW5BSS9BenVyZS1PcGVuQUkgY2xpZW50IGZhbGxzIHRocm91Z2ggYWxsIHRocmVlXG5icmFuY2hlcyBhbmQgaXMgbmV2ZXIgY2xvc2VkIOKAlCBpdHMgYWlvaHR0cCBzZXNzaW9uIHN1cmZhY2VzIGFzXG5gVW5jbG9zZWQgY2xpZW50IHNlc3PigKYifQ==
```
}