https://github.com/berriai/litellm/issues/31966 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTk2NiIsImhlYWRsaW5lIjoiIzMxOTY2IFtCdWddOiAvdjEvbW9kZWxzIGRvZXMgbm90IHJlc29sdmUgZW50aXR5IEFjY2VzcyBHcm91cHMgKGFjY2Vzc19ncm91cF9pZHMpIC0gb25seSBzaG93cyAnbm8tZGVmYXVsdC1tb2RlbHMnIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBLZXZpblJvaG4iLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuSSBtYW5hZ2UgbW9kZWwgYWNjZXNzIHdpdGggdGhlIG5ldyBBY2Nlc3MgR3JvdXBzICh0aGUgZW50aXR5IG9uZXMgZnJvbSBgL3YxL2FjY2Vzc19ncm91cGAsIGF0dGFjaGVkIHRvIHRlYW1zIHZpYSBgYWNjZXNzX2dyb3VwX2lkc2ApLiBUaGUgdGVhbXMgaGF2ZSBgbW9kZWxzOiBbXCJuby1kZWZhdWx0LW1vZGVsc1wiXWAgc28gdGhleSBvbmx5IGdldCB3aGF0IHRoZSBncm91cHMgZ3JhbnQuXG5cbmBHRVQgL3YxL21vZGVsc2Agd2l0aCB0aG9zZSBzYW1lIGtleXMgcmV0dXJucyAqKm5vbmUqKiBvZiB0aGVzZSBtb2RlbHMuIFRoZSBvbmx5IHRoaW5nIGluIHRoZSByZXNwb25zZSBpcyB0aGUgbGl0ZXJhbCBzdHJpbmcgYG5vLWRlZmF1bHQtbW9kZWxzYCwgYXMgaWYgaXQgd2VyZSBhIG1vZGVsLlxuXG5TbyBteSBhcHBzIGdldCBhbiBlbXB0eSBtb2RlbCBwaWNrZXIgd2l0aCBvbmUgZmFrZSBlbnRyeSBpbiBpdC4gTWVhbndoaWxlIHRoZSBtb2RlbHMgd29yayBmaW5lIGlmIHlvdSB0eXBlIHRoZWlyIG5hbWVzIG1hbnVhbGx5LlxuXG5Gcm9tIHdoYXQgSSBjYW4gdGVsbCwgdHdvIHRoaW5ncyBhcmUgZ29pbmcgb246XG5cbjEuIFRoZSBjb2RlIHRoYXQgYnVpbGRzIHRoZSBgL3YxL21vZGVsc2AgcmVzcG9uc2UgbmV2ZXIgbG9va3MgYXQgYGFjY2Vzc19ncm91cF9pZHNgLiBJdCBvbmx5IGZvbGxvd3MgdGhlIGBtb2RlbHNgIGZpZWxkcy5cbjIuIEJlY2F1c2UgdGhlIHJlc29sdmVyIGVuZHMgdXAgaG9sZGluZyBgbm8tZGVmYXVsdC1tb2RlbHNgIGFuZCBjYW4gbm90IG1hdGNoIGl0IHRvIGFueXRoaW5nLCBpdCBqdXN0IHBhc3NlcyBpdCB0aHJvdWdoIGludG8gdGhlIHJlc3BvbnNlLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbjEuIENyZWF0ZSBhbiBhY2Nlc3MgZ3JvdXAgY29udGFpbmluZyBpdDpcbiAgIGBgYFxuICAgY3VybCAtWCBQT1NUIFwiJFBST1hZL3YxL2FjY2Vzc19ncm91cFwiIC1IIFwiQXV0aG9yaXphdGlvbjogQmVhcmVyICRNQVNURVJfS0VZXCIgXFxcbiAgICAgLUggXCJDb250ZW50LVR5cGU6IGFwcGxpY2F0aW9uL2pzb25cIiBcXFxuICAgICAtZCAne1wiYWNjZXNzX2dyb3VwX25hbWVcIjog4oCmIn0=
```
}