https://github.com/berriai/litellm/issues/31562 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU2MiIsImhlYWRsaW5lIjoiIzMxNTYyIFtCdWddOiBCYXNlTW9kZWxSZXNwb25zZUl0ZXJhdG9yIGZhbHNlbHkgdGVybWluYXRlcyBzdHJlYW0gd2hlbiB0b29sLWNhbGwgYXJndW1lbnRzIGNvbnRhaW4gXCJbRE9ORV1cIiIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAY2hlbmJvamlhbiIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbmBCYXNlTW9kZWxSZXNwb25zZUl0ZXJhdG9yLl9oYW5kbGVfc3RyaW5nX2NodW5rYCB1c2VzIGEgc3Vic3RyaW5nIGNoZWNrIChgaWYgXCJbRE9ORV1cIiBpbiBzdHJfbGluZWApIHRvIGRldGVjdCB0aGUgU1NFIHRlcm1pbmF0aW9uIHNpZ25hbC4gVGhpcyBjYXVzZXMgZmFsc2Ugc3RyZWFtIHRlcm1pbmF0aW9uIHdoZW4gYSBwcm92aWRlciBzZW5kcyBhIHZhbGlkIEpTT04gY2h1bmsgd2hvc2Ugc3RyaW5nIHZhbHVlcyBoYXBwZW4gdG8gY29udGFpbiB0aGUgbGl0ZXJhbCBcIltET05FXVwiLlxuXG5Gb3IgZXhhbXBsZSwgaWYgYSBtb2RlbCBnZW5lcmF0ZXMgYSB0b29sIGNhbGwgd2l0aCBhcmd1bWVudHMgbGlrZSBge1wiY29tbWFuZFwiOiBcIltET05FXSByZXNldFwifWAsIG9yIGFueSBKU09OIHBheWxvYWQgY29udGFpbmluZyBcIltET05FXVwiIGFzIGEgc3Vic3RyaW5nLCB0aGUgc3RyZWFtIGlzIHByZW1hdHVyZWx5IGN1dCBvZmYuIFRoZSB1c2VyIHNlZXMgYSB0cnVuY2F0ZWQgcmVzcG9uc2Ugd2l0aCBubyBlcnJvci5cblxuVGhpcyBhZmZlY3RzIGFsbCBwcm92aWRlcnMgdXNpbmcgYEJhc2VNb2RlbFJlc3BvbnNlSXRlcmF0b3JgOiBEYXRhYnJpY2tzLCBPcGVuUm91dGVyLCBPVkhDbG91ZCwgQ2xvdWRmbGFyZSwgVHJpdG9uLCBBMkEsIFdhdHNvbngsIEFudGhyb3BpYyBjb21wbGV0aW9uLCBPbGxhbWEsIENvbWV0QVBJLCBCZWRyb2NrIERlZXBTZWVrLCBWZXJ0ZXggQUkgYWdlbnQgZW5naW5lLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cblVzaW5nIGFueSBwcm92aWRlciB0aGF0IHJvdXRlcyB0aHJvdWdoIGBCYXNlTW9kZWxSZXNwb25zZUl0ZXJhdG9yYCwgdHJpZ2dlciBhIHN0cmVhbWluZyByZXNwb25zZSB3aGVyZSB0aGUgbW9kZWwncyBvdXRwdXQgY29udGFpbnMgdGhlIGxpdGVyYWwgc3RyaW5nIFwiW0RPTkVdXCIgaW5zaWRlIEpTT04gY29udGVudCAoZS5nLiBpbnNpZGUgdG9vbC1jYWxsIGFyZ3VtZW50cykuXG5cblRoZSBzaW1wbGVzdCBwcm9ncmFtbWF0aWMgcmVwcm9kdWN0aW9uOlxuXG5gYGBweXRob25cbmZyb20gbGl0ZWxsbS5sbG1zLmJhc2VfbGxtLmJhc2VfbW9kZWxfaXRl4oCmIn0=
```
}