https://github.com/berriai/litellm/issues/31976 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTk3NiIsImhlYWRsaW5lIjoiIzMxOTc2IFtCdWddOiBgQmVkcm9ja0d1YXJkcmFpbGAgd2l0aCBgZGlzYWJsZV9leGNlcHRpb25fb25fYmxvY2s9VHJ1ZWAgc2lsZW50bHkgYnlwYXNzZXMgYmxvY2sgb24gYC92MS9tZXNzYWdlc2AgcmVxdWVzdHMiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG12cmliZWlybzc1IiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIGBkaXNhYmxlX2V4Y2VwdGlvbl9vbl9ibG9jaz1UcnVlYCBpcyBzZXQgb24gYSBgQmVkcm9ja0d1YXJkcmFpbGAsIGJsb2NrZWQgYC92MS9tZXNzYWdlc2AgcmVxdWVzdHMgYXJlICoqc2lsZW50bHkgYWxsb3dlZCB0aHJvdWdoKiogdG8gdGhlIHVuZGVybHlpbmcgbW9kZWwuIFRoZSBndWFyZHJhaWwgZmlyZXMgY29ycmVjdGx5IGFuZCB0aGUgQmVkcm9jayBBcHBseUd1YXJkcmFpbCBBUEkgZGV0ZWN0cyB0aGUgdmlvbGF0aW9uLCBidXQgdGhlIGJsb2NrIGhhcyBubyBlZmZlY3QgYW5kIHRoZSBtb2RlbCBjYWxsIHByb2NlZWRzIGFuZCByZXR1cm5zIGEgcmVhbCByZXNwb25zZSB0byB0aGUgY2xpZW50LlxuXG4jIyMgUm9vdCBDYXVzZVxuXG5Ud28gY29tcG9uZW50cyBhcmUgb3V0IG9mIHN5bmM6XG5cbioqMS4gYGFzeW5jX3ByZV9jYWxsX2hvb2tgIGluIGBiZWRyb2NrX2d1YXJkcmFpbHMucHlgKiogKGludHJvZHVjZWQgaW4gdjEuNzguOCwgY29tbWl0IGBiOTBlOTE2YCkgc2V0cyBhIGBNb2RlbFJlc3BvbnNlYCBvYmplY3QgYXMgdGhlIG1vY2sgcmVzcG9uc2Ugd2hlbiBjb250ZW50IGlzIGJsb2NrZWQ6XG5cbmBgYHB5dGhvblxuIyBiZWRyb2NrX2d1YXJkcmFpbHMucHlcbmV4Y2VwdCBHdWFyZHJhaWxJbnRlcnZlbnRpb25Ob3JtYWxTdHJpbmdFcnJvciBhcyBlOlxuICAgIGJlZHJvY2tfZ3VhcmRyYWlsX3Jlc3BvbnNlID0gZS5tZXNzYWdlXG4uLi5cbmlmIGlzaW5zdGFuY2UoYmVkcm9ja19ndWFyZHJhaWxfcmVzcG9uc2UsIHN0cik6XG4gICAgZGF0YVtcIm1vY2tfcmVzcG9uc2VcIl0gPSBzZWxmLmNyZWF0ZV9ndWFyZHJhaWxfYmxvY2tlZF9yZXNwb25zZShcbiAgICAgICAgcmVzcG9uc2U9YmVkcm9ja19ndWFyZHJhaWxfcmVzcG9uc2VcbiAgICApXG5cbmRlZiBjcmVhdGVfZ3VhcmRyYWlsX2Jsb2NrZWRfcmVzcG9uc2Uoc2VsZiwgcmVzcG9uc2U6IHN0cikgLT4gTW9kZWxSZXNwb25zZTpcbiAgICByZXR1cm4gTW9kZWxSZXNwb25zZShcbiAgICAgICAgY2hvaWNlcz1bQ2hvaWNlcyhtZXNzYWdlPU1lc3NhZ2UoY29udGVudD1yZXNwb25zZSkpXSxcbiAgICAgICAgbW9kZWw9XCJiZWRyb2NrLWd1YXJkcmFpbFwiLFxuICAgIClcbmBgYFxuXG4qKjIuIFRoZSBgL3YxL21lc3NhZ2VzYCBoYW5kbGVyKiogKGBtZXNzYWdlcy9oYW5kbGVyLnB5YCwgbGluZSB+NDI2LCBjaGVjayBpbnRyb2R1Y2VkIHYxLjc0LjEsIGPigKYifQ==
```
}