https://github.com/berriai/litellm/issues/31934 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTkzNCIsImhlYWRsaW5lIjoiIzMxOTM0IFtCdWddOiBQcm9qZWN0ZWQgbGltaXQgYWxlcnRpbmcgaWdub3JlcyBidWRnZXQgcmVzZXQgcGVyaW9kIChkYWlseS93ZWVrbHkvbW9udGhseSkiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG5odDEyMDYiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBhIGJ1ZGdldCBpcyBjb25maWd1cmVkIHRvIHJlc2V0IGRhaWx5IChlLmcuIGJ1ZGdldF9kdXJhdGlvbjogXCIxZFwiKSwgdGhlIGBwcm9qZWN0ZWRfZXhjZWVkZWRfZGF0ZWAgc3RpbGwgY2FsY3VsYXRlcyBiYXNlZCBvbiBkYXlzIHJlbWFpbmluZyBpbiB0aGUgbW9udGgsIG5vdCB0aGUgY3VycmVudCBkYXkuXG5UaGlzIGNhdXNlcyBtaXNsZWFkaW5nIGFsZXJ0cyB0aGF0IHNob3cgdGhlIGJ1ZGdldCB3aWxsIGJlIGV4Y2VlZGVkIG9uIGEgZGF5IGluIHRoZSBmdXR1cmUsIHdoZW4gaW4gcmVhbGl0eSB0aGUgYnVkZ2V0IHJlc2V0cyBhdCBtaWRuaWdodC5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBDcmVhdGVzIGEga2V5IHdpdGggYSBkYWlseSByZXNldCBwZXJpb2QgYW5kIGEgYnVkZ2V0IG9mICQxMFxuMi4gQ29uZmlndXJlIGFsZXJ0aW5nIChTbGFjaykgdG8gcmVjZWl2ZSBgcHJvamVjdGVkX2xpbWl0X2V4Y2VlZGVkYCBhbGVydHNcbjMuIE1ha2UgQVBJIHJlcXVlc3RzIHVzaW5nIHRoZSBnZW5lcmF0ZWQga2V5IHRvIGFjY3VtdWxhdGUgc3BlbmRcbjQuIE9ic2VydmUgdGhlIGFsZXJ0XG5cblxuIyMjIFJlbGV2YW50IGxvZyBvdXRwdXRcblxuYGBgc2hlbGxcblxuYGBgXG5cbiMjIyBXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0P1xuXG5Qcm94eVxuXG4jIyMgV2hhdCBMaXRlTExNIHZlcnNpb24gYXJlIHlvdSBvbiA/XG5cbnYxLjg1LjFcblxuIyMjIFR3aXR0ZXIgLyBMaW5rZWRJbiBkZXRhaWxzXG5cbl9ObyByZXNwb25zZV8ifQ== ``` }