https://github.com/berriai/litellm/issues/31594 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU5NCIsImhlYWRsaW5lIjoiIzMxNTk0IFtCdWddOiBjb3N0X2JyZWFrZG93biBtaXNzaW5nIGNhY2hlX3JlYWRfY29zdC9jYWNoZV9jcmVhdGlvbl9jb3N0IGZvciBEZWVwU2VlayAvIE9wZW5BSS1jb21wYXRpYmxlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBlcmRqaWVsIiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBwcm9tcHRpbmcgRGVlcFNlZWsgKipkaXJlY3RseSoqLCB0aGUgQVBJIHJlc3BvbnNlIGluY2x1ZGVzIGNhY2hlIHRva2VuIGluZm9ybWF0aW9uIGluIGB1c2FnZS5wcm9tcHRfdG9rZW5zX2RldGFpbHMuY2FjaGVkX3Rva2Vuc2AuIEZvciBleGFtcGxlLCBhIGNhY2hlLWhpdCByZXNwb25zZSBmcm9tIERlZXBTZWVrIGxvb2tzIGxpa2U6XG5cbmBgYGpzb25cbntcbiAgXCJ1c2FnZVwiOiB7XG4gICAgXCJwcm9tcHRfdG9rZW5zXCI6IDEzNjE1MyxcbiAgICBcImNvbXBsZXRpb25fdG9rZW5zXCI6IDQxOCxcbiAgICBcInByb21wdF90b2tlbnNfZGV0YWlsc1wiOiB7XG4gICAgICBcImNhY2hlZF90b2tlbnNcIjogMTM1OTM2XG4gICAgfVxuICB9XG59XG5gYGBcblxuV2hlbiByb3V0aW5nIHRoZSAqKnNhbWUgcmVxdWVzdCB0aHJvdWdoIExpdGVMTE0gUHJveHkqKiwgdGhlIHNwZW5kIGxvZydzIGBjb3N0X2JyZWFrZG93bmAgb25seSBzaG93cyBgaW5wdXRfY29zdGAsIGBvdXRwdXRfY29zdGAsIGFuZCBgdG90YWxfY29zdGAg4oCUICoqbm8gYGNhY2hlX3JlYWRfY29zdGAgZmllbGQgYXBwZWFycyoqLCBldmVuIHRob3VnaCB0aGUgcHJveHkgYWxyZWFkeSBhcHBsaWVkIHRoZSBjb3JyZWN0IGNhY2hlIGRpc2NvdW50IHRvIHRoZSB0b3RhbC4gVGhlIGJyZWFrZG93biBpcyBvcGFxdWU6IHRoZXJlJ3Mgbm8gd2F5IHRvIHNlZSBob3cgbXVjaCBvZiBgaW5wdXRfY29zdGAgY2FtZSBmcm9tIGNhY2hlIGhpdHMgdnMgY2FjaGUgbWlzc2VzLlxuXG5UaGUgYGNvbXBsZXRpb25fY29zdCgpYCBmdW5jdGlvbiBvbmx5IGNoZWNrcyBgdXNhZ2UuY2FjaGVfcmVhZF9pbnB1dF90b2tlbnNgIChBbnRocm9waWMgY29udmVudGlvbikuIERlZXBTZWVrIChPcGVuQUktY29tcGF0aWJsZSkgcmV0dXJucyBjYWNoZSB0b2tlbnMgYXMgYHVzYWdlLnByb21wdF90b2tlbnNfZGV0YWlscy5jYWNoZWRfdG9rZW5zYC4gVGhlIGBVc2FnZWAgUHlkYW50aWMgbW9kZWwgZG9lcyAqKm5vdCoqIGhhdmUgYSBkaXJlY3QgYGNhY2hlX3JlYWRfaW5wdXRfdG9rZW5zYCBmaWVsZCDigJQgc28gYGdldGF0dHIob2JqLCBcImNhY2hlX3JlYWRfaW5wdXRfdG/igKYifQ==
```
}