https://github.com/berriai/litellm/issues/31279 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTI3OSIsImhlYWRsaW5lIjoiIzMxMjc5IFtCdWddOiBgL3YxL21lc3NhZ2VzYCBhZGFwdGVyIHJlcGxheXMgYHRoaW5raW5nX2Jsb2Nrc2AgdG8gT3BlbkFJLWNvbXBhdGlibGUgYmFja2VuZHMsIGNhdXNpbmcgcmVwZXRpdGlvbiBsb29wcyBvbiBsb25nIHRvb2wgY2hhaW5zIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEB0b21hc2tpciIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uLCBjbGF1ZGUgY29kZSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIHRoZSBBbnRocm9waWMgYC92MS9tZXNzYWdlc2AgZXhwZXJpbWVudGFsIGFkYXB0ZXIgcHJveGllcyBhICoqbXVsdGktdHVybiwgdG9vbC11c2luZyoqIGNvbnZlcnNhdGlvbiB0byBhbiAqKk9wZW5BSS1jb21wYXRpYmxlIHJlYXNvbmluZyBiYWNrZW5kKiogKHZMTE0vU0dMYW5nIHNlcnZpbmcgYSBEZWVwU2VlayBcInRoaW5raW5nXCIgbW9kZWwpLCB0aGUgYXNzaXN0YW50IGRlZ2VuZXJhdGVzIGludG8gKipwaHJhc2UgcmVwZXRpdGlvbioqIHRoYXQgKipncm93cyB3aXRoIGNvbnZlcnNhdGlvbiBsZW5ndGgqKjpcblxuYGBgXG5Db250aW51aW5nLlxuQ29udGludWluZy5cbkNvbnRpbnVpbmcuXG5gYGBcblxuSXQgaXMgaW52aXNpYmxlIG9uIHNob3J0IGNvbnZlcnNhdGlvbnMgYW5kIG9ubHkgYXBwZWFycyBvbmNlIHRoZSBoaXN0b3J5IGlzIGxvbmcgKOKJiDgrIHRvb2wgdHVybnMpLiBUaGUgc3RyZWFtZWQgU1NFIGlzIHdlbGwtZm9ybWVkIC0gbm8gZXJyb3IsIG5vIGZhbGxiYWNrIC0gdGhlIG1vZGVsIGdlbnVpbmVseSBnZW5lcmF0ZXMgdGhlIHJlcGVhdGVkIHRva2Vucy5cblxuKipSb290IGNhdXNlLioqIGBMaXRlTExNQW50aHJvcGljTWVzc2FnZXNBZGFwdGVyLnRyYW5zbGF0ZV9hbnRocm9waWNfbWVzc2FnZXNfdG9fb3BlbmFpYFxuKGBsaXRlbGxtL2xsbXMvYW50aHJvcGljL2V4cGVyaW1lbnRhbF9wYXNzX3Rocm91Z2gvYWRhcHRlcnMvdHJhbnNmb3JtYXRpb24ucHlgKSBhdHRhY2hlcyB0aGVcbmB0aGlua2luZ19ibG9ja3NgIGZpZWxkIHRvICoqZXZlcnkgcmVwbGF5ZWQgYXNzaXN0YW50IHR1cm4sIGZvciBldmVyeSBiYWNrZW5kKio6XG5cbmBgYHB5dGhvblxuYXNzaXN0YW50X21lc3NhZ2UgPSBDaGF0Q29tcGxldGlvbkFzc2lzdGFudE1lc3NhZ2UoXG4gICAgcm9sZT1cImFzc2lzdGFudFwiLFxuICAgIGNvbnRlbnQ9YXNzaXN0YW50X2NvbnRlbnQsXG4gICAgdGhpbmtpbmdfYmxvY2tzPSh0aGlua2luZ19ibG9ja3MgaWYgbGVuKHRoaW5raW5nX2Jsb2NrcykgPiAwIGVsc2UgTm9uZSksXG4pXG4uLi5cbmlmIGxlbih0aGlua2luZ19ibG9ja3MpID4gMDpcbiAgICBhc3Npc3RhbnRfbWVzc+KApiJ9
```
}