https://github.com/berriai/litellm/issues/30501 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDUwMSIsImhlYWRsaW5lIjoiIzMwNTAxIFtGZWF0dXJlXTogU3VwcG9ydCBPcGVuQUkgYHZpZGVvX3VybGAgY29udGVudCBmb3IgR2VtaW5pIGNoYXQgY29tcGxldGlvbnMgKFZlcnRleCBBSSAvIEdvb2dsZSBBSSBTdHVkaW8pIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBsYXJhd3MiLCJMYWJlbHM6IGVuaGFuY2VtZW50LCBsbG0gdHJhbnNsYXRpb24sIFNESyJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5QbGVhc2UgYWRkIG5hdGl2ZSBzdXBwb3J0IGZvciBPcGVuQUktY29tcGF0aWJsZSBgdmlkZW9fdXJsYCBtZXNzYWdlIGNvbnRlbnQgd2hlbiB1c2luZyBHZW1pbmkgbW9kZWxzIHRocm91Z2ggTGl0ZUxMTSAoYHZlcnRleF9haS8uLi5gIGFuZCBgZ2VtaW5pLy4uLmAgcGF0aHMpLlxuXG5XaGVuIGEgcmVxdWVzdCBjb250YWluczpcblxuYGBganNvblxue1xuICBcInR5cGVcIjogXCJ2aWRlb191cmxcIixcbiAgXCJ2aWRlb191cmxcIjogeyBcInVybFwiOiBcImRhdGE6dmlkZW8vbXA0O2Jhc2U2NCwuLi5cIiB9XG59XG5gYGBcblxuTGl0ZUxMTSBzaG91bGQgY29udmVydCBpdCBpbnRvIGEgR2VtaW5pLWNvbXBhdGlibGUgbWVkaWEgcGFydCAoZm9yIGV4YW1wbGUgdmlhIGBmaWxlX2RhdGFgICsgTUlNRSB0eXBlKSwgc2ltaWxhciB0byBob3cgb3RoZXIgbXVsdGltb2RhbCBjb250ZW50IGlzIG5vcm1hbGl6ZWQuXG5cblJlcXVlc3RlZCBiZWhhdmlvcjpcblxuMS4gQWNjZXB0IGB2aWRlb191cmxgIGluIE9wZW5BSSBjaGF0IGNvbnRlbnQgYXJyYXlzIGZvciBHZW1pbmkgcm91dGVzLlxuMi4gU3VwcG9ydCBib3RoIGBkYXRhOmAgVVJMcyBhbmQgcmVndWxhciBwdWJsaWMgVVJMcy5cbjMuIEluZmVyIE1JTUUgdHlwZSB3aGVuIHBvc3NpYmxlIGFuZCBhbGxvdyBleHBsaWNpdCBvdmVycmlkZS5cbjQuIFByZXNlcnZlIG9wdGlvbmFsIG1ldGFkYXRhIChlLmcuIGB2aWRlb19tZXRhZGF0YWApIGlmIHByb3ZpZGVkLlxuNS4gUmV0dXJuIGEgY2xlYXIgdmFsaWRhdGlvbiBlcnJvciBpZiBjb252ZXJzaW9uIGlzIGltcG9zc2libGUgKGluc3RlYWQgb2Ygc2lsZW50bHkgaWdub3JpbmcgbWVkaWEpLlxuXG4jIyMgTW90aXZhdGlvbiwgcGl0Y2hcblxuV2UgcmVseSBvbiBPcGVuQUktY29tcGF0aWJsZSBwYXlsb2FkcyBhY3Jvc3MgbXVsdGlwbGUgcHJvdmlkZXJzLiBGb3IgR2VtaW5pIG1vZGVscyBpbiBMaXRlTExNLCBgdmlkZW9fdXJsYCBpcyBjdXJyZW50bHkgbm90IHJlY29nbml6ZWQgaW4gcHJhY3RpY2UsIHNvIHZpZGVvIGlucHV0IGlzIGVmZmVjdGl2ZWx5IGxvc3QuXG5cbk9ic2VydmVkIHJlc3VsdDpcbi0gTW9kZWwgcmVzcG9uZHMgYXMg4oCmIn0=
```
}