https://github.com/berriai/litellm/issues/30617 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDYxNyIsImhlYWRsaW5lIjoiIzMwNjE3IFtCdWddOiBTdHJlYW1pbmcgdG9vbC1jYWxsIHJlc3BvbnNlcyBjcmFzaCB3aXRoIFR5cGVFcnJvcjogJ01vY2tWYWxTZXInIG9iamVjdCBpcyBub3QgYW4gaW5zdGFuY2Ugb2YgJ1NjaGVtYVNlcmlhbGl6ZXInIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBsaXp6emNhaSIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyBEZXNjcmliZSB0aGUgYnVnXG5cbldoZW4gYSBzdHJlYW1pbmcgcmVzcG9uc2UgY29udGFpbnMgdG9vbCBjYWxscyAob3IgbG9ncHJvYnMpLCBMaXRlTExNIGNyYXNoZXMgbWlkLXN0cmVhbSB3aXRoOlxuXG5gYGBcblR5cGVFcnJvcjogJ01vY2tWYWxTZXInIG9iamVjdCBpcyBub3QgYW4gaW5zdGFuY2Ugb2YgJ1NjaGVtYVNlcmlhbGl6ZXInXG5gYGBcblxuVGhlIHN0cmVhbSB0ZXJtaW5hdGVzIGVhcmx5IGFuZCB0aGUgY2xpZW50IHJlY2VpdmVzIG5vIHRvb2wgY2FsbCBjb250ZW50LlxuXG4jIyBSb290IGNhdXNlXG5cbmBvcGVuYWkuX21vZGVscy5CYXNlTW9kZWxgIHNldHMgYGRlZmVyX2J1aWxkPVRydWVgLCBzbyBhbGwgb3BlbmFpIFNESyBzdWJjbGFzc2VzIHN0YXJ0IHdpdGggYE1vY2tWYWxTZXJgIGFzIHRoZWlyIHB5ZGFudGljIHNlcmlhbGl6ZXIuIFRoZSBkZWZlcnJlZCBidWlsZCBmaXJlcyBvbiBgX19pbml0X19gLCBidXQgdGhlIFNESyBhbHdheXMgcGFyc2VzIHN0cmVhbWluZyByZXNwb25zZXMgdmlhIGBtb2RlbF92YWxpZGF0ZSgpYCwgd2hpY2ggZG9lcyBub3QgdHJpZ2dlciB0aGUgYnVpbGQuIFNvIG9iamVjdHMgbGlrZSBgQ2hvaWNlTG9ncHJvYnNgIGFuZCBgQ2hvaWNlRGVsdGFUb29sQ2FsbGAgcmV0YWluIGBNb2NrVmFsU2VyYCBhZnRlciBwYXJzaW5nLlxuXG5gc3RyZWFtaW5nX2hhbmRsZXIucHlgIHN0b3JlcyB0aGVzZSByYXcgU0RLIG9iamVjdHMgYXMgZXh0cmEgZmllbGQgdmFsdWVzIGluIGBNb2RlbFJlc3BvbnNlU3RyZWFtYC4gV2hlbiBgcHJveHlfc2VydmVyLl9zZXJpYWxpemVfc3RyZWFtaW5nX2NodW5rKClgIGNhbGxzIGBtb2RlbF9kdW1wX2pzb24oKWAsIHB5ZGFudGljJ3MgUnVzdCBjb3JlIGxvb2tzIHVwIGB0eXBlKHZhbHVlKS5fX3B5ZGFudGljX3NlcmlhbGl6ZXJfX2AgYXQgdGhlIEMgbGV2ZWwgKG5vIFB5dGhvbiBgX19nZXRhdHRyX19gIGZhbGxiYWNrKSwgZmluZHMgYE1vY2tWYWxTZXJgLCBhbmQgcmFpc2VzIGBUeXBlRXJyb3JgLlxuXG5UaGUgY3Jhc2ggaXMgaW50ZXJtaXR0ZW50OiBgbW9kZWxfZHVtcCgpYCBhY2NpZGVudGFsbHkgc2VsZi1oZWFscyB2aWEgYE1vY2tWYWxTZXIuX19nZXRhdHRyX19gIC0+IGBhdHRlbXB0X3JlYnVpbGQoKWAuIElmIGEgdXNhZ2UgY2h1bmsgdHJpZ2dlcnMgYG1vZGVsX2R1bXAoKWAgZmlyc3QsIHRoZSBjbGFzcyBpcyByZWJ1aWx0IGFzIGEgc2lkZSBl4oCmIn0= ``` }