https://github.com/berriai/litellm/issues/32042 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMjA0MiIsImhlYWRsaW5lIjoiIzMyMDQyIFtCdWddOiBTdG9wIGZvcmNpbmcgY2xlYW4gY2xpZW50cyB0byBmaXggeW91ciBnYXRld2F5J3MgYXJjaGl0ZWN0dXJhbCBmbGF3cyEgRml4IHRoZSByaWdpZCBwYXJhbWV0ZXIgYmxvY2tpbmcuIOWIq+WGjemAvOedgOaXoOi+nOeahOWuouaIt+err+WOu+e7mee9keWFs+eahOaetuaehOe8uumZt+aTpuWxgeiCoeS6hu+8geeri+WIu+S/ruWkjeatu+adv+eahOWPguaVsOaLpuaIqumAu+i+keOAgiIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAd2hlbmd1IiwiTGFiZWxzOiBidWcsIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG4jIyMgVGl0bGVcblVuYmVsaWV2YWJseSBicmFpbi1kZWFkIGRlc2lnbi4gWW91ciByaWdpZCBwYXJhbWV0ZXIgYmxvY2tpbmcgaXMgbGl0ZXJhbGx5IGJyaWNraW5nIGNvbXBsaWFudCBjbGllbnRzLiBGaXggdGhpcyBnYXJiYWdlLlxuXG4jIyMgQm9keVxuXG4qKkRlc2NyaWJlIHRoZSBidWcqKlxuTGV0J3MgY3V0IHRoZSBwb2xpdGUgY3JhcDogd2hvIGluIHRoZWlyIHJpZ2h0IG1pbmQgdGhvdWdodCBpdCB3YXMgYSBicmlsbGlhbnQgaWRlYSB0byBoYXZlIGEgZ2F0ZXdheSBoYXJkY29kZSBhIHBhcmFtZXRlciB3aGl0ZWxpc3QgYW5kIHRocm93IGEgYDQwMCBVbnN1cHBvcnRlZFBhcmFtc0Vycm9yYCBmb3Igc3RhbmRhcmQgcGFyYW1ldGVycz8gXG5cblJpZ2h0IG5vdywgc2VuZGluZyBhIGNvbXBsZXRlbHkgc3RhbmRhcmQgcGFyYW1ldGVyIGxpa2UgYHJlYXNvbmluZ19lZmZvcnRgIHRvIGEgcHJlbWllciBwcm92aWRlciB2aWEgYGRlZXBzZWVrLXY0LXByb2AgcmVzdWx0cyBpbiBMaXRlTExNIGNvbXBsZXRlbHkgYnJpY2tpbmcgdGhlIHJlcXVlc3QuIFRoZSBjbGllbnQgaXMgMTAwJSBjb21wbGlhbnQuIFRoZSB1cHN0cmVhbSBwcm92aWRlciBoYW5kbGVzIGl0IHBlcmZlY3RseS4gWWV0LCBMaXRlTExNIHNpdHMgaW4gdGhlIG1pZGRsZSBsaWtlIGEgY2x1ZWxlc3MsIG5vc3kgbWlkZGxlbWFuLCBibG9ja2luZyBwcm9kdWN0aW9uIHRyYWZmaWMganVzdCBiZWNhdXNlIGl0IGRvZXNuJ3QgcmVjb2duaXplIHRoZSBwYXJhbWV0ZXIuIFxuXG5UaGlzIHN0dXBpZCByZXN0cmljdGlvbiBzZXJ2ZXMgYWJzb2x1dGVseSBaRVJPIHB1cnBvc2UuIEl0IGlzIHB1cmVseSByZWR1bmRhbnQsIHBhdHJvbml6aW5nLCBhbmQgdXR0ZXJseSBicmFpbi1kZWFkLlxuXG4qKldoeSB0aGlzIGRlc2lnbiBpcyBhIGpva2U6KipcbkEgZ2F0ZXdheSBpcyBzdXBwb3NlZCB0byBiZSBhIHRyYW5zcGFyZW50IHBpcGUuIEl0IHJvdXRlcywgaXQgYXV0aGVzLCBpdCBzdGF5cyBvdXQgb2YgdGhlIHdheS4gSXQgaXMgTk9UIHlvdXIgam9iIHRvIHBsYXkgXCJwYXJlbnRcIiB0byB0aGUgY2xpZW50IG9yIHRvIFwicHJvdGVjdOKApiJ9 ``` }