https://github.com/berriai/litellm/issues/24710 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yNDcxMCIsImhlYWRsaW5lIjoiIzI0NzEwIE1DUCBVSTogRWRpdCBTZXR0aW5ncyDihpIgVG9vbCBDb25maWd1cmF0aW9uIGZhaWxzIGZvciBPQXV0aDIgTTJNIHNlcnZlcnMgKGNyZWRlbnRpYWxzIHJlZGFjdGVkKSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbWFkaHUxOTk5MSJdLCJleGNlcnB0IjoiIyMgQnVnIFJlcG9ydFxuXG4jIyMgRGVzY3JpcHRpb25cblxuV2hlbiBlZGl0aW5nIGFuIGV4aXN0aW5nIE1DUCBzZXJ2ZXIgd2l0aCBPQXV0aDIgTTJNIChgY2xpZW50X2NyZWRlbnRpYWxzYCkgYXV0aCwgdGhlICoqRWRpdCBTZXR0aW5ncyDihpIgVG9vbCBDb25maWd1cmF0aW9uKiogcGFuZWwgc2hvd3M6XG5cbj4gKipVbmFibGUgdG8gbG9hZCB0b29scyoqXG4+IEZhaWxlZCB0byBjb25uZWN0IHRvIE1DUCBzZXJ2ZXIuIENoZWNrIHByb3h5IGxvZ3MgZm9yIGRldGFpbHMuXG5cbiMjIyBSb290IENhdXNlXG5cblRoZSBlZGl0IGZvcm0gcG9wdWxhdGVzIGBmb3JtVmFsdWVzYCBmcm9tIHRoZSBzZXJ2ZXIgcmVjb3JkIHJldHVybmVkIGJ5IGBHRVQgL3YxL21jcC9zZXJ2ZXIvPGlkPmAuIEZvciBPQXV0aDIgc2VydmVycywgYGNyZWRlbnRpYWxzYCBpcyBhbHdheXMgYG51bGxgIGluIEFQSSByZXNwb25zZXMgKGVuY3J5cHRlZCBhdCByZXN0LCByZWRhY3RlZCBmb3Igc2VjdXJpdHkpLiBUaGUgVUkgdGhlbiBjYWxscyBgUE9TVCAvbWNwLXJlc3QvdGVzdC90b29scy9saXN0YCB3aXRoIHRoZSBmb3JtIHZhbHVlcyDigJQgYnV0IHNpbmNlIGBjbGllbnRfaWRgIGFuZCBgY2xpZW50X3NlY3JldGAgYXJlIG1pc3NpbmcsIHRoZSB0ZXN0IGVuZHBvaW50IGNhbm5vdCBmZXRjaCBhbiBPQXV0aDIgdG9rZW4gYW5kIHRoZSBjb25uZWN0aW9uIGZhaWxzLlxuXG4qKkNvZGUgcGF0aDoqKlxuMS4gYG1jcF90b29sX2NvbmZpZ3VyYXRpb24udHN4YCDihpIgYHVzZVRlc3RNQ1BDb25uZWN0aW9uYCBob29rIOKGkiBgdGVzdE1DUFRvb2xzTGlzdFJlcXVlc3RgXG4yLiBCYWNrZW5kOiBgcmVzdF9lbmRwb2ludHMucHlgIGBfZXhlY3V0ZV93aXRoX21jcF9jbGllbnQoKWAg4oCUIGBfZXh0cmFjdF9jcmVkZW50aWFscygpYCByZXR1cm5zIGAoTm9uZSwgTm9uZSwgTm9uZSlgXG4zLiBgaGFzX2NsaWVudF9jcmVkZW50aWFsc2AgaXMgYEZhbHNlYCDihpIgbm8gTTJNIHRva2VuIGZldGNoIOKGkiBjb25uZWN0aW9uIGZhaWxzIHdpdGggZ2VuZXJpYyBlcnJvclxuXG4jIyMgRXhwZWN0ZWQgQmVoYXZpb3JcblxuRm9yIGV4aXN0aW5nIE0yTSBzZXJ2ZXJzLCB0aGUgVG9vbCBDb25maWd1cmF0aW9uIHBhbmVsIHNob3VsZCBiZSBhYmxlIHRvIGxvYWQgdG9vbHMgd2l0aG91dCByZXF1aXJpbmcgY3JlZGVudGlhbHMgdG8gYmUgcmUtZW50ZXJlZC4gT3B0aW9uczpcbjEuIFVzZSB0aGUgc3RvcmVkIChlbmPigKYifQ== ``` }