https://github.com/berriai/litellm/issues/24089 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yNDA4OSIsImhlYWRsaW5lIjoiIzI0MDg5IE1DUDogdG9vbF9uYW1lX3RvX21jcF9zZXJ2ZXJfbmFtZV9tYXBwaW5nIGVtcHRpZWQgYnkgY2FuY2VsbGVkIGxpc3RfdG9vbHMg4oaSIDQwNCBvbiB0b29sIGNhbGxzIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBtYWRodTE5OTkxIl0sImV4Y2VycHQiOiIjIyBEZXNjcmlwdGlvblxuXG5XaGVuIExpdGVMTE0gY2FsbHMgYGxpc3RfdG9vbHNgIG9uIGFuIGFzeW5jL1NTRS1iYXNlZCBNQ1Agc2VydmVyIChlLmcuIERhdGFicmlja3MpIHZpYSB0aGUgTUNQIHByb3RvY29sIGVuZHBvaW50LCBhbiBhbnlpbyBjYW5jZWwgc2NvcGUgZmlyZXMgYmVmb3JlIHRoZSBTU0Ugc3RyZWFtIGlzIGZ1bGx5IHByb2Nlc3NlZC4gVGhlIGNhbGwgaXMgYWJvcnRlZCBtaWQtZXhlY3V0aW9uIOKAlCBgX2xpc3RfdG9vbHNfYW5kX2FkZF9wcmVmaXhgIG5ldmVyIGNvbXBsZXRlcywgc28gYHRvb2xfbmFtZV90b19tY3Bfc2VydmVyX25hbWVfbWFwcGluZ2AgaXMgKipuZXZlciBwb3B1bGF0ZWQqKiBmb3IgdGhhdCBzZXJ2ZXIuIEFsbCBzdWJzZXF1ZW50IGBtY3AtcmVzdC90b29scy9jYWxsYCByZXF1ZXN0cyBmb3IgdGhhdCBzZXJ2ZXIncyB0b29scyB0aGVuIHJldHVybiA0MDQuXG5cbiMjIFJvb3QgQ2F1c2VcblxuIyMjIFN0ZXAgMTogUHJvdG9jb2wgYGxpc3RfdG9vbHNgIGlzIGNhbmNlbGxlZCDigJQgbWFwcGluZyBuZXZlciB3cml0dGVuXG5cbkZvciBhc3luYy9TU0UgTUNQIHNlcnZlcnMgKGUuZy4gRGF0YWJyaWNrcyByZXNwb25kaW5nIDIwMiArIFNTRSBzdHJlYW0pLCB0aGUgYW55aW8gY2FuY2VsIHNjb3BlIGluIGBjbGllbnQucHlgIGZpcmVzIGJlZm9yZSB0aGUgdXBzdHJlYW0gcmVzcG9uc2UgaXMgcHJvY2Vzc2VkLiBUaGUgZW50aXJlIGBfbGlzdF90b29sc19hbmRfYWRkX3ByZWZpeGAgY2FsbCBpcyBhYm9ydGVkIOKAlCBpdCBkb2Vzbid0IHdyaXRlIDAgdG9vbHMsIGl0IHdyaXRlcyAqKm5vdGhpbmcqKi4gVGhlIG1hcHBpbmcgZm9yIHRoYXQgc2VydmVyIHN0YXlzIGVtcHR5LlxuXG5TeW5jaHJvbm91cyBzZXJ2ZXJzIChlLmcuIHJldHVybmluZyAyMDAgZGlyZWN0bHkpIGFyZSB1bmFmZmVjdGVkIGJlY2F1c2UgdGhlIHJlc3BvbnNlIGFycml2ZXMgYmVmb3JlIHRoZSBjYW5jZWwgc2NvcGUgZmlyZXMuXG5cbiMjIyBTdGVwIDI6IFRoZSAzMHMgcmVsb2FkIGN5Y2xlIGRvZXNuJ3QgZml4IGl0XG5cbmBpbml0aWFsaXplX3Rvb2xfbmFtZV90b19tY3Bfc2VydmVyX25hbWVfbWFwcGluZ2AgaXMgY2FsbGVkIG9uIHN0YXJ0dXAgKGFmdGVyIGxvYWRpbmcgY29uZmlnKSBhbmQgd2hlbiBPcGVuQVBJIHNlcnZlcnMgYXJlIHJlZ2lzdGVyZWQuIEl0IGNhbGxzIGBfZ2V0X3Rvb2xzX2Zyb21fc2VydmVyYCBmb3IgZWFjaOKApiJ9
```
}