https://github.com/berriai/litellm/issues/21347 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTM0NyIsImhlYWRsaW5lIjoiIzIxMzQ3IFZhbGlkYXRlIExpdGVMTE0gb3V0cHV0IGFuZCBwcm92aWRlciBtYXBwaW5ncyB1c2luZyBBUEkgc3BlY3MiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQENoZXNhcnMiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgU3VtbWFyeVxuXG5MaXRlTExNJ3MgY29yZSB2YWx1ZSBwcm9wb3NpdGlvbiBpczogY2FsbCBhbnkgTExNIHByb3ZpZGVyLCBnZXQgT3BlbkFJLWNvbXBhdGlibGUgb3V0cHV0LiBUb2RheSwgdGhpcyBjb21wYXRpYmlsaXR5IGlzIHZlcmlmaWVkIGluZGlyZWN0bHkg4oCUIHRocm91Z2ggaW50ZWdyYXRpb24gdGVzdHMgdGhhdCBtYWtlIHJlYWwgQVBJIGNhbGxzIGFuZCBjaGVjayBzcGVjaWZpYyBmaWVsZHMgbWFudWFsbHkuIFRoZXJlIGlzIG5vIHN5c3RlbWF0aWMgdmFsaWRhdGlvbiB0aGF0IHRoZSBvdXRwdXQgZm9ybWF0IG1hdGNoZXMgdGhlIE9wZW5BSSBzcGVjaWZpY2F0aW9uLlxuXG4jIyBPcGVuQUkgcHVibGlzaGVzIHRoZWlyIGZ1bGwgQVBJIHNwZWNcblxuT3BlbkFJIG1haW50YWlucyBhbiBPcGVuQVBJIDMuMS4wIHNwZWNpZmljYXRpb24gKH43NSwwMDAgbGluZXMgWUFNTCkgYXQgW29wZW5haS9vcGVuYWktb3BlbmFwaV0oaHR0cHM6Ly9naXRodWIuY29tL29wZW5haS9vcGVuYWktb3BlbmFwaSkgd2l0aCBldmVyeSBlbmRwb2ludCdzIHJlcXVlc3QgYW5kIHJlc3BvbnNlIHNjaGVtYXMsIGluY2x1ZGluZzpcbi0gQWxsIGZpZWxkIG5hbWVzLCB0eXBlcywgcmVxdWlyZWQvb3B0aW9uYWwgbWFya2Vyc1xuLSBFbnVtIHZhbHVlcyAoZS5nLiwgYGZpbmlzaF9yZWFzb25gOiBgc3RvcGAsIGBsZW5ndGhgLCBgdG9vbF9jYWxsc2AsIGBjb250ZW50X2ZpbHRlcmAsIGBmdW5jdGlvbl9jYWxsYClcbi0gTmVzdGVkIG9iamVjdCBzdHJ1Y3R1cmVzIChzdHJlYW1pbmcgY2h1bmtzLCB0b29sIGNhbGxzLCB1c2FnZSwgZXRjLilcblxuTGl0ZUxMTSBkb2VzIG5vdCB1c2UgdGhpcyBzcGVjIGFueXdoZXJlLlxuXG4jIyBXaHkgdGhpcyBtYXR0ZXJzIOKAlCByZWFsIGV4YW1wbGVcblxuUFIgIzE5NTU4IG1lcmdlZCBjb2RlIHRoYXQgcGFzc2VzIFZlcnRleCBBSS9HZW1pbmkgZmluaXNoIHJlYXNvbnMgKGBtYWxmb3JtZWRfZnVuY3Rpb25fY2FsbGAsIGBmaW5pc2hfcmVhc29uX3Vuc3BlY2lmaWVkYCkgZGlyZWN0bHkgdG8gdXNlcnMuIFRoaXMgd2FzIGZsYWdnZWQgZHVyaW5nIHJldmlldzpcblxuPiBAa3JyaXNoZGhvbGFraWE6IFwiaXNuJ3QgdGhpcyBiYWQsIHNpbmNlIGl0IGJyZWFrcyBvcGVuYWkgY29uc2lzdGVuY3k/XCJcblxuVGhlIE9wZW5BSSBTREsgdGhyb3dzIGBsaXRlcmFsX2Vycm9yYCDigJQgdGhlIGVudGlyZSByZXNwb25zZSBpcyBsb3N0LCBp4oCmIn0=
```
}