https://github.com/berriai/litellm/issues/31595 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU5NSIsImhlYWRsaW5lIjoiIzMxNTk1IFtGZWF0dXJlXTogQURFUFQgUm91dGVyIGZvciBUZW1wbGF0ZS1CYXNlZCBSb3V0aW5nIGFuZCBTTE0gRGlzdGlsbGF0aW9uIGZyb20gUHJvZHVjdGlvbiBUcmFmZmljIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBRdWlja0hhd2siLCJMYWJlbHM6IGVuaGFuY2VtZW50LCBwcm94eSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5JbnRyb2R1Y2UgYW4gQURFUFQgcm91dGVyIHN0cmF0ZWd5IGluIExpdGVMTE0gUHJveHkgdG8gc3VwcG9ydCBhZGFwdGl2ZSBkZWxlZ2F0aW9uIG9mIGFnZW50aWMgd29ya2Zsb3dzIHRvIHNwZWNpYWxpemVkIFNMTXMgdHJhaW5lZCBmcm9tIHJlYWwgcHJvZHVjdGlvbiB0cmFmZmljXG5cblRoZSBmZWF0dXJlIGFkZHMgYSBuZXcgQURFUFQgZGVwbG95bWVudCB0eXBlIHRoYXQgcm91dGVzIHJlcXVlc3RzIGJ5IHByb21wdCBzdHJ1Y3R1cmUsIG5vdCBqdXN0IG1vZGVsIGFsaWFzLiBJdCBkZXJpdmVzIGEgc3RhYmxlIHRlbXBsYXRlIHNpZ25hdHVyZSBmcm9tIGluY29taW5nIHByb21wdHMgYnkgbWFza2luZyB2YXJpYWJsZSBzcGFucyBhbmQgY29tYmluaW5nIHRoYXQgdGVtcGxhdGUgd2l0aCB0aGUgc3lzdGVtIHByb21wdCBmb3IgcGVyLXRvb2wgaXNvbGF0aW9uLiBJZiBhIG1hdGNoaW5nIHRyYWluZWQgcm91dGUgZXhpc3RzLCBpdCBmb3J3YXJkcyB0byB0aGUgdGVtcGxhdGUgdGFyZ2V0IG1vZGVsLiBJZiBubyBtYXRjaCBleGlzdHMsIGl0IHNhZmVseSBmYWxscyBiYWNrIHRvIGEgY29uZmlndXJlZCBkZWZhdWx0IG1vZGVsXG5cbkVhY2ggc3VjY2Vzc2Z1bCBpbnRlcmFjdGlvbiBpcyBzdG9yZWQgYXMgdHJhaW5pbmcgZGF0YSBpbiBQb3N0Z3JlcywgbGlua2VkIHRvIGl0cyB0ZW1wbGF0ZS4gQXQgY29uZmlndXJhYmxlIGNvbnZlcnNhdGlvbiB0aHJlc2hvbGRzLCBMaXRlTExNIGNhbiBub3RpZnkgYW4gZXh0ZXJuYWwgdHJhaW5lciBlbmRwb2ludC4gQWZ0ZXIgdHJhaW5pbmcgZmluaXNoZXMsIHRoZSB0cmFpbmVyIHdyaXRlcyBiYWNrIGEgdGFyZ2V0IG1vZGVsIGZvciB0aGF0IHRlbXBsYXRlLCBhbmQgc3Vic2VxdWVudCBtYXRjaGluZyB0cmFmZmljIGlzIGRlbGVnYXRlZCB0byB0aGUgdHJhaW5lZCBTTE0gd2l0aCBubyBwcm94eSByZXN0YXJ0IHJlcXVpcmVkXG5cblRoZSBmZWF0dXJlIGFsc28gaW5jbHVkZXMgb3BlcmF0b3ItZmFjaW5nIHNldHVwIGFuZCBtYW5hZ2VtZW50IGluIHRoZSBkYXNoYm9hcmQuXG5cbiMjIyBNb3RpdmF0aW9uLCBwaXRjaFxuXG5BZ2VudGljIHN5c3RlbeKApiJ9
```
}