https://github.com/berriai/litellm/issues/30448 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDQ0OCIsImhlYWRsaW5lIjoiIzMwNDQ4IFtGZWF0dXJlXTogQmF5ZXNpYW4gb3B0aW1pemF0aW9uIGZlYXR1cmUiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQFRpYm8yNDAzIiwiTGFiZWxzOiBlbmhhbmNlbWVudCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5CYXllc2lhbiBvcHRpbWl6YXRpb24gdXNlcyBhIHByb2JhYmlsaXN0aWMgbW9kZWwgdG8gZmluZCB0aGUgYmVzdCBzZXR0aW5ncyBmb3IgY29tcGxleCBzeXN0ZW1zIHdpdGggbWluaW1hbCB0ZXN0aW5nLlxuSXQgYmFsYW5jZXMgZXhwbG9yaW5nIG5ldyBjb25maWd1cmF0aW9ucyBhbmQgZXhwbG9pdGluZyBrbm93biBnb29kIHNldHRpbmdzIHRvIHN5c3RlbWF0aWNhbGx5IG1heGltaXplIHlvdXIgdGFyZ2V0IG1ldHJpY3MuXG5Gb3IgTGl0ZUxMTSwgaXQgYXZvaWRzIHdhc3RpbmcgbW9uZXkgYnkgc21hcnRseSBhZGp1c3RpbmcgcGFyYW1ldGVycyBsaWtlIHRlbXBlcmF0dXJlIG9yIG1vZGVsIHNlbGVjdGlvbiB0byBsb3dlciBsYXRlbmN5IGFuZCBBUEkgY29zdHMuXG5UaGlzIGFwcHJvYWNoIGlzIG11Y2ggZmFzdGVyIGFuZCBjaGVhcGVyIHRoYW4gdGVzdGluZyBldmVyeSBzaW5nbGUgb3B0aW9uIG9yIGd1ZXNzaW5nIHNldHRpbmdzIGF0IHJhbmRvbS5cbkl0IGlzIHRoZSBwZXJmZWN0IGNob2ljZSBmb3IgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzIGJlY2F1c2UgZWFjaCB0ZXN0IHJlcXVpcmVzIHNsb3cgYW5kIGV4cGVuc2l2ZSBBUEkgY2FsbHMuXG5JdCBjb3VsZCBiZSBhIG5pY2UtdG8taGF2ZS5cblxuIyMjIE1vdGl2YXRpb24sIHBpdGNoXG5cblAoQyh4KSDiiaQgTGltaXRlKSA9IM6mKCAoTGltaXRlIC0gzrxjKHgpKSAvIM+DYyh4KSApXG5UaGlzIGZvcm11bGEgY2FsY3VsYXRlcyB0aGUgcHJvYmFiaWxpdHkgdGhhdCB5b3VyIGh5cGVycGFyYW1ldGVyIGNob2ljZSBzdGF5cyB1bmRlciB0aGUgdG9rZW4gbGltaXQuXG5JdCBub3JtYWxpemVzIHRoZSBzYWZldHkgbWFyZ2luIHVzaW5nIHRoZSBtb2RlbCdzIHByZWRpY3RlZCB0b2tlbiBtZWFuIGFuZCB1bmNlcnRhaW50eS5cbi0gUChDKHgpIDw9IExpbWl0KSA6IFByb2JhYmlsaXR5IHRoYXQgdGhlIHRva2VuIGNvbnN1bXB0aW9uIHN0YXlzIHdpdGhpbiB0aGUgZml4ZWQgYnVkZ2V0LlxuLSB4ICAgICAgICAgICAgICAgIDogVGVzdGVkIGh5cGVycGFyYW1ldGVyIGNvbmZpZ3VyYXRpb24gKGUuZy4sIHRlbXBlcmF0dXJlLCBwZW5hbHRpZXMpLlxuLeKApiJ9
```
}