https://github.com/berriai/litellm/issues/30721 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyMSIsImhlYWRsaW5lIjoiIzMwNzIxIFtGZWF0dXJlXTogQWxsb3cgdXNpbmcgYW4gZXhpc3Rpbmcgc2VjcmV0IGZvciBkYXRhYmFzZSBjcmVkZW50aWFscyBvbiB0aGUgc3RhbmRhbG9uZSBQb3N0Z3JlcyBwYXRoIChoZWxtIGNoYXJ0KSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAd2l6Y2hlIiwiTGFiZWxzOiBlbmhhbmNlbWVudCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5XaGVuIGBkYi5kZXBsb3lTdGFuZGFsb25lOiB0cnVlYCwgdGhlIGNoYXJ0IGFsd2F5cyBjcmVhdGVzIGl0cyBvd24gKi1kYmNyZWRlbnRpYWxzIFNlY3JldCBmcm9tIHBsYWludGV4dCBwb3N0Z3Jlc3FsLmF1dGguKiB2YWx1ZXMgYW5kIGhhcmRjb2RlcyB0aGUgZGVwbG95bWVudCBhbmQgbWlncmF0aW9uIGpvYiB0byByZWFkIGl0LiBcblxuVGhlcmUncyBubyB3YXkgdG8gc291cmNlIGNyZWRlbnRpYWxzIGZyb20gYW4gZXhpc3Rpbmcgc2VjcmV0IChlLmcuIEV4dGVybmFsU2VjcmV0L3ZhdWx0KSwgc28gdGhlIHByb3h5IGFuZCBQb3N0Z3JlcyBjYW4gZW5kIHVwIHdpdGggbWlzbWF0Y2hlZCBjcmVkZW50aWFscy5cblxuIyMjIE1vdGl2YXRpb24sIHBpdGNoXG5cbkRlcGxveWluZyBMaXRlTExNIHdpdGggdGhlIGNoYXJ0LW1hbmFnZWQgc3RhbmRhbG9uZSBQb3N0Z3JlcyBhbmQgd2FudCB0byBrZWVwIGRhdGFiYXNlIGNyZWRlbnRpYWxzIGluIGEgdmF1bHQgKHN5bmNlZCB2aWEgRXh0ZXJuYWxTZWNyZXQpIHJhdGhlciB0aGFuIGluIHBsYWludGV4dCB2YWx1ZXMuXG5cbiMjIyBXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0P1xuXG5IZWxtIENoYXJ0XG5cbiMjIyBMaXRlTExNIGlzIGhpcmluZyBhIGZvdW5kaW5nIGJhY2tlbmQgZW5naW5lZXIsIGFyZSB5b3UgaW50ZXJlc3RlZCBpbiBqb2luaW5nIHVzIGFuZCBzaGlwcGluZyB0byBhbGwgb3VyIHVzZXJzP1xuXG5Ob1xuXG4jIyMgVHdpdHRlciAvIExpbmtlZEluIGRldGFpbHNcblxuX05vIHJlc3BvbnNlXyJ9
```
}