https://github.com/berriai/litellm/issues/30560 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDU2MCIsImhlYWRsaW5lIjoiIzMwNTYwIE9wZW5BUEktYmFja2VkIE1DUCBzZXJ2ZXIgcmV0dXJucyA0MDEgd2hlbiB0aGUgc3BlYyBVUkwgaXMgcHJvdGVjdGVkIGJ5IHRoZSBjb25maWd1cmVkIGF1dGgiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQE5hcm9oMDkxIl0sImV4Y2VycHQiOiJXaGVuIGFkZGluZyBhbiBNQ1Agc2VydmVyIGZyb20gYW4gT3BlbkFQSSBzcGVjaWZpY2F0aW9uIGFuZCBzZWxlY3RpbmcgQmVhcmVyIFRva2VuIGF1dGhlbnRpY2F0aW9uLCB0aGUgZGFzaGJvYXJkIHJldHVybnMgYSA0MDEgZXZlbiB3aXRoIGEgdmFsaWQgdG9rZW4uIFRoZSBzYW1lIHNwZWMgVVJMIGxvYWRzIGNvcnJlY3RseSBpbiBQb3N0bWFuIHdoZW4gdGhlIEF1dGhvcml6YXRpb24gaGVhZGVyIGlzIHNlbnQsIHdoaWNoIHBvaW50cyBhdCBMaXRlTExNIHJhdGhlciB0aGFuIHRoZSB1cHN0cmVhbSBBUEkuXG5cblRoZSByb290IGNhdXNlIGlzIHRoYXQgTGl0ZUxMTSBkb3dubG9hZHMgdGhlIE9wZW5BUEkgZG9jdW1lbnQgKGBzcGVjX3BhdGhgKSB3aXRob3V0IGZvcndhcmRpbmcgdGhlIGNvbmZpZ3VyZWQgY3JlZGVudGlhbC4gYGxvYWRfb3BlbmFwaV9zcGVjX2FzeW5jYCBpc3N1ZXMgYSBwbGFpbiBHRVQgd2l0aCBubyBBdXRob3JpemF0aW9uIGhlYWRlciwgYm90aCBpbiB0aGUgZGFzaGJvYXJkIHRvb2xzIHByZXZpZXcgKGAvdjEvbWNwL3NlcnZlci90ZXN0L3Rvb2xzL2xpc3RgKSBhbmQgaW4gdGhlIHNlcnZlciByZWdpc3RyYXRpb24gcGF0aCBpbiBgbWNwX3NlcnZlcl9tYW5hZ2VyLl9yZWdpc3Rlcl9vcGVuYXBpX3Rvb2xzYC4gV2hlbiB0aGUgc3BlYyBVUkwgaXMgaG9zdGVkIGJlaGluZCB0aGUgc2FtZSBjcmVkZW50aWFsIGFzIGl0cyBlbmRwb2ludHMsIHdoaWNoIGlzIHRoZSBjb21tb24gY2FzZSwgdGhlIHVwc3RyZWFtIHJlcGxpZXMgNDAxIGFuZCB0aGUgc2VydmVyIGNhbiBuZXZlciBiZSBhZGRlZC5cblxuVGhpcyBpcyBzZXBhcmF0ZSBmcm9tIHRoZSByZXF1ZXN0LXRpbWUgYGV4dHJhX2hlYWRlcnNgIGZvcndhcmRpbmcgYWRkcmVzc2VkIGluICMyNzM4MyBhbmQgIzI2ODY0OyB0aGF0IHdvcmsgb25seSBjb3ZlcnMgaGVhZGVycyBzZW50IHdoaWxlIGV4ZWN1dGluZyBhIHRvb2wsIG5vdCB0aGUgc3BlYyBmZXRjaCBpdHNlbGYsIHNvIHRoZSBzcGVjIGRvd25sb2FkIHdhcyBzdGlsbCBnb2luZyBvdXQgdW5hdXRoZW50aWNhdGVkLlxuXG5UbyByZXByb2R1Y2UsIHNlcnZlIGFuIE9wZW5BUEkgc3BlYyBiZWhpbmQgYSBCZWFyZXIgdG9rZW4sIHRoZW4gaW4gdGhlIGRhc2hib2FyZCBhZGQgYSBuZXcgTUNQIHNlcnZlciBmcm9tIHRoYXQgc3BlYyBVUkwsIGNob29zZSBCZWFyZXIgVG9rZW4sIGFuZCBwYXN0ZSDigKYifQ==
```
}