https://github.com/berriai/litellm/issues/30416 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDQxNiIsImhlYWRsaW5lIjoiIzMwNDE2IFtCdWddIFBvdGVudGlhbCBDb250ZXh0IFN0YXRlIExlYWthZ2UgaW4gTUNQIFJvdXRpbmcgKF9tY3BfYWN0aXZlX3Rvb2xzZXRfaWQpIHVuZGVyIEFzeW5jIFN0cmVhbSBJbnRlcnJ1cHRpb24iLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQFFpdVl1Y2hlbmcyMDAzIiwiTGFiZWxzOiBidWcsIHByb3h5Il0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbkEgYnVnIGhhcHBlbmVkIVRocm91Z2ggc3RhdGljIHNvdXJjZSBjb2RlIGFuYWx5c2lzIG9mIHRoZSBkeW5hbWljIE1DUCByb3V0ZSBoYW5kbGluZyBsb2dpYyBpbiBwcm94eV9zZXJ2ZXIucHksIGEgcG90ZW50aWFsIGNvbnRleHQgc3RhdGUgbGVha2FnZSB2dWxuZXJhYmlsaXR5IHdhcyBpZGVudGlmaWVkLiBXaGVuIGEgcmVxdWVzdCBtYXRjaGVzIGEgY2FjaGVkIHRvb2xzZXQsIHRoZSBzZXJ2ZXIgbXV0YXRlcyB0aGUgQVNHSSBzY29wZSBhbmQgc2V0cyBhIGNvbnRleHQgdmFyaWFibGUgdXNpbmcgdG9rZW4gPSBfbWNwX2FjdGl2ZV90b29sc2V0X2lkLnNldCh0b29sc2V0LnRvb2xzZXRfaWQpLlxuXG5XaGlsZSB0aGlzIGlzIHdyYXBwZWQgaW4gYSB0cnkuLi5maW5hbGx5IGJsb2NrIHRvIHJlc2V0IHRoZSB0b2tlbiwgYWJydXB0IGFzeW5jaHJvbm91cyBzdHJlYW0gaW50ZXJydXB0aW9ucyAoZS5nLiwgdW5oYW5kbGVkIGFzeW5jaW8uQ2FuY2VsbGVkRXJyb3IgZnJvbSByZXF1ZXN0LnJlY2VpdmUgZHVyaW5nIF9zdHJlYW1fbWNwX2FzZ2lfcmVzcG9uc2UsIG9yIGRlZXAgdW5oYW5kbGVkIHNvY2tldCBkcm9wcykgY291bGQgcG90ZW50aWFsbHkgZGlzcnVwdCB0aGUgY2xlYW51cCBsaWZlY3ljbGUuIEluIGhpZ2hseSBjb25jdXJyZW50IHNjZW5hcmlvcywgdGhpcyBtaWdodCBsZWF2ZSBwb2xsdXRlZCBzY29wZSBkaWN0aW9uYXJpZXMgb3IgZGlydHkgX21jcF9hY3RpdmVfdG9vbHNldF9pZCBjb250ZXh0IHN0YXRlcyBmb3Igc3Vic2VxdWVudCByZXF1ZXN0cyB1dGlsaXppbmcgdGhlIHNhbWUgYXN5bmMgd29ya2VyLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbk5vdGU6IFRoaXMgaXNzdWUgd2FzIGlkZW50aWZpZWQgdmlhIHN0YXRpYyBzZWN1cml0eSBhbmFseXNpcy4gVGhlIGZvbGxvd2luZyBpcyB0aGUgdGhlb3JldGljYWwgcmVwcm9kdWN0aW9uIHBhdGggdW5kZXIgaGlnaCBjb25jdXJyZW5jeS5cbjEuIFNlbmQgYSBoaWdoIHZvbHVtZSBvZiBjb25jdXJyZW50IEhUVFAgcmVxdWVzdHMgdGFyZ2V0aW5nIGEgdmFsaWQgY2FjaGVkIG1jcF9zZXJ2ZXJfbmFtZSAo4oCmIn0=
```
}