https://github.com/berriai/litellm/issues/30816 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDgxNiIsImhlYWRsaW5lIjoiIzMwODE2IFtGZWF0dXJlXTogUmVwb3J0IGFjdHVhbCB1c2FnZSBjb3N0IHRvIFNTRSBjbGllbnRzIGluIHN0cmVhbWluZyBtb2RlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBhd3NjaG1lZGVyIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIFN1bW1hcnlcblxuV2hlbiByZXNwb25zZXMgYXJlIHN0cmVhbWVkIChgc3RyZWFtOiB0cnVlYCksIHRoZXJlIGlzIGN1cnJlbnRseSBubyBzdGFuZGFyZCB3YXkgZm9yIGEgY2xpZW50IHRvIGxlYXJuIHRoZSBwcm94eSdzIGF1dGhvcml0YXRpdmUgY29zdCBmb3IgdGhlIGNvbXBsZXRlZCByZXF1ZXN0LiBUaGUgcHJveHkgYWxyZWFkeSBjb21wdXRlcyB0aGlzIGNvc3Qgc2VydmVyLXNpZGU7IGl0IGlzIGp1c3Qgbm90IGRlbGl2ZXJlZCBiYWNrIHRvIHRoZSBjbGllbnQuIEFzIGEgcmVzdWx0LCBjbGllbnRzIHRlbmQgdG8gcmUtaW1wbGVtZW50IHRoZWlyIG93biBjb3N0IGVzdGltYXRpb24gZnJvbSByYXcgdG9rZW4gY291bnRzLCB3aGljaCBjYW5ub3QgYWNjb3VudCBmb3IgcHJveHktc2lkZSBtb2RpZmllcnMgKGRpc2NvdW50cywgbWFyZ2lucywgTUNQIHRvb2wgdXNhZ2UsIHByb21wdCBjYWNoaW5nKSB0aGF0IG9ubHkgdGhlIHByb3h5IGtub3dzIGFib3V0LlxuXG5UaGlzIGlzc3VlIHByb3Bvc2VzIHN1cmZhY2luZyB0aGUgcHJveHkncyBhbHJlYWR5LWNvbXB1dGVkIGNvc3QgdG8gdGhlIGNsaWVudCBhdCBzdHJlYW0gZW5kLiBCZWNhdXNlIHRoZSB2YWx1ZSBpcyBjYWxjdWxhdGVkIHN5bmNocm9ub3VzbHkgYmVmb3JlIGxvZ2dpbmcgaGFwcGVucywgdGhpcyBzaG91bGQgYmUgYSByZWxhdGl2ZWx5IGxvdy1yaXNrIGFkZGl0aW9uLlxuXG4tLS1cblxuIyMgQmFja2dyb3VuZFxuXG5BIHN0cmVhbWluZyByZXF1ZXN0IGlzIGRlbGl2ZXJlZCBhcyBhIHNlcXVlbmNlIG9mIFNTRSBldmVudHMgZW5kaW5nIHdpdGggYGRhdGE6IFtET05FXWAuIFNlcnZlci1zaWRlLCB0aGUgcHJveHkgY2FsY3VsYXRlcyB0aGUgdHJ1ZSBjb3N0IGFjY291bnRpbmcgZm9yOlxuXG4tIE1vZGVsLXNwZWNpZmljIHRva2VuIHByaWNpbmcgKGlucHV0LCBvdXRwdXQsIGNhY2hlZCwgcmVhc29uaW5nKVxuLSBQcm9tcHQgY2FjaGluZyBkaXNjb3VudHMgKEFudGhyb3BpYywgT3BlbkFJLCBCZWRyb2NrKVxuLSBNQ1AgdG9vbCB1c2FnZSBjb3N0c1xuLSBPcGVyYXRvci1jb25maWd1cmVkIGRpc2NvdW50cyAoYGNvc3RfZGlzY291bnRfY29uZmlnYCkgYW5kIG1hcmdpbnMgKGBjb3N0X21hcmdpbl9jb25maWdgKVxuLSBQcm92aWRlci1zcGVjaWZpYyB1cGxpZnRzIChnZW8gcm91dGluZywgc3BlZWQgdGllcnMpXG4tIEJ1aWx0LWluIHRvb2wgY29zdHMgKHdlYiBzZWFy4oCmIn0=
```
}