https://github.com/berriai/litellm/issues/30301 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDMwMSIsImhlYWRsaW5lIjoiIzMwMzAxIFtGZWF0dXJlXTogSGFyZGVuIHByb3ZpZGVyIHRyYW5zZm9ybXMgYWdhaW5zdCBMaXRlTExNLWludGVybmFsIG9wdGlvbmFsX3BhcmFtcyBsZWFraW5nIGludG8gcmVxdWVzdCBib2RpZXMiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGZhbmdrYW5nbWkiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiwgU0RLLCBjbGF1ZGUgY29kZSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbk5vIGV4aXN0aW5nIGlzc3VlIHByb3Bvc2VzIHRoZSBzeXN0ZW1hdGljIGZpeCwgYnV0IHNldmVyYWwgb3BlbiBpc3N1ZXMgYXJlIGluZGl2aWR1YWwgaW5zdGFuY2VzIG9mIHRoZSBzYW1lIGZhaWx1cmUgY2xhc3MsIHdoZXJlIGEgZmllbGQgTGl0ZUxMTSBmb3J3YXJkZWQgaXMgcmVqZWN0ZWQgYnkgYSBzdHJpY3QgcHJvdmlkZXIgc2NoZW1hIHdpdGggXCJFeHRyYSBpbnB1dHMgYXJlIG5vdCBwZXJtaXR0ZWRcIjogIzIzNzQxICh2ZWN0b3Jfc3RvcmVfaWRzKSwgIzI2MjQwIChDbGF1ZGUgQ29kZSksICMyNzUzMiAoY29udGV4dF9tYW5hZ2VtZW50IG9uIC92MS9tZXNzYWdlcyBwYXNzdGhyb3VnaCksICMyMzgyNSAodG9vbHNbXS5jdXN0b20uZWFnZXJfaW5wdXRfc3RyZWFtaW5nKSwgIzI4MDgxIChiZXRhcyBmaWVsZCBvbiBDb252ZXJzZSkuIEVhY2ggaXMgYmVpbmcgZml4ZWQgb25lIGF0IGEgdGltZTsgdGhpcyBpc3N1ZSBwcm9wb3NlcyBjbG9zaW5nIHRoZSBjbGFzc1xuXG4jIyMgVGhlIEZlYXR1cmVcblxuQXVkaXQgYW5kIGhhcmRlbiBwcm92aWRlciByZXF1ZXN0IHRyYW5zZm9ybXMgc28gTGl0ZUxMTS1pbnRlcm5hbCBgb3B0aW9uYWxfcGFyYW1zYCBrZXlzIGNhbiBuZXZlciBiZSBzZXJpYWxpemVkIGludG8gcHJvdmlkZXIgcmVxdWVzdCBib2RpZXMsIHdpdGggYSBzaW5nbGUgc2hhcmVkIG1lY2hhbmlzbSBpbnN0ZWFkIG9mIHBlci1oYW5kbGVyIGBwb3BgIGNhbGxzLlxuXG5DdXJyZW50IHN0YXRlIG9mIHRoZSBjb2RlYmFzZTpcblxuVGhlcmUgYXJlIDEyOSBzcGxhdC1zdHlsZSBib2R5IGNvbnN0cnVjdGlvbnMgKGAqKm9wdGlvbmFsX3BhcmFtc2AgLyBgKippbmZlcmVuY2VfcGFyYW1zYCBhbmQgc2ltaWxhcikgYWNyb3NzIGBsaXRlbGxtL2xsbXMvYCwgZm9yIGV4YW1wbGUgYHBldGFscy9jb21wbGV0aW9uL2hhbmRsZXIucHlgLCBgb3BlbmFpX2xpa2UvY2hhdC9oYW5kbGVyLnB5YCwgYHRvZ2V0aGVyX2FpL2NvbXBsZXRpb24vdHJhbnNmb3JtYXRpb24ucHlgLCBgYXp1cmUvYXp1cmUucHlgLCBgb3ZoY2xvdWQvZW1iZWRkaW5nL3RyYW5zZm9ybWF0aW9uLnB5YC4gRWFjaCBvZiB0aGVzZSBmb3J3YXJkcyDigKYifQ==
```
}