https://github.com/berriai/litellm/issues/30976 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDk3NiIsImhlYWRsaW5lIjoiIzMwOTc2IFtCdWddOiBNQ1AgZ2F0ZXdheSB3YXJucyBcIidpbnQnIG9iamVjdCBpcyBub3Qgc3Vic2NyaXB0YWJsZVwiIGZvciBpbnRlZ2VyIHByb2dyZXNzVG9rZW4iLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHBkZWNhdCJdLCJleGNlcnB0IjoiIyMjIFdoYXQgaGFwcGVuZWQ/XG5cblRoZSBNQ1AgZ2F0ZXdheSBsb2dzIHRoaXMgd2FybmluZyBvbiAqKmV2ZXJ5KiogdG9vbCBjYWxsIHdoZW4gdGhlIGNhbGxpbmcgaG9zdCBzZW5kcyBhbiBpbnRlZ2VyIGBwcm9ncmVzc1Rva2VuYDpcblxuYGBgXG5XQVJOSU5HOkxpdGVMTE06Q291bGQgbm90IGNhcHR1cmUgaG9zdCBwcm9ncmVzcyBjb250ZXh0OiAnaW50JyBvYmplY3QgaXMgbm90IHN1YnNjcmlwdGFibGVcbmBgYFxuXG5QZXIgdGhlIE1DUCBzcGVjLCBgcHJvZ3Jlc3NUb2tlbmAgaXMgYHN0cmluZyB8IGludGVnZXJgIChbc2NoZW1hLmpzb24jTDIzMDItTDIzMDhdKGh0dHBzOi8vZ2l0aHViLmNvbS9tb2RlbGNvbnRleHRwcm90b2NvbC9tb2RlbGNvbnRleHRwcm90b2NvbC9ibG9iL21haW4vc2NoZW1hLzIwMjUtMTEtMjUvc2NoZW1hLmpzb24jTDIzMDItTDIzMDgpLCByZXByZXNlbnRlZCBhcyBgc3RyIHwgaW50YCBpbiB0aGUgUHl0aG9uIFNESydzIGBtY3AvdHlwZXMucHlgKSwgc28gdGhlIGludGVnZXIgYnJhbmNoIGlzIHZhbGlkIGFuZCBzcGVjLWNvbXBsaWFudC5cblxuSW4gYGxpdGVsbG0vcHJveHkvX2V4cGVyaW1lbnRhbC9tY3Bfc2VydmVyL3NlcnZlci5weWAsIHRoZSBob3N0LXByb2dyZXNzLWNhcHR1cmUgYmxvY2sgZm9ybWF0cyB0aGUgdG9rZW4gd2l0aDpcblxuYGBgcHl0aG9uXG52ZXJib3NlX2xvZ2dlci5kZWJ1ZyhmXCJIb3N0IHByb2dyZXNzVG9rZW4gY2FwdHVyZWQ6IHtob3N0X3Rva2VuWzo4XX0uLi5cIilcbmBgYFxuXG5UaGUgYFs6OF1gIHNsaWNlIGFzc3VtZXMgYSBzdHJpbmcsIHNvIGFuIGludGVnZXIgdG9rZW4gcmFpc2VzIGBUeXBlRXJyb3I6ICdpbnQnIG9iamVjdCBpcyBub3Qgc3Vic2NyaXB0YWJsZWAuIFRoZSBzdXJyb3VuZGluZyBgdHJ5L2V4Y2VwdGAgc3dhbGxvd3MgaXQgYW5kIHJlLXN1cmZhY2VzIGl0IGFzIHRoZSBtaXNsZWFkaW5nIFwiQ291bGQgbm90IGNhcHR1cmUgaG9zdCBwcm9ncmVzcyBjb250ZXh0XCIgd2FybmluZyBhYm92ZS5cblxuVHdvIG5vdGVzIG9uIGltcGFjdDpcblxuLSBUaGUgZi1zdHJpbmcgaXMgZXZhbHVhdGVkIGVhZ2VybHkgcmVnYXJkbGVzcyBvZiBsb2cgbGV2ZWwsIHNvIHRoaXMgZmlyZXMgZXZlbiB3aXRoIGRlYnVnIGxvZ2dpbmcgZGlzYWJsZWQuXG4tIGBob3N0X3Byb2dyZXNzX2NhbGxiYWNrYCBpcyBhc3NpZ25lZCAqYmVmb3JlKiB0aGUgZmFpbGluZyBsb2cgbGluZSwgc28gcOKApiJ9
```
}