https://github.com/berriai/litellm/issues/31030 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTAzMCIsImhlYWRsaW5lIjoiIzMxMDMwIFtCdWddOiBWZXJ0ZXggQUkgSGFpa3UgZmFpbHMgd2l0aCB0aGlua2luZzp7XCJ0eXBlXCI6XCJhZGFwdGl2ZVwifSBvbiAvdjEvbWVzc2FnZXMg4oCUIGRyb3BfcGFyYW1zIG5vdCBhcHBsaWVkIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEB3b29qdW5nMyIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uLCBjbGF1ZGUgY29kZSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIGEgcmVxdWVzdCBpcyBzZW50IHRvIHRoZSBBbnRocm9waWMtbmF0aXZlIHBhc3MtdGhyb3VnaCBlbmRwb2ludCBgUE9TVCAvdjEvbWVzc2FnZXNgLCBMaXRlTExNIGZvcndhcmRzIHRoZSByZXF1ZXN0IGJvZHkgdG8gVmVydGV4IEFJIGVzc2VudGlhbGx5IHZlcmJhdGltLiBQcm92aWRlci9tb2RlbC1zcGVjaWZpYyBwYXJhbWV0ZXJzIHRoYXQgdGhlIHRhcmdldCBtb2RlbCBkb2VzIG5vdCBzdXBwb3J0IGFyZSBub3Qgc2FuaXRpemVkIOKAlCBldmVuIHdpdGggYGRyb3BfcGFyYW1zOiB0cnVlYCBzZXQgZ2xvYmFsbHkgaW4gYGxpdGVsbG1fc2V0dGluZ3NgLCBhbmQgZXZlbiB3aXRoIG5vIGBhZGRpdGlvbmFsX2Ryb3BfcGFyYW1zYCBvdmVycmlkZSBhbnl3aGVyZSBpbiB0aGUgY29uZmlnLlxuXG5UaGUgcHJvb2YgaXMgdGhhdCB0aGUgc2FtZSBtb2RlbCBhbmQgdGhlIHNhbWUgcGFyYW1ldGVyIGJlaGF2ZSBkaWZmZXJlbnRseSBkZXBlbmRpbmcgb24gdGhlIHJvdXRlOlxuLSBgUE9TVCAvdjEvbWVzc2FnZXNgIHdpdGggYG1vZGVsPWhhaWt1YCAoZm9yd2FyZGVkIHRvIGB2ZXJ0ZXhfYWkvY2xhdWRlLWhhaWt1LTQtNWApLCBgdGhpbmtpbmc6e1widHlwZVwiOlwiYWRhcHRpdmVcIn1gIOKGkiAqKkhUVFAgNDAwKiogKFZlcnRleCByZWplY3RzIGl0KS5cbi0gYFBPU1QgL3YxL2NoYXQvY29tcGxldGlvbnNgIHdpdGggdGhlIHNhbWUgbW9kZWwgYW5kIHNhbWUgYHRoaW5raW5nYCBwYXlsb2FkIOKGkiAqKkhUVFAgMjAwKiogKExpdGVMTE0gc2VlbXMgdG8gZHJvcCBgdGhpbmtpbmdgIGJlZm9yZSBmb3J3YXJkaW5nOyByZXNwb25zZSBzaG93cyBgcmVhc29uaW5nX3Rva2VuczowYCwgYHRoaW5raW5nX2Jsb2NrczpudWxsYCkuXG5cblRoaXMgaXMgbm90IGJlY2F1c2UgYGFkYXB0aXZlYCBpcyBhbiBpbnZhbGlkIHZhbHVlIGluIGdlbmVyYWwg4oCUIGBjbGF1ZGUtb3B1cy00LThgIGFjY2VwdHMgYHRoaW5raW5nOntcInR5cGVcIjpcImFkYXB0aXZlXCJ9YCB2aWEgdGhlIHNhbWUgYC92MS9tZXNzYWdlc2Agcm91dGUgd2l0aCBIVFRQIDIwMC4gSXQncyBhIG1vZGVsLWNhcGFiaWxpdHkgbWlzbWF0Y2ggKOKApiJ9
```
}