https://github.com/berriai/litellm/issues/31187 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTE4NyIsImhlYWRsaW5lIjoiIzMxMTg3IGZpeChhenVyZV9haSk6IHN0cmlwIG91dHB1dF9jb25maWcuZWZmb3J0IGZvciBBenVyZSBBSSBGb3VuZHJ5IENsYXVkZSBtb2RlbHMgdGhhdCByZWplY3QgaXQgKEhhaWt1IDQuNSkiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGRzdGVlbGV5IiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24sIGNsYXVkZSBjb2RlIl0sImV4Y2VycHQiOiIjIyBCdWcgRGVzY3JpcHRpb25cblxuV2hlbiBhIHJlcXVlc3QgYXJyaXZlcyBhdCBMaXRlTExNJ3MgQW50aHJvcGljIHBhc3MtdGhyb3VnaCBlbmRwb2ludCAoYC9hbnRocm9waWMvdjEvbWVzc2FnZXNgKSBhbmQgaXMgcm91dGVkIHRvIGEgQ2xhdWRlIEhhaWt1IDQuNSBtb2RlbCBiYWNrZWQgYnkgdGhlIGBhenVyZV9haS9gIHByb3ZpZGVyLCBgb3V0cHV0X2NvbmZpZy5lZmZvcnRgIGlzIGZvcndhcmRlZCB0byBBenVyZSBBSSBGb3VuZHJ5IHVuY2hhbmdlZC4gQXp1cmUgcmVqZWN0cyBpdCB3aXRoOlxuXG5gYGBcbjQwMCB7XCJ0eXBlXCI6XCJpbnZhbGlkX3JlcXVlc3RfZXJyb3JcIixcIm1lc3NhZ2VcIjpcIlRoaXMgbW9kZWwgZG9lcyBub3Qgc3VwcG9ydCB0aGUgZWZmb3J0IHBhcmFtZXRlci5cIn1cbmBgYFxuXG5UaGlzIGFmZmVjdHMgYWxsIGNhbGxlcnMgdXNpbmcgdGhlIEFudGhyb3BpYyBTREsgcG9pbnRlZCBhdCBhIExpdGVMTE0gcHJveHkg4oCUIGZvciBleGFtcGxlLCAqKkNsYXVkZSBDb2RlKiogd2l0aCBgQU5USFJPUElDX0JBU0VfVVJMYCBzZXQgdG8gYSBMaXRlTExNIHByb3h5IGVuZHBvaW50LlxuXG4jIyBXaHkgRXhpc3RpbmcgV29ya2Fyb3VuZHMgRmFpbFxuXG5gYWRkaXRpb25hbF9kcm9wX3BhcmFtczogW1wib3V0cHV0X2NvbmZpZ1wiXWAgYW5kIGBkcm9wX3BhcmFtczogdHJ1ZWAgb3BlcmF0ZSBvbiB0aGUgT3BlbkFJ4oaScHJvdmlkZXIgdHJhbnNsYXRpb24gbGF5ZXIuIFdoZW4gdGhlIHJlcXVlc3QgZW50ZXJzIHZpYSBgL2FudGhyb3BpYy92MS9tZXNzYWdlc2AgYW5kIHJvdXRlcyB0byBhbiBgYXp1cmVfYWkvYCBtb2RlbCwgTGl0ZUxMTSB0cmFuc2xhdGVzIEFudGhyb3BpY+KGkkF6dXJlIEFJIGZvcm1hdCDigJQgYnV0IGBhZGRpdGlvbmFsX2Ryb3BfcGFyYW1zYCBpcyAqKm5vdCoqIGFwcGxpZWQgZHVyaW5nIHRoYXQgdHJhbnNsYXRpb24gc3RlcC4gVGhlIHBhcmFtZXRlciBzdXJ2aXZlcyBpbnRvIHRoZSBvdXRib3VuZCByZXF1ZXN0LlxuXG4jIyBFeGlzdGluZyBQcmVjZWRlbnRcblxuUFIgIzI5NTg1IGZpeGVkIHRoZSBpZGVudGljYWwgaXNzdWUgZm9yIFZlcnRleCBBSTogaXQgc3RyaXBzIGBvdXRwdXRfY29uZmlnLmVmZm9ydGAgZm9yIFZlcnRleCBDbGF1ZGUgbW9kZWxzIHRoYXQgcmVqZWN0IGl0LiBUaGUgQXp1cmUgQUkgcHJvdmlkZXIgcGF0aCBoYXMgbm8gZXF1aXZhbGVudCBndWFyZC5cblxuRnJvbSBgbGl0ZWxsbS9sbG1zL3ZlcnTigKYifQ==
```
}