https://github.com/berriai/litellm/issues/31008 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTAwOCIsImhlYWRsaW5lIjoiIzMxMDA4IFtCdWddOiBCYWNrZ3JvdW5kIGhlYWx0aCBjaGVja3MgZmFpbCBmb3IgT3BlblJvdXRlciBtb2RlbHMgd2l0aCBleHRyYV9ib2R5LnRvb2xzIChvcGVucm91dGVyOndlYl9zZWFyY2gpOyByZWFsIGNvbXBsZXRpb25zIHN1Y2NlZWQiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHBsaXNzamUiLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5PcGVuUm91dGVyIG1vZGVscyBjb25maWd1cmVkIHdpdGggZ2F0ZXdheS13aWRlIHdlYiBzZWFyY2ggdmlhIGBsaXRlbGxtX3BhcmFtcy5leHRyYV9ib2R5LnRvb2xzYCAoYG9wZW5yb3V0ZXI6d2ViX3NlYXJjaGAsIG9wdGlvbmFsbHkgYG9wZW5yb3V0ZXI6ZGF0ZXRpbWVgKSBhcmUgbWFya2VkICoqdW5oZWFsdGh5KiogYnkgTGl0ZUxMTSBiYWNrZ3JvdW5kIGhlYWx0aCBjaGVja3MsIHdoaWxlIG5vcm1hbCBjaGF0IGNvbXBsZXRpb25zIG9uIHRoZSBzYW1lIGRlcGxveW1lbnQgc3VjY2VlZC5cblxuKipFeHBlY3RlZDoqKiBIZWFsdGggY2hlY2tzIHBhc3MgZm9yIGEgZGVwbG95bWVudCB0aGF0IGNhbiBjb21wbGV0ZSByZWFsIGNoYXQgcmVxdWVzdHMsIG9yIHByb2JlcyBzaG91bGQgbm90IGluaGVyaXQgc2VydmVyLXRvb2wgYGV4dHJhX2JvZHlgIHRoYXQgY2hhbmdlcyByZXF1ZXN0IHNlbWFudGljcy5cblxuKipBY3R1YWw6KiogUmVtb3ZpbmcgYGV4dHJhX2JvZHlgIG1ha2VzIGhlYWx0aCBjaGVja3MgcGFzcy4gQWRkaW5nIG9ubHkgYG9wZW5yb3V0ZXI6d2ViX3NlYXJjaGAgaW4gYGV4dHJhX2JvZHlgIG1ha2VzIGhlYWx0aCBjaGVja3MgZmFpbCBhZ2Fpbi4gSW5jcmVhc2luZyBgbW9kZWxfaW5mby5oZWFsdGhfY2hlY2tfbWF4X3Rva2Vuc2AgZGlkIG5vdCBoZWxwLlxuXG4qKkVudmlyb25tZW50KipcblxuLSBMaXRlTExNIHYxLjg5LjIgKHByb2R1Y3Rpb24pIGFuZCB2MS44OS4zIChsb2NhbCBkb2NrZXIpIOKAlCBzYW1lIGJlaGF2aW9yXG4tIFByb3ZpZGVyOiBPcGVuUm91dGVyXG4tIEV4YW1wbGUgbW9kZWxzOiBgb3BlbnJvdXRlci9hbnRocm9waWMvY2xhdWRlLWhhaWt1LTQuNWAsIGBvcGVucm91dGVyL2dvb2dsZS9nZW1pbmktMy1mbGFzaC1wcmV2aWV3YFxuLSBNb2RlbHMgc3RvcmVkIGluIERCIHZpYSBBZG1pbiBVSSAoYFNUT1JFX01PREVMX0lOX0RCPVRydWVgKVxuXG4qKlN1c3BlY3RlZCBjYXVzZSoqXG5cbmBsaXRlbGxtL3Byb3h5L2hlYWx0aF9jaGVjay5weWAgZnVuY3Rpb24gYF91cGRhdGVfbGl0ZWxsbV9wYXJhbXNfZm9yX2hlYWx0aF9jaGVjaygpYCBvdmVycmlkZXMgYG3igKYifQ==
```
}