https://github.com/berriai/litellm/issues/31609 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTYwOSIsImhlYWRsaW5lIjoiIzMxNjA5IE1DUCBlZ3Jlc3M6IHRvb2wgbGlzdGluZyBkcm9wcyB0aGUgY2FsbGVyIHN1YmplY3QgdG9rZW4sIHNvIElELUpBRyAvIHRva2VuX2V4Y2hhbmdlIE9CTyBzZXJ2ZXJzIGxpc3Qgbm8gdG9vbHMiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHlhc3Npbi1iZXJyaWFpIl0sImV4Y2VycHQiOiIjIyBXaGF0XG5cbldoZW4gdGhlIHByb3h5IGxpc3RzIHRvb2xzIGZvciBhbiBNQ1AgZWdyZXNzIHNlcnZlciB0aGF0IHJlc29sdmVzIGl0cyB1cHN0cmVhbSBjcmVkZW50aWFsIGZyb20gdGhlIGNhbGxlcidzIGlkZW50aXR5ICh0aGUgcGVyLXVzZXIgT0JPIGdyYW50czogYG9hdXRoMl9pZF9qYWdgLCBhbmQgYG9hdXRoMl90b2tlbl9leGNoYW5nZWAgd2hlbiBubyBtYWNoaW5lIGZhbGxiYWNrIGlzIGNvbmZpZ3VyZWQpLCB0aGUgdG9vbCBsaXN0IGNvbWVzIGJhY2sgZW1wdHksIHNvIHRoZSBjbGllbnQgbmV2ZXIgZGlzY292ZXJzIHRoZSB0b29scyBhbmQgYSBzdWJzZXF1ZW50IGB0b29scy9jYWxsYCBpcyByZWplY3RlZCB3aXRoIFwidG9vbCBub3QgZm91bmRcIiBiZWZvcmUgdGhlIGNyZWRlbnRpYWwgZXhjaGFuZ2UgZXZlciBydW5zLiBUaGUgc2VydmVyIGlzIGVmZmVjdGl2ZWx5IHVudXNhYmxlIGVuZCB0byBlbmQgdGhyb3VnaCB0aGUgcHJveHkgTUNQIGdhdGV3YXkuXG5cbiMjIFdoeVxuXG5UaGUgdG9vbC1saXN0aW5nIHBhdGggKGBNQ1BTZXJ2ZXJNYW5hZ2VyLl9nZXRfdG9vbHNfZnJvbV9zZXJ2ZXJgIGluIGBsaXRlbGxtL3Byb3h5L19leHBlcmltZW50YWwvbWNwX3NlcnZlci9tY3Bfc2VydmVyX21hbmFnZXIucHlgKSBjYWxscyBgX2NyZWF0ZV9tY3BfY2xpZW50YCB3aXRob3V0IGEgYHN1YmplY3RfdG9rZW5gLCBieSBsb25nLXN0YW5kaW5nIGRlc2lnbiAoXCJ0b29sIGxpc3RpbmcgbXVzdCBub3QgYmUgYmxvY2tlZCBieSBtaXNzaW5nIHBlci11c2VyIGVudiB2YXJzXCIpLiBUaGUgdG9vbC1jYWxsIHBhdGggKGBfY2FsbF9yZWd1bGFyX21jcF90b29sYCkgZG9lcyBleHRyYWN0IHRoZSBjYWxsZXIncyBiZWFyZXIgYW5kIHRocmVhZCBpdCB0aHJvdWdoLiBGb3IgYW4gYG9hdXRoMl9pZF9qYWdgIHNlcnZlciB0aGVyZSBpcyBubyBzdGF0aWMgY3JlZGVudGlhbCB0byBmYWxsIGJhY2sgb24sIHNvIGxpc3RpbmcgZmFpbHMgY2xvc2VkICh0aGUgcmVzb2x2ZXIgcmV0dXJucyBgcHJlY29uZGl0aW9uX3JlcXVpcmVkYCksIGBnZXRfdG9vbHNgIHN3YWxsb3dzIGl0IGFuZCByZXR1cm5zIGBbXWAsIHRoZSByZWdpc3RyeSBzdGF5cyBlbXB0eSwgYW5kIHRoZSBjYWxsIGlzIHRoZW4gcmVmdXNlZCBhZ2FpbnN0IHRoYXQgZW1wdHkgcmVnaXN0cnkuXG5cblRoaXMgaXMgbm90IGludHJvZHVjZWQgYnkgdGhlIHYyLW5hdGl2ZSBJRC3igKYifQ==
```
}