https://github.com/berriai/litellm/issues/31050 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA1MCIsImhlYWRsaW5lIjoiIzMxMDUwIFtCdWddOiBNQ1Agc3RhdGljX2hlYWRlcnMgd2l0aCBvcy5lbnZpcm9uL1ZBUiBhcmUgbm90IHJlc29sdmVkIHdoZW4gc2F2ZWQgdmlhIFVJL0RCIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBoYXJzaGlscHJhamFwYXRpOTYiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuKipXaGF0IGhhcHBlbmVkOioqICBcbldoZW4gY29uZmlndXJpbmcgYW4gTUNQIHNlcnZlciBpbiB0aGUgQWRtaW4gVUksIHNldHRpbmcgYSAqKlN0YXRpYyBIZWFkZXIqKiB2YWx1ZSB0byBgb3MuZW52aXJvbi88RU5WX1ZBUl9OQU1FPmAgZG9lcyBub3QgcmVzb2x2ZSB0byB0aGUgYWN0dWFsIGVudmlyb25tZW50IHZhcmlhYmxlIGF0IHJ1bnRpbWUuIFRoZSBsaXRlcmFsIHN0cmluZyBgb3MuZW52aXJvbi88RU5WX1ZBUl9OQU1FPmAgaXMgc3RvcmVkIGluIHRoZSBEQiBhbmQgc2VudCBvbiBvdXRib3VuZCBNQ1AgcmVxdWVzdHMsIHNvIGF1dGggZmFpbHMuXG5cblBhc3RpbmcgdGhlIHJlYWwgc2VjcmV0IHZhbHVlIG1hbnVhbGx5IGluIHRoZSBzYW1lIFN0YXRpYyBIZWFkZXJzIGZpZWxkIHdvcmtzLlxuXG4qKkV4cGVjdGVkOioqICBcbmBvcy5lbnZpcm9uLzxWQVI+YCBpbiBNQ1AgYHN0YXRpY19oZWFkZXJzYCBzaG91bGQgcmVzb2x2ZSB2aWEgYGdldF9zZWNyZXQoKWAgLyBgb3MuZ2V0ZW52KClgLCBjb25zaXN0ZW50IHdpdGggb3RoZXIgcHJveHkgY29uZmlnIGZpZWxkcyBhbmQgWUFNTCBgbWNwX3NlcnZlcnNgIGNvbmZpZy5cblxuKipSb290IGNhdXNlIChmb3IgbWFpbnRhaW5lcnMpOioqICBcbmBQcm94eUNvbmZpZy5fY2hlY2tfZm9yX29zX2Vudmlyb25fdmFycygpYCByZXNvbHZlcyBgb3MuZW52aXJvbi9gIHJlZmVyZW5jZXMgZm9yIFlBTUwgY29uZmlnIGF0IGxvYWQgdGltZSwgYnV0IGBidWlsZF9tY3Bfc2VydmVyX2Zyb21fdGFibGUoKWAgZGVzZXJpYWxpemVzIGBzdGF0aWNfaGVhZGVyc2AgZnJvbSB0aGUgREIgd2l0aG91dCByZXNvbHZpbmcgdGhlbS4gVGhlIFRlc3QgQ29ubmVjdGlvbiBwYXRoIGFsc28gcGFzc2VzIGByZXF1ZXN0LnN0YXRpY19oZWFkZXJzYCB0aHJvdWdoIHVuY2hhbmdlZC5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBTZXQgYSBzZWNyZXQgaW4gdGhlIHByb3h5IHByb2Nlc3MgZW52aXJvbm1lbnQsIGUuZy46XG4gICBleHBvcnQgTVlfU0VDUkVUPVwic29tZS12YWx1ZVwiXG5cbjIuIFN0YXJ0IExpdGVMTE0gcHJveHkgd2l0aCBEQiBlbmFibGVkLuKApiJ9
```
}