https://github.com/berriai/litellm/issues/31352 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTM1MiIsImhlYWRsaW5lIjoiIzMxMzUyIEVuYWJsZSBMaW5rLVRpbWUgT3B0aW1pemF0aW9uIChMVE8pIGFuZCBjb2RlZ2VuLXVuaXRzID0gMSBmb3IgUmVsZWFzZSBidWlsZHMgKGFuZCBwb3NzaWJseSBvdGhlciBvcHRpb25zKSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAemFtYXphbjRpayJdLCJleGNlcnB0IjoiSGkhXG5cbkp1c3QgcmVhZCB0aGUgW2FydGljbGVdKGh0dHBzOi8vZG9jcy5saXRlbGxtLmFpL2Jsb2cvbGl0ZWxsbS1ydXN0LWxhdW5jaCkgYWJvdXQgdGhlIFJ1c3QgcmV3cml0ZSAtIG5pY2UgdG8gc2VlIHRoYXQgbW9yZSBwZW9wbGUgY2FyZXMgYWJvdXQgcGVyZm9ybWFuY2UgaW4gdGhlIGluZHVzdHJ5ISBUaGF0J3Mgd2h5IEkgZGVjaWRlZCB0byBwcm9wb3NlIHNvbWUgYWRkaXRpb25hbCBlYXN5LXRvLWVuYWJsZSBpbXByb3ZlbWVudHMgZm9yIHRoZSBSdXN0IHZlcnNpb24uXG5cbkkgbm90aWNlZCB0aGF0IGluIHRoZSBgQ2FyZ28udG9tbGAgW2ZpbGVdKGh0dHBzOi8vZ2l0aHViLmNvbS9CZXJyaUFJL2xpdGVsbG0vYmxvYi9saXRlbGxtX2ludGVybmFsX3N0YWdpbmcvbGl0ZWxsbS1ydXN0L0NhcmdvLnRvbWwpLCBbTGluay1UaW1lIE9wdGltaXphdGlvbl0oaHR0cHM6Ly9ubmV0aGVyY290ZS5naXRodWIuaW8vcGVyZi1ib29rL2J1aWxkLWNvbmZpZ3VyYXRpb24uaHRtbCNsaW5rLXRpbWUtb3B0aW1pemF0aW9uKSAoTFRPKSBmb3IgdGhlIHByb2plY3QgaXMgbm90IGVuYWJsZWQuIEkgc3VnZ2VzdCBzd2l0Y2hpbmcgaXQgb24gc2luY2UgaXQgd2lsbCByZWR1Y2UgdGhlIGJpbmFyeSBzaXplIChhbHdheXMgYSBnb29kIHRoaW5nIHRvIGhhdmUpIGFuZCB3aWxsIGxpa2VseSBpbXByb3ZlIENQVSBwZXJmb3JtYW5jZSBhIGJpdCBkdWUgdG8gbW9yZSBhZ2dyZXNzaXZlIGNvbXBpbGVyIG9wdGltaXphdGlvbnMuIEFkZGl0aW9uYWxseSwgYGNvZGVnZW4tdW5pdHMgPSAxYCAoQ1UxKSBvcHRpb24gY2FuIGhlbHAgdG9vIGluIGEgc2ltaWxhciB0byBMVE8gd2F5LCBzbyBJIHJlY29tbWVuZCB0byBlbmFibGUgaXQgYXMgd2VsbC5cblxuSSByZWNvbW1lbmQgZW5hYmxpbmcgTFRPIG9ubHkgZm9yIFJlbGVhc2UgYnVpbGRzIHNvIGRldmVsb3BlcnMgZXhwZXJpZW5jZSB3b24ndCBiZSBhZmZlY3RlZCBieSB0aGUgaW5jcmVhc2VkIGJ1aWxkIHRpbWUuIEFjdHVhbGx5LCBJIGNhbiBwcm9wb3NlIHRvIHVzZSBmbGFncyBkaXJlY3RseSBmcm9tIHRoaXMgYHJpcGdyZXBgIFtwcm9maWxlXShodHRwczovL2dpdGh1Yi5jb20vQnVybnRTdXNoaS9yaXBncmVwL2Jsb2IvY2JjNTk4ZjI0NWYzYzE1N2E4NzJiNjkxMDI2NTNlMmUzNDliNmQ5Mi9DYXJnby50b21sI0w3NikgKGxpa2Ugc3RyaXBwaW5nIGFuZCBvdGhlciBwb3RlbnRpYWxs4oCmIn0=
```
}