https://github.com/berriai/litellm/issues/31722 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTcyMiIsImhlYWRsaW5lIjoiIzMxNzIyIFN0cmVhbWluZzogcmVzcG9uc2UgYG1vZGVsYCBpcyBvdmVycmlkZGVuIHRvIHRoZSByZXF1ZXN0ZWQgbW9kZWwgYWZ0ZXIgYSBmYWxsYmFjayAoc2VydmVkIGRlcGxveW1lbnQgbWFza2VkKTsgbm9uLXN0cmVhbWluZyBpcyBjb3JyZWN0Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBHaXVsaW9TdXJ5YSIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgV2hhdCBoYXBwZW5lZFxuXG5XaGVuIGEgcmVxdWVzdCBpcyByb3V0ZWQgdGhyb3VnaCB0aGUgcHJveHkgd2l0aCBtb2RlbC1ncm91cCAqKmZhbGxiYWNrcyoqIGFuZCB0aGUgcHJpbWFyeSBkZXBsb3ltZW50IGZhaWxzIChlLmcuIGEgYEJhZFJlcXVlc3RFcnJvcmAgLyBgVW5zdXBwb3J0ZWRQYXJhbXNFcnJvcmApLCB0aGUgcmVxdWVzdCBjb3JyZWN0bHkgZmFsbHMgYmFjayB0byBhIHNlY29uZGFyeSBkZXBsb3ltZW50LlxuXG5Ib3dldmVyLCB0aGUgYG1vZGVsYCBmaWVsZCByZXBvcnRlZCBiYWNrIHRvIHRoZSBjbGllbnQgZGlmZmVycyBiZXR3ZWVuIG5vbi1zdHJlYW1pbmcgYW5kIHN0cmVhbWluZzpcblxuLSAqKk5vbi1zdHJlYW1pbmcqKiDihpIgYHJlc3BvbnNlLm1vZGVsYCBpcyB0aGUgKipzZXJ2ZWQgKGZhbGxiYWNrKSBkZXBsb3ltZW50Kiog4oCUIGNvcnJlY3QuXG4tICoqU3RyZWFtaW5nKiog4oaSIGV2ZXJ5IGNodW5rJ3MgYG1vZGVsYCBpcyB0aGUgKipvcmlnaW5hbGx5IHJlcXVlc3RlZCBtb2RlbCBncm91cCoqLCBub3QgdGhlIGRlcGxveW1lbnQgdGhhdCBhY3R1YWxseSBnZW5lcmF0ZWQgdGhlIHRva2VucyDigJQgdGhlIGZhbGxiYWNrIGlzICoqc2lsZW50bHkgbWFza2VkKiouXG5cbkEgc3RyZWFtaW5nIGNsaWVudCB0aGVyZWZvcmUgY2Fubm90IHRlbGwgZnJvbSB0aGUgcmVzcG9uc2UgYm9keSB0aGF0IGEgZmFsbGJhY2sgaGFwcGVuZWQ6IGBtb2RlbGAgcmVwb3J0cyB0aGUgcmVxdWVzdGVkIG1vZGVsIHdoaWxlIGEgZGlmZmVyZW50IGRlcGxveW1lbnQgc2VydmVkIHRoZSByZXF1ZXN0LlxuXG4jIyMgUmVwcm9kdWN0aW9uXG5cbkNvbmZpZyDigJQgcHJpbWFyeSBncm91cCBmYWxscyBiYWNrIHRvIGEgc2Vjb25kYXJ5IGdyb3VwOlxuXG5gYGB5YW1sXG5tb2RlbF9saXN0OlxuICAtIG1vZGVsX25hbWU6IHByaW1hcnktbW9kZWxcbiAgICBsaXRlbGxtX3BhcmFtczpcbiAgICAgIG1vZGVsOiBvcGVuYWkvPHByb3ZpZGVyLW1vZGVsLXRoYXQtcmVqZWN0cy1zb21lLXBhcmFtPlxuICAgICAgYXBpX2Jhc2U6IGh0dHBzOi8vLi4uL3YxXG4gIC0gbW9kZWxfbmFtZTogc2Vjb25kYXJ5LW1vZGVsXG4gICAgbGl0ZWxsbV9wYXJhbXM6XG4gICAgICBtb2RlbDogYmVkcm9jay88c29tZS1iZWRyb2NrLW1vZGVsPlxucm91dGVyX3NldHRpbmdzOlxuICBmYWxsYmFja3M6IFt7XCJwcmltYXJ5LW1vZGVsXCI6IFtcInNlY29uZGFyeS1tb2RlbFwiXX1dXG5saXRlbGxtX3Nl4oCmIn0=
```
}