https://github.com/berriai/litellm/issues/31261 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTI2MSIsImhlYWRsaW5lIjoiIzMxMjYxIGxpdGVsbG0gcnVzdCBwaXAgYmluYXJ5Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBpc2hhYW4tYmVycmkiXSwiZXhjZXJwdCI6IldlIGFyZSBzdGFydGluZyB0aGlzIGlzc3VlIGFzIHRoZSBjZW50cmFsIHBsYWNlIGZvciBwZW9wbGUgdG8gcmVwb3J0IGluc3RhbGwgaXNzdWVzIHdpdGggdGhlIHVwY29taW5nIExpdGVMTE0gUnVzdC1iYWNrZWQgcGlwIGJpbmFyeSB3b3JrLlxuXG5Hb2FsOiBtYWtlIHRoZSBkZWZhdWx0IGBwaXAgaW5zdGFsbCBsaXRlbGxtYCBpbmNsdWRlIHRoZSBSdXN0IGV4dGVuc2lvbiB3aGVyZSBhIGNvbXBhdGlibGUgd2hlZWwgaXMgYXZhaWxhYmxlLCBzbyBMaXRlTExNIFB5dGhvbiBjb2RlIGNhbiBkZXBlbmQgb24gdGhlIFJ1c3QgaW1wbGVtZW50YXRpb24gd2l0aG91dCByZXF1aXJpbmcgYSBzZXBhcmF0ZSB1c2VyLWZhY2luZyBwYWNrYWdlLlxuXG5QbGVhc2UgcmVwb3J0IGFueSBpbnN0YWxsL2ltcG9ydCBwcm9ibGVtcyBoZXJlLCBlc3BlY2lhbGx5IGZvcjpcblxuLSBtYWNPUyBhcm02NCBvciB4ODZfNjRcbi0gTGludXggeDg2XzY0IG9yIGFhcmNoNjRcbi0gQWxwaW5lIC8gbXVzbGxpbnV4IGNvbnRhaW5lcnNcbi0gV2luZG93cyB4ODZfNjRcbi0gbGVzcyBjb21tb24gUHl0aG9uIHJ1bnRpbWVzIG9yIHBsYXRmb3Jtc1xuXG5IZWxwZnVsIHJlcG9ydCBmb3JtYXQ6XG5cbmBgYHRleHRcbk9TIC8gZGlzdHJvOlxuQ1BVIGFyY2hpdGVjdHVyZTpcblB5dGhvbiB2ZXJzaW9uOlxucGlwIG9yIHV2IHZlcnNpb246XG5JbnN0YWxsIGNvbW1hbmQ6XG5GdWxsIGVycm9yIGxvZzpcbk91dHB1dCBvZjogcHl0aG9uIC1tIHBpcCBkZWJ1ZyAtLXZlcmJvc2UgfCBoZWFkIC04MFxuT3V0cHV0IG9mOiBweXRob24gLWMgXCJpbXBvcnQgcGxhdGZvcm0sIHN5czsgcHJpbnQoc3lzLnZlcnNpb24pOyBwcmludChwbGF0Zm9ybS5wbGF0Zm9ybSgpKTsgcHJpbnQocGxhdGZvcm0ubWFjaGluZSgpKVwiXG5gYGBcblxuS25vd24gaW1wbGVtZW50YXRpb24gZGlyZWN0aW9uOlxuXG4tIHNoaXAgUnVzdCBpbnNpZGUgdGhlIGRlZmF1bHQgYGxpdGVsbG1gIHBsYXRmb3JtIHdoZWVsc1xuLSBleHBvc2UgdGhlIG5hdGl2ZSBtb2R1bGUgdW5kZXIgdGhlIGBsaXRlbGxtYCBwYWNrYWdlLCBlLmcuIGBsaXRlbGxtLl9ydXN0X2JyaWRnZWBcbi0gdXNlIFB5TzMgKyBtYXR1cmluIGZvciBiaW5hcnkgd2hlZWwgYnVpbGRzXG4tIGtlZXAgQ0kgc21va2UgdGVzdHMgZm9yIGltcG9ydC9pbnN0YWxsIG9uIGV2ZXJ5IHN1cHBvcnRlZCB3aGVlbCB0YXJnZXRcbi0gbWFrZSBEb2NrZXIgc291cmNlIGJ1aWxkcyBpbuKApiJ9
```
}