https://github.com/berriai/litellm/issues/31481 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTQ4MSIsImhlYWRsaW5lIjoiIzMxNDgxIFtCdWddOiBhZGFwdGl2ZV9yb3V0ZXIgcmVhZHMgbW9kZWwgY29zdCBmcm9tIGxpdGVsbG1fcGFyYW1zLmlucHV0X2Nvc3RfcGVyX3Rva2VuLCBub3QgbW9kZWxfaW5mbyDigJQgc2lsZW50bHkgemVyb2VzIG91dCBjb3N0LXdlaWdodGVkIHJvdXRpbmciLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHN1cmFuamFub3R0aSIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbldoZW4gY29uZmlndXJpbmcgYGF1dG9fcm91dGVyL2FkYXB0aXZlX3JvdXRlcmAgd2l0aCBgd2VpZ2h0czoge3F1YWxpdHk6IFgsIGNvc3Q6IFl9YCwgdGhlIHJvdXRlcidzIGNvc3QtYXdhcmUgc2NvcmluZyBzaWxlbnRseSBkb2VzIG5vdGhpbmcgaWYgYGlucHV0X2Nvc3RfcGVyX3Rva2VuYCBpcyBvbmx5IGRlY2xhcmVkIHVuZGVyIGBtb2RlbF9pbmZvYCAodGhlIGNvbnZlbnRpb25hbC9kb2N1bWVudGVkIGxvY2F0aW9uIGZvciBjb3N0IHRyYWNraW5nIGVsc2V3aGVyZSBpbiBMaXRlTExNLCBlLmcuIGNvc3QgbG9nZ2luZywgYnVkZ2V0IGFsZXJ0cykuXG5cblJvb3QgY2F1c2UgKGZvdW5kIGJ5IHJlYWRpbmcgcm91dGVyLnB5IGFuZCBiYW5kaXQucHkgaW5zaWRlIHRoZSBpbnN0YWxsZWQgcGFja2FnZSk6XG5cbmBSb3V0ZXIuaW5pdF9hZGFwdGl2ZV9yb3V0ZXJfZGVwbG95bWVudGAgYnVpbGRzIGBtb2RlbF90b19jb3N0YCBieSByZWFkaW5nIGBscF9kaWN0LmdldChcImlucHV0X2Nvc3RfcGVyX3Rva2VuXCIpYCBmcm9tIGVhY2ggbW9kZWwncyBgbGl0ZWxsbV9wYXJhbXNgLCBub3QgZnJvbSBgbW9kZWxfaW5mb2A6XG5cbmBgYFxubHAgPSBkLmdldChcImxpdGVsbG1fcGFyYW1zXCIpIGlmIGlzaW5zdGFuY2UoZCwgZGljdCkgZWxzZSBkLmxpdGVsbG1fcGFyYW1zXG5scF9kaWN0ID0gbHAgaWYgaXNpbnN0YW5jZShscCwgZGljdCkgZWxzZSAobHAubW9kZWxfZHVtcCgpIGlmIGxwIGVsc2Uge30pXG5jb3N0ID0gbHBfZGljdC5nZXQoXCJpbnB1dF9jb3N0X3Blcl90b2tlblwiKVxuaWYgY29zdCBpcyBub3QgTm9uZTpcbiAgICBtb2RlbF90b19jb3N0W25hbWVdID0gZmxvYXQoY29zdClcbmBgYFxuXG5cbiMjIyBTdGVwcyB0byBSZXByb2R1Y2VcblxuQ29uZmlndXJlIG1vZGVsX2xpc3Qgd2l0aCBhdCBsZWFzdCB0d28gbW9kZWxzIGJlaGluZCBhdXRvX3JvdXRlci9hZGFwdGl2ZV9yb3V0ZXIsIGRlY2xhcmluZyBpbnB1dF9jb3N0X3Blcl90b2tlbiBvbmx5IHVuZGVyIG1vZGVsX2luZm8gKG5vdCBsaXRlbGxtX3BhcmFtcyksIGUuZy46XG5gYGBcbm1vZGVsX2xpc3Q6XG5cbm1vZGVsX25hbWU6IGNoZWFwLW1vZGXigKYifQ== ``` }