https://github.com/berriai/litellm/issues/31696 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTY5NiIsImhlYWRsaW5lIjoiIzMxNjk2IFtCdWddOiBHZW1pbmkgdmlhIC9yZXNwb25zZXMgZW5kcG9pbnQgcmV0dXJucyBcInRleHRcIjogbnVsbCBpbiBvdXRwdXRfdGV4dCBjb250ZW50IGJsb2NrIOKAlCB2aW9sYXRlcyBPcGVuQUkgUmVzcG9uc2VzIEFQSSBzcGVjIGFuZCBjcmFzaGVzIGRvd25zdHJlYW0gY29uc3VtZXJzIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBzb21pbG1haGVzaHdhcmkyMCIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbldoZW4gTGl0ZUxMTSBwcm94aWVzIGEgR2VtaW5pIG1vZGVsIChWZXJ0ZXggQUkpIHZpYSB0aGUgYC9yZXNwb25zZXNgIGVuZHBvaW50LCB0aGUgYmFjay10cmFuc2xhdGlvbiBmcm9tIEdlbWluaSdzIG5hdGl2ZSByZXNwb25zZSBmb3JtYXQgaW50byBPcGVuQUkgUmVzcG9uc2VzIEFQSSBmb3JtYXQgZW1pdHMgYFwidGV4dFwiOiBudWxsYCBmb3IgYG91dHB1dF90ZXh0YCBjb250ZW50IGJsb2NrcyB3aGVuIEdlbWluaSByZXR1cm5zIGEgdG9vbC9mdW5jdGlvbiBjYWxsIGFsb25nc2lkZSBhbiBlbXB0eSB0ZXh0IHByZWZpeC5cblxuVGhlIE9wZW5BSSBSZXNwb25zZXMgQVBJIHNwZWMgZGVmaW5lcyBgUmVzcG9uc2VPdXRwdXRUZXh0LnRleHRgIGFzIGBzdHJgIOKAlCBhIHJlcXVpcmVkLCBub24tbnVsbGFibGUgZmllbGQuIExpdGVMTE0ncyBiYWNrLXRyYW5zbGF0aW9uIHZpb2xhdGVzIHRoaXMgY29udHJhY3QgYnkgc2V0dGluZyBpdCB0byBgbnVsbGAgaW5zdGVhZCBvZiBgXCJcImAgKGVtcHR5IHN0cmluZykuXG5cblRoaXMgY2F1c2VzIGFueSBkb3duc3RyZWFtIGNvbnN1bWVyIHRoYXQgY29ycmVjdGx5IHRydXN0cyB0aGUgc3BlYyB0byBjcmFzaC4gSW4gb3VyIGNhc2UsIGBsYW5nY2hhaW4tb3BlbmFpYCdzIGBfZ2V0X291dHB1dF90ZXh0YCBmdW5jdGlvbiBkb2VzIGBcIlwiLmpvaW4oW2NvbnRlbnQudGV4dCBmb3IgY29udGVudCBpbiBvdXRwdXQuY29udGVudF0pYCwgd2hpY2ggdGhyb3dzOlxuXG5UeXBlRXJyb3I6IHNlcXVlbmNlIGl0ZW0gMDogZXhwZWN0ZWQgc3RyIGluc3RhbmNlLCBOb25lVHlwZSBmb3VuZFxuXG5UaGUgY3Jhc2ggaGFwcGVucyBvbiBldmVyeSBHZW1pbmkgcmVxdWVzdCB3aGVyZSB0aGUgbW9kZWwgcmV0dXJucyBhIHRvb2wgY2FsbCB3aXRoIGFuIGVtcHR5IHRleHQgcHJlZml4IOKAlCB3aGljaCBHZW1pbmkgZG9lcyByb3V0aW5lbHkgd2hlbiBpbnZva2luZyB0b29scyAoaXQgZW1pdHMgYSBibGFuayByZWFzb25pbmcvdGV4dCBibG9jayBhbG9uZ3NpZGUgdGhlIGZ1bmN0aW9uX2NhbGwgYmxvY2spLlxuXG5FeHBlY3RlZCBiZWhhdmlvdXI6IExpdGVMTE0gc2hvdWxkIOKApiJ9
```
}