https://github.com/berriai/litellm/issues/31699 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTY5OSIsImhlYWRsaW5lIjoiIzMxNjk5IFtCdWddOiBnb29nbGVNYXBzICsgcmVzcG9uc2VfZm9ybWF0IG9uIFZlcnRleCBBSSBzZW5kcyBgcmVzcG9uc2VGb3JtYXRgICh1bnN1cHBvcnRlZCAgIGZpZWxkKSwgY2F1c2luZyB+NjUtNzUlIGZsYWt5IDQwMCBlcnJvcnMgdW5kZXIgY29uY3VycmVudCBsb2FkIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBUaGFuYXdhcmF0R2l0aHViIiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiB1c2luZyBgZ29vZ2xlTWFwc2AgdG9vbCB3aXRoIGByZXNwb25zZV9mb3JtYXRgIChqc29uX3NjaGVtYSkgb24gYSBgdmVydGV4X2FpLWBcbiAgcHJlZml4ZWQgbW9kZWwsIExpdGVMTE0gdjEuODkuMCsgY29udmVydHMgdGhlIHJlcXVlc3QgdG8gdXNlIGByZXNwb25zZUZvcm1hdGAgaW5cbiAgYGdlbmVyYXRpb25Db25maWdgLiBIb3dldmVyLCBgcmVzcG9uc2VGb3JtYXRgIGlzIG5vdCBhIGRvY3VtZW50ZWQgZmllbGQgaW4gdGhlIFZlcnRleCBBSVxuICBBUEkgKHRoZSBvZmZpY2lhbCBkb2NzIG9ubHkgbGlzdCBgcmVzcG9uc2VNaW1lVHlwZWAgKyBgcmVzcG9uc2VTY2hlbWFgKS4gVW5kZXIgY29uY3VycmVudFxuICBsb2FkIHRoaXMgY2F1c2VzIH42NS03NSUgb2YgcmVxdWVzdHMgdG8gZmFpbCB3aXRoOlxuXG4gIFwiVW5hYmxlIHRvIHN1Ym1pdCByZXF1ZXN0IGJlY2F1c2UgQm90aCBsZWdhY3kgc3RydWN0dXJlZCBvdXRwdXQgZmllbGRzIGFuZCBuZXcgcmVzcG9uc2VcbiAgZm9ybWF0IGZpZWxkcyBhcmUgc2V0LiBQbGVhc2UgdXNlIG9ubHkgb25lIG9mIHRoZSB0d28gYXBwcm9hY2hlcy5cIlxuICBcbiAgVGhlIHJlcXVlc3QgYm9keSBvbmx5IGNvbnRhaW5zIGByZXNwb25zZUZvcm1hdGAgKG5vIGxlZ2FjeSBmaWVsZHMpLCB5ZXQgVmVydGV4IEFJIHJldHVybnNcbiAgdGhpcyBlcnJvciBpbnRlcm1pdHRlbnRseSwgaW5kaWNhdGluZyBHb29nbGUncyBiYWNrZW5kIGlzIGFkZGluZyBsZWdhY3kgZmllbGRzXG4gIGludGVybmFsbHkgb24gc29tZSByZXF1ZXN0cyBiZWZvcmUgdmFsaWRhdGlvbi5cbiAgXG4gIEV4cGVjdGVkIGJlaGF2aW9yOiBWZXJ0ZXggQUkgcmVxdWVzdHMgc2hvdWxkIHVzZSBgcmVzcG9uc2VNaW1lVHlwZWAgK1xuICBgcmVzcG9uc2VKc29uU2NoZW1hYCAoT0xEIGZvcm1hdCksIHdoaWNoIHdvcmtzIDEwMCUgcmVsaWFibHkuIFRoZSBgcmVzcG9uc2VGb3JtYXRgXG4gIHJld3JpdGUgaW50cm9kdWNlZCBpbiBQUiAjMjk1ODIgc2hvdWxkIG9ubHkgYXBwbHkgdG8gdGhlIGBnZW1pbmkvYCBwcm92aWRlciBwYXRoIChHZW1pbmlcbiAgQVBJKSwgbm90IGB2ZXJ0ZXhfYeKApiJ9
```
}