https://github.com/berriai/litellm/issues/31837 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTgzNyIsImhlYWRsaW5lIjoiIzMxODM3IFtCdWddOiBPcGVuQUkgUmVzcG9uc2VzIHNlcnZlZCBzZXJ2aWNlX3RpZXI9ZGVmYXVsdCBpcyBiaWxsZWQgYXMgcHJpb3JpdHkgd2hlbiByZXF1ZXN0ZWQgcHJpb3JpdHkiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHNpbGVuY2Vkb2N0b3IiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiwgU0RLIl0sImV4Y2VycHQiOiIjIyMgV2hhdCBoYXBwZW5lZD9cblxuT3BlbkFJIFJlc3BvbnNlcyBjb3N0IHRyYWNraW5nIGNhbiBiaWxsIGEgcmVxdWVzdCBhdCBwcmlvcml0eSByYXRlcyBldmVuIHdoZW4gdGhlIHByb3ZpZGVyIHJlc3BvbnNlIHNheXMgdGhlIHJlcXVlc3Qgd2FzIHNlcnZlZCBhcyBgZGVmYXVsdGAuXG5cblRoaXMgaXMgYSBjb3N0LWNhbGN1bGF0aW9uIHByZWNlZGVuY2UgYnVnIGZvciBgL3YxL3Jlc3BvbnNlc2AsIG5vdCBhIFVJIGNvbmZpZ3VyYXRpb24gaXNzdWUuXG5cblRoZSBwcm9ibGVtYXRpYyBjYXNlIGlzOlxuXG4tIHRoZSByZXF1ZXN0IGFza3MgZm9yIGBzZXJ2aWNlX3RpZXI9XCJwcmlvcml0eVwiYFxuLSB0aGUgT3BlbkFJIFJlc3BvbnNlcyByZXNwb25zZSBjb250YWlucyBgc2VydmljZV90aWVyPVwiZGVmYXVsdFwiYFxuLSBMaXRlTExNIGNvc3QgY2FsY3VsYXRpb24gcHJlZmVycyB0aGUgcmVxdWVzdC1sZXZlbCB0aWVyIGJlZm9yZSB0aGUgcmVzcG9uc2UgdGllclxuXG5UaGF0IG1lYW5zIGNvc3QgdHJhY2tpbmcgY2FuIHNlbGVjdCBgaW5wdXRfY29zdF9wZXJfdG9rZW5fcHJpb3JpdHlgIC8gYG91dHB1dF9jb3N0X3Blcl90b2tlbl9wcmlvcml0eWAgZXZlbiB0aG91Z2ggdGhlIHNlcnZlZCB0aWVyIHJlcG9ydGVkIGJ5IHRoZSBwcm92aWRlciB3YXMgYGRlZmF1bHRgLlxuXG5FeHBlY3RlZCBiZWhhdmlvcjogd2hlbiBhIHByb3ZpZGVyIHJlcG9ydHMgdGhlIHNlcnZlZCB0aWVyIG9uIHRoZSByZXNwb25zZSwgY29zdCB0cmFja2luZyBzaG91bGQgcHJlZmVyIHRoYXQgY29uY3JldGUgc2VydmVkIHRpZXIgb3ZlciB0aGUgcmVxdWVzdCBwcmVmZXJlbmNlLiBBIHJlc3BvbnNlLWxldmVsIGBkZWZhdWx0YCBzaG91bGQgbWFwIHRvIHN0YW5kYXJkL2RlZmF1bHQgcHJpY2luZy5cblxuIyMjIFN0ZXBzIHRvIHJlcHJvZHVjZVxuXG5gYGBweXRob25cbmltcG9ydCBsaXRlbGxtXG5mcm9tIGxpdGVsbG0gaW1wb3J0IGNvbXBsZXRpb25fY29zdFxuZnJvbSBsaXRlbGxtLnR5cGVzLmxsbXMub3BlbmFpIGltcG9ydCBSZXNwb25zZXNBUElSZXNwb25zZVxuXG5tb2RlbCA9IFwidGVzdC1vcGVuYWktcmVzcG9uc2VzLWRlZmF1bHQtdGllci1jb3N0LW1vZGVsXCJcbmxpdGVsbG0ucmVnaXN0ZXJfbW9kZWwoXG4gICAgbW9kZWxfY29zdD17XG4gICAgICAgIG1vZGVsOiB7XG4gICAgICAgICAgICBcImlucHV0X2Nvc3RfcGVyX3Rva2VuXCI6IDAuMDAxLFxuICAgICAgICAgICAgXCJvdXRw4oCmIn0=
```
}