https://github.com/berriai/litellm/issues/31894 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTg5NCIsImhlYWRsaW5lIjoiIzMxODk0IFtCdWddOiBFbWJlZGRpbmdzIGRvbid0IHdvcmsgZm9yIERlZXBJbmZyYSwgb3IgQ3VzdG9tIE9wZW5BSSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbmd1eWVubXAiLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5JJ20gdXNpbmcgYSBjdXN0b20gcHJvdmlkZXIgKERlZXBJbmZyYSkgdG8gaG9zdCBgUXdlbi9Rd2VuMy1FbWJlZGRpbmctOEJgIGZvciBlbWJlZGRpbmcuICBJJ3ZlIGhhZCBhIGxvdCBvZiBkaWZmaWN1bHR5IHNldHRpbmcgdXAgTGl0ZUxMTSB0byBwcm9wZXJseSBydW4gZW1iZWRkaW5ncyB0aHJvdWdoIERlZXBJbmZyYS5cblxuVGhlIHF1aWNrIHN1bW1hcnkgaXMgdGhhdCBJIGRvbid0IHRoaW5rIHlvdSBjYW4gcnVuIGVtYmVkZGluZ3Mgd2hlbiB0aGUgcHJvdmlkZXIgaXMgc2V0IHRvIERlZXBJbmZyYSBvciBgY3VzdG9tX29wZW5haWAuICBJdCBvbmx5IHdvcmtzIHdpdGggYHByb3ZpZGVyPW9wZW5haWAgYW5kIHRoZSBjcmVkZW50aWFscyBwcm92aWRlIGFuIEFQSSBiYXNlIHBvaW50aW5nIHRvIERlZXBJbmZyYS5cblxuV2UgZmFsbCB0aHJvdWdoIHRvIGxpdGVsbG0vbWFpbi5weTo2ODM3OlxuYGBgXG4gICAgICAgIGVsc2U6XG4gICAgICAgICAgICByYWlzZSBMaXRlTExNVW5rbm93blByb3ZpZGVyKG1vZGVsPW1vZGVsLCBjdXN0b21fbGxtX3Byb3ZpZGVyPWN1c3RvbV9sbG1fcHJvdmlkZXIpXG5gYGBcblxuSSB0aGluayB0aGlzIGlzc3VlIHNob3dzIG9mZiBhIGZldyBwcm9ibGVtczpcbiogd2hlbiBhbiBwcm92aWRlciBkb2VzIG5vdCBzdXBwb3J0IGVtYmVkZGluZ3MsIGEgdmVyeSB1bmhlbHBmdWwgZXJyb3Igb2NjdXJzXG4qIGl0J3MgdW5jbGVhciBpZiBJIHNob3VsZCB1c2UgdGhlIERlZXBJbmZyYSBwcm92aWRlciwgdGhlIEN1c3RvbSBPcGVuQUkgcHJvdmlkZXIsIG9yIE9wZW5haS1saWtlLCBPcGVuQUkgQ29tcGF0aWJsZSBBUElzLi4uIHR1cm5zIG91dCBvbmx5IE9wZW5BSSBpcyBzdXBwb3J0ZWRcblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBDcmVhdGUgYSBEZWVwSW5mcmEgb3IgQ3VzdG9tIE9wZW5BSSBwcm92aWRlciBtb2RlbCBmb3IgZW1iZWRkaW5ncyB1c2luZyBgUXdlbi9Rd2VuMy1FbWJlZGRpbmctOEJgXG4yLiBUZXN0IHRoZSBjb25uZWN0aW9uXG5cbiMjIyBSZWxldmFudCBsb2cgb3V0cHV0XG5cbmBgYHNoZWxsXG5UaGlzIGlzIHRoZSBvdXRwdXQgb2YgYSB0ZeKApiJ9
```
}