https://github.com/berriai/litellm/issues/31178 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTE3OCIsImhlYWRsaW5lIjoiIzMxMTc4IFtCdWddOiBMaXRlTExNIHByb3h5IGZhaWxzIGZvciB2TExNIHF3ZW4zLXZsLWVtYmVkZGluZy04YiB3aXRoIGltYWdlIGlucHV0cyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAY3l5c2t5IiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuIyBMaXRlTExNIHByb3h5IGZhaWxzIGZvciBgcXdlbjMtdmwtZW1iZWRkaW5nLThiYCB3aXRoIGltYWdlIGlucHV0c1xuXG4jIyBTdW1tYXJ5XG5cbldoZW4gcHJveHlpbmcgdGhlIG11bHRpbW9kYWwgZW1iZWRkaW5nIG1vZGVsIGBxd2VuMy12bC1lbWJlZGRpbmctOGJgIHRocm91Z2hcbkxpdGVMTE0gdG8gYSB2TExNIGJhY2tlbmQsIGltYWdlIGlucHV0cyBhcmUgZWl0aGVyIHJlamVjdGVkIG91dHJpZ2h0IG9yIGNhdXNlXG5hbiBpbnRlcm5hbCA1MDAuIFRoZSBzYW1lIHJlcXVlc3RzIHdvcmsgZmluZSB3aGVuIHNlbnQgKipkaXJlY3RseSB0byB2TExNKiosXG53aGljaCBmb3JjZXMgdXMgdG8gYnlwYXNzIHRoZSBMaXRlTExNIHByb3h5IGZvciBhbnkgaW1hZ2UtZW1iZWRkaW5nXG53b3JrbG9hZHMuXG5cbiMjIEVudmlyb25tZW50XG5cbi0gdkxMTSBzZXJ2ZXMgYHF3ZW4zLXZsLWVtYmVkZGluZy04YmAgd2l0aCBhbiBPcGVuQUktY29tcGF0aWJsZVxuICBgL3YxL2VtYmVkZGluZ3NgIHJvdXRlLiBJdCBhbHNvIGFjY2VwdHMgdkxMTS1uYXRpdmVcbiAgYC92MS9lbWJlZGRpbmdzYCByZXF1ZXN0cyBzaGFwZWQgbGlrZSBhIGNoYXQgY29tcGxldGlvblxuICAoYG1lc3NhZ2VzOiBbe3JvbGU6IFwidXNlclwiLCBjb250ZW50OiBbe3R5cGU6XCJpbWFnZV91cmxcIiwgaW1hZ2VfdXJsOnt1cmw6Li4ufX1dfV1gKS5cbi0gTGl0ZUxMTSBwcm94eSBpcyBmcm9udGluZyB2TExNIChlbnYgdmFycyBpbiBvdXIgYC5lbnZgKTpcblxuICBgYGBcbiAgT1BFTkFJX0FQSV9CQVNFPWh0dHA6Ly82MC41MS4xLjEyODo5OTk5L3YxICAgICAgICAgICMgTGl0ZUxMTSBwcm94eVxuICBPUEVOQUlfQVBJX0tFWT1zay0uLi5cbiAgQ0hBVF9NT0RFTD1xd2VuMy41LTM5N2JcbiAgSU5TVFJVQ1RfTU9ERUw9cXdlbjMuNS0zOTdiLWluc3RydWN0XG4gIEVNQkVERElOR19PUEVOQUlfQVBJX0JBU0U9aHR0cDovLzEwLjAuMTUxLjI6MTQ3MDEvdjEgIyB2TExNIGRpcmVjdFxuICBFTUJFRERJTkdfTU9ERUw9cXdlbjMtdmwtZW1iZWRkaW5nLThiXG4gIGBgYFxuXG4gIFRoZSBwcm94eSBpcyByZWFjaGVkIG9uIHRoZSBkZWZhdWx0IE9wZW5BSSBwb3LigKYifQ==
```
}