https://github.com/berriai/litellm/issues/31619 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTYxOSIsImhlYWRsaW5lIjoiIzMxNjE5IFtCdWddOiBMYW5nR3JhcGggc3RyZWFtaW5nIGxlYWtzIHRoZSBodHRweCBjb25uZWN0aW9uIOKAlCBMYW5nR3JhcGhTU0VTdHJlYW1JdGVyYXRvciBoYXMgbm8gY2xvc2UoKS9hY2xvc2UoKSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAVmVkYW50LUFnYXJ3YWwiXSwiZXhjZXJwdCI6IiMjIFdoYXQgaGFwcGVuZWQ/XG5cbkxhbmdHcmFwaCBzdHJlYW1pbmcgbGVha3MgdGhlIHVuZGVybHlpbmcgaHR0cHggY29ubmVjdGlvbiB3aGVuZXZlciBhIHN0cmVhbSBpcyBjbGVhbmVkIHVwIChjbGllbnQgZGlzY29ubmVjdCwgbWlkLXN0cmVhbSBlcnJvciwgb3IgYW55IGVhcmx5IHRlcm1pbmF0aW9uKSwgYmVjYXVzZSBgTGFuZ0dyYXBoU1NFU3RyZWFtSXRlcmF0b3JgIGRvZXNuJ3QgaW1wbGVtZW50IGBjbG9zZSgpYCAvIGBhY2xvc2UoKWAuXG5cbmBDdXN0b21TdHJlYW1XcmFwcGVyLmFjbG9zZSgpYCByZWxlYXNlcyB0aGUgdW5kZXJseWluZyBzdHJlYW0gdmlhOlxuYGBgcHl0aG9uXG5pZiBoYXNhdHRyKHN0cmVhbV90b19jbG9zZSwgXCJhY2xvc2VcIik6XG4gICAgYXdhaXQgc3RyZWFtX3RvX2Nsb3NlLmFjbG9zZSgpXG5lbGlmIGhhc2F0dHIoc3RyZWFtX3RvX2Nsb3NlLCBcImNsb3NlXCIpOlxuICAgIC4uLlxuYGBgXG5gTGFuZ0dyYXBoU1NFU3RyZWFtSXRlcmF0b3JgIChgbGl0ZWxsbS9sbG1zL2xhbmdncmFwaC9jaGF0L3NzZV9pdGVyYXRvci5weWApIGhvbGRzIGBzZWxmLnJlc3BvbnNlYCAoYW4gaHR0cHggc3RyZWFtaW5nIHJlc3BvbnNlID0gYSBjaGVja2VkLW91dCBjb25uZWN0aW9uKSBidXQgZGVmaW5lcyAqKm5laXRoZXIqKiBgYWNsb3NlYCAqKm5vcioqIGBjbG9zZWAgKG5vciBgX19kZWxfX2ApLiBTbyB0aGUgY2xlYW51cCBjb250cmFjdCBzaWxlbnRseSBuby1vcHMgYW5kIHRoZSBjb25uZWN0aW9uIGlzIG5ldmVyIHJldHVybmVkIHRvIHRoZSBwb29sLiBBZGRpdGlvbmFsbHksIGBfX25leHRfX2AvYF9fYW5leHRfX2Agc3dhbGxvdyBtaWQtc3RyZWFtIGV4Y2VwdGlvbnMgYW5kIHJhaXNlIGBTdG9wKEFzeW5jKUl0ZXJhdGlvbmAgd2l0aG91dCBjbG9zaW5nIGBzZWxmLnJlc3BvbnNlYC5cblxuVGhpcyBpcyB0aGUgc2FtZSBmYWlsdXJlIGNsYXNzIGFzICMzMDI3MSAoY29ubmVjdGlvbiBub3QgcmVsZWFzZWQgb24gZWFybHkgc3RyZWFtIGJyZWFrKS4gT3RoZXIgcHJvdmlkZXJzJyBzdHJlYW0gaXRlcmF0b3JzIGV4cG9zZSBgYWNsb3NlYCAoZS5nLiBiYXJlIGByZXNwb25zZS5haXRlcl9saW5lcygpYCBnZW5lcmF0b3JzKSwgc28gY2xlYW51cCBwcm9wYWdhdGVzIGNvcnJlY3RseSDigJQgTGFuZ0dyYXBoIGJyZWFrcyB0aGF0IGNoYWluLlxuXG4jIyBSZXBybyAoZm91bmQgdmlhIGNvZGUgcmV2aWV3KVxuYGBgcHl0aG9uXG5m4oCmIn0=
```
}