https://github.com/berriai/litellm/issues/31398 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTM5OCIsImhlYWRsaW5lIjoiIzMxMzk4IFtGZWF0dXJlXTogQ0MgU3dpdGNoLWxpa2UgVUkgY29tcG9uZW50IHRvIGhvdC1zd2l0Y2ggYWN0aXZlIGJhY2tlbmQgZGVwbG95bWVudCBmb3IgYSBtb2RlbCBncm91cCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbGluLWNhbHZpbiIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyBEZXNjcmlwdGlvblxuXG5XaGVuIGEgbW9kZWwgZ3JvdXAgKGlkZW50aWZpZWQgYnkgYG1vZGVsX25hbWVgKSBoYXMgbXVsdGlwbGUgZGVwbG95bWVudHMgKGUuZy4sIHNhbWUgbW9kZWwgZnJvbSBkaWZmZXJlbnQgcHJvdmlkZXJzIGxpa2UgQXp1cmUgT3BlbkFJIHZzIE9wZW5BSSwgb3IgbXVsdGlwbGUgdkxMTSBpbnN0YW5jZXMpLCBvcGVyYXRvcnMgbmVlZCBhIHNpbXBsZSB3YXkgdG8gKipob3Qtc3dpdGNoIHdoaWNoIGRlcGxveW1lbnQgaXMgdGhlIFwiYWN0aXZlXCIgb25lKiogZnJvbSB0aGUgQWRtaW4gVUkg4oCUIHNpbWlsYXIgdG8gYSBcIkNDIFN3aXRjaFwiIGV4cGVyaWVuY2UuXG5cbiMjIEN1cnJlbnQgc3RhdGVcblxuVGhlIGNsb3Nlc3QgZXhpc3RpbmcgZmVhdHVyZSBpcyB0aGUgKipQYXVzZS9SZXN1bWUgU3dpdGNoKiogKFBSICMyNzkyNywgIzI4MTUxLCBjbG9zZWQgaXNzdWUgIzEzNzAzKS4gVGhpcyBhbGxvd3MgcGF1c2luZyBpbmRpdmlkdWFsIGRlcGxveW1lbnRzIGZyb20gdGhlIFVJLCBhbmQgdHJhZmZpYyBhdXRvbWF0aWNhbGx5IHJvdXRlcyB0byBzaWJsaW5nIGRlcGxveW1lbnRzIHVuZGVyIHRoZSBzYW1lIGBtb2RlbF9uYW1lYC4gSG93ZXZlciwgdGhlIFVYIGlzIGRpZmZlcmVudCBmcm9tIGEgZGVkaWNhdGVkIGFjdGl2ZS1iYWNrZW5kIHNlbGVjdG9yOlxuXG4tIFBhdXNlL1Jlc3VtZSBpcyBhIGJpbmFyeSBvbi9vZmYgdG9nZ2xlIHBlciBkZXBsb3ltZW50XG4tIEl0IGRvZXMgbm90IHZpc3VhbGx5IHNob3cgXCJ0aGlzIGRlcGxveW1lbnQgaXMgY3VycmVudGx5IHRoZSBhY3RpdmUgb25lXCIgdnMgXCJ0aGlzIGlzIGEgc3RhbmRieVwiXG4tIFN3aXRjaGluZyByZXF1aXJlcyBwYXVzaW5nIG9uZSBkZXBsb3ltZW50IGFuZCByZWx5aW5nIG9uIGZhbGxiYWNrLCByYXRoZXIgdGhhbiBleHBsaWNpdGx5IHNlbGVjdGluZyB3aGljaCBkZXBsb3ltZW50IHNob3VsZCBoYW5kbGUgdHJhZmZpY1xuXG4jIyBEZXNpcmVkIGZ1bmN0aW9uYWxpdHlcblxuQSBkZWRpY2F0ZWQgVUkgY29tcG9uZW50IHRoYXQ6XG5cbjEuICoqR3JvdXBzIGRlcGxveW1lbnRzIGJ5IG1vZGVsIGdyb3VwKiog4oCUIHNob3dzIGFsbCBkZXBsb3ltZW50cyB1bmRlciBhIGdpdmVuIGBtb2RlbF9uYW1lYFxuMi4gKipEaXNwbGF5cyBkZXBsb3ltZW50IG1ldGFkYXRhKiog4oCUIHByb3ZpZGVyLCBtb2RlbCwgYXBpX2Jhc2UsIG9yZGVyLCBoZWFsdGggc3RhdHVzXG4zLiAqKuKApiJ9
```
}