https://github.com/berriai/litellm/issues/31226 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTIyNiIsImhlYWRsaW5lIjoiIzMxMjI2IFtGZWF0dXJlXTogZ3JlZW4tY29zdCBtZXRyaWNzIHdpdGggdGhlIEVjb2xvZ2l0cyBvYnNlcnZhYmlsdHkgcGx1Z2luIGZvciBsaXRlbGxtIHByb3h5Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBKZXNzaHVhbiIsIkxhYmVsczogZW5oYW5jZW1lbnQsIHByb3h5Il0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFRoZSBGZWF0dXJlXG5cbldlIHByb3Bvc2UgdG8gZW5yaWNoIGxpdGVsbG0ncyBleGlzdGluZyBsbG0gY2FsbCBtZXRyaWNzIHZpYSBhbiBvcHRpb25uYWwgRWNvbG9naXRzIHBsdWdpbiB0aGF0IHdpbGwgcHJvdmlkZSBncmVlbi1jb3N0IG1ldHJpY3MsIGJhc2VkIG9uIHRoZSBbRWNvbG9naXRzIEFQSV0oaHR0cHM6Ly9hcGkuZWNvbG9naXRzLmFpL2RvY3MpIGNhbGN1bGF0b3IsIGFuZCBmb3IgdmlzaWJpbGl0eSB0aHJvdWdoIGFsbCB0aGUgZG93bnN0cmVhbSBvYnNlcnZhYmlsaXR5IGNhbGxiYWNrIHBsdWdpbjogRGF0YWRvZywgTGFuZ2Z1c2UsIGV0Yy5cblxuRm9yIHRoaXMgZmlyc3QgcmF3ICdwcm94eSBtb2RlJyBmdW5jdGlvbmFsIHZlcnNpb24sIHRoZSBwcmluY2lwbGUgaXMgc2ltcGxlOlxuXG4tIHdoZW4gYSBuZXcgbW9kZWwgaXMgcmVnaXN0ZXJlZCwgdGhlIGxpdGVsbG0gYWRtaW5zIGNhbiBhZGQgYSBtb2RlbCBpbmZvIGFyZ3VtZW50IHVudGl0bGVkIFwiZWNvbG9naXRzX2VsZWN0cmljaXR5X21peF96b25lXCIgKGUuZy4gJ0ZSQScsICdERVUnKSBmb3IgdGhpcyBtb2RlbC4gSWYgdGhleSBkbyBub3QsIHRoZSBkZWZhdWx0IGVsZWN0cmlmeSBtaXggem9uZSBjYWxsIGJhY2sgc2ltcGx5IHRvIHRoZSBkZWZhdWx0IHpvbmUgXCJXT1JcIiAoZm9yIFwid29ybGRcIikuXG5cbi0gZm9yIGVhY2ggc3VjY2Vzc2Z1bGwgY2FsbCBmcm9tIGxpdGVsbG0gdG8gYW4gbGxtIHByb3ZpZGVyLCB0aGUgZ3JlZW4gaW1wYWN0IGlzIGV2YWx1YXRlZCB3aXRoIGFuIEFQSSBjYWxsIHRvIEVjb2xvZ2l0cyBBUEkgKG9yIHRoZSBpbnRlcm5hbCBFY29sb2dpdHMgQVBJIHNlbGYtaG9zdGVkIGJ5IHRoZSBlbnRlcnByaXNlKSBhbmQgdGhlc2UgbmV3IGdyZWVuIG1ldHJpYyBlbnJpY2ggdGhlIGluaXRpYWwgcGF5bG9hZCBmb3IgYWxsIHRoZSBsaXRlbGxtIHN1cHBvcnRlZCBjYWxsYmFjayBpbnRlZ3JhdGlvbnMgcGx1Z2luLCBjaG9vc2VuIGJ5IHRoZSB1c2VyczogbGFuZ2Z1c2UsIGRhdGFkb2csIHByb21ldGhldXMgbWV0cmljcyAuLi4gRm9yIHRoaXMgbGF0ZXN0LCBzb21lIGdyZWVuLWNvc3QgbWV0cmljcyBjb3VudGVyIGHigKYifQ==
```
}