https://github.com/berriai/litellm/issues/30320 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDMyMCIsImhlYWRsaW5lIjoiIzMwMzIwIFtCdWddOiBsaXRlbGxtW3Byb3h5XSArIHZlcnRleF9haSBtb2RlbHMgNTAwcyBvbiBldmVyeSByZXF1ZXN0IHdpdGggcmF3IFwiTm8gbW9kdWxlIG5hbWVkICdnb29nbGUnXCIg4oCUIGdvb2dsZS1hdXRoIG1pc3NpbmcgZnJvbSBwcm94eSBleHRyYSwgbm8gc3RhcnR1cCB2YWxpZGF0aW9uIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBqYXZpZXJ2aWxsYW0tYXhpb20tcm9ib3RpY3MiLCJMYWJlbHM6IHByb3h5LCBsbG0gdHJhbnNsYXRpb24sIGNsYXVkZSBjb2RlIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbkEgYmFyZSBwaXAvdXYgaW5zdGFsbCBvZiBgbGl0ZWxsbVtwcm94eV1gIHdpdGggYSBgdmVydGV4X2FpLypgIG1vZGVsIGluIGBtb2RlbF9saXN0YCBzdGFydHMgdGhlIHByb3h5IGNsZWFubHksIGJ1dCAqKmV2ZXJ5IHJlcXVlc3QgdGhlbiBmYWlscyB3aXRoIGEgNTAwKiogd2hvc2Ugcm9vdCBjYXVzZSBpcyBhIHJhdyBgTW9kdWxlTm90Rm91bmRFcnJvcjogTm8gbW9kdWxlIG5hbWVkICdnb29nbGUnYCByYWlzZWQgZnJvbSBgdmVydGV4X2xsbV9iYXNlLnB5YCAoYGZyb20gZ29vZ2xlLmF1dGguY3JlZGVudGlhbHMgaW1wb3J0IFRva2VuU3RhdGVgKS5cblxuYGdvb2dsZS1hdXRoYCBpcyBub3QgcGFydCBvZiB0aGUgYHByb3h5YCBleHRyYSwgYW5kIG5vdGhpbmcgdmFsaWRhdGVzIGl0IGF0IHN0YXJ0dXAgZXZlbiB0aG91Z2ggdGhlIGNvbmZpZyBkZWNsYXJlcyBWZXJ0ZXggbW9kZWxzIHRoYXQgY2FuIG9ubHkgYXV0aGVudGljYXRlIHRocm91Z2ggYGdvb2dsZS5hdXRoYC5cblxuV2h5IHRoaXMgaXMgc3VycHJpc2luZyBmcm9tIGEgdXNlcidzIHBlcnNwZWN0aXZlOlxuXG4tIFRoZSBgcHJveHlgIGV4dHJhICoqZG9lcyoqIHNoaXAgdGhlIGVxdWl2YWxlbnQgYXV0aCBkZXBlbmRlbmN5IGZvciB0aGUgb3RoZXIgbWFqb3IgY2xvdWRzIOKAlCBgYm90bzNgIChCZWRyb2NrL1NpZ1Y0KSBhbmQgYGF6dXJlLWlkZW50aXR5YCBhcmUgYm90aCBpbiBgW3Byb2plY3Qub3B0aW9uYWwtZGVwZW5kZW5jaWVzXS5wcm94eWAg4oCUIHNvIFZlcnRleCBpcyB0aGUgb25seSBtYWpvciBjbG91ZCB3aG9zZSBhdXRoIGRlcGVuZGVuY3kgaXMgbWlzc2luZyBmcm9tIGEgYGxpdGVsbG1bcHJveHldYCBpbnN0YWxsLlxuLSBUaGUgRG9ja2VyIGltYWdlIHByZS1pbnN0YWxscyBgZ29vZ2xlLWNsb3VkLWFpcGxhdGZvcm1gICh2aWEgYHByb3h5LXJ1bnRpbWVgKSwgc28gdGhlIGZhaWx1cmUgb25seSBoaXRzIHBpcC91diB1c2VycywgZS5nLiBhbnlvbmUgZm9sbG93aW5nIHRoZSBcIlVzZSBDbGF1ZGUgQ29kZSB3aXRoIE5vbi1BbnRocm9waWMgTW9kZWxzXCIgdHV0b3JpYWwgd2l0aCBhIEdlbWluaS9WZXJ0ZXgg4oCmIn0=
```
}