https://github.com/berriai/litellm/issues/30371 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDM3MSIsImhlYWRsaW5lIjoiIzMwMzcxIFtCdWddOiBCZWRyb2NrIGludm9rZSBwYXRoIGxlYWtzIExpdGVMTE0taW50ZXJuYWwgcGFyYW1zIGludG8gdGhlIHJlcXVlc3QgYm9keSAoQ29udmVyc2UgYWxyZWFkeSBmaWx0ZXJzIHRoZW0pIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBraW1uYW11IiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IlRoYW5rcyBmb3IgTGl0ZUxMTSDigJQgdGhlIHVuaWZpZWQgZ2F0ZXdheSBoYXMgYmVlbiBodWdlbHkgdXNlZnVsIGZvciB3b3JraW5nIGFjcm9zcyBCZWRyb2NrIGFuZCBvdGhlciBwcm92aWRlcnMuXG5cbiMjIFByb2JsZW1cblxuVGhlIEJlZHJvY2sgKippbnZva2UqKiB0cmFuc2Zvcm0gbGVha3MgTGl0ZUxMTS1pbnRlcm5hbCBgb3B0aW9uYWxfcGFyYW1zYCBpbnRvIHRoZSBwcm92aWRlciByZXF1ZXN0IGJvZHkuIEFmdGVyIGZpbHRlcmluZyBvdXQgQVdTLWF1dGgga2V5cywgaXQgc3BsYXRzIHRoZSByZW1haW5pbmcgYGluZmVyZW5jZV9wYXJhbXNgIHN0cmFpZ2h0IGludG8gdGhlIHJlcXVlc3Q6XG5cbmBgYHB5dGhvblxuIyBsaXRlbGxtL2xsbXMvYmVkcm9jay9jaGF0L2ludm9rZV90cmFuc2Zvcm1hdGlvbnMvYmFzZV9pbnZva2VfdHJhbnNmb3JtYXRpb24ucHkgICh0cmFuc2Zvcm1fcmVxdWVzdClcbmluZmVyZW5jZV9wYXJhbXMgPSB7azogdiBmb3IgaywgdiBpbiBpbmZlcmVuY2VfcGFyYW1zLml0ZW1zKClcbiAgICAgICAgICAgICAgICAgICAgaWYgayBub3QgaW4gc2VsZi5hd3NfYXV0aGVudGljYXRpb25fcGFyYW1zfVxuLi4uXG5yZXF1ZXN0X2RhdGEgPSB7XCJwcm9tcHRcIjogcHJvbXB0LCAqKmluZmVyZW5jZV9wYXJhbXN9ICAgIyBpbnRlcm5hbCBrbm9icyBsZWFrIHRocm91Z2hcbmBgYFxuXG5JbnRlcm5hbCBjb250cm9sIGZsYWdzIChlLmcuIHRoZSBNQ1AgaGFuZGxlciBrZXlzIGBza2lwX21jcF9oYW5kbGVyYCAvIGBfc2tpcF9tY3BfaGFuZGxlcmApIGFyZSBub3QgdmFsaWQgQmVkcm9jayBpbmZlcmVuY2UgcGFyYW1ldGVycywgc28gbGVha2luZyB0aGVtIGludG8gdGhlIGJvZHkgY2FuIG1ha2UgQmVkcm9jayByZWplY3QgdGhlIHJlcXVlc3QuXG5cbiMjIFdoeSB0aGlzIGlzIGEgZ2FwIGluIGFuIGV4aXN0aW5nIHBhdHRlcm5cblxuVGhlIHNpYmxpbmcgKipDb252ZXJzZSoqIHBhdGggYWxyZWFkeSBndWFyZHMgYWdhaW5zdCBleGFjdGx5IHRoaXM6XG5cbmBgYHB5dGhvblxuIyBsaXRlbGxtL2xsbXMvYmVkcm9jay9jaGF0L2NvbnZlcnNlX3RyYW5zZm9ybWF0aW9uLnB5XG5hZGRpdGlvbmFsX3JlcXVlc3RfcGFyYW1zID0gZmlsdGVyX2ludGVybmFsX3BhcmFtcyhhZGRpdGlvbmFsX3JlcXVlc3RfcGFyYW1zKVxuYGBgXG5cblRoZSBpbnZva2UgcGF0aCBuZXZlciBjYWxscyBgZmlsdGVyX2ludGVybmFsX3BhcmFtc2Ag4oCUIGl0IHJlbGllcyDigKYifQ==
```
}