https://github.com/berriai/litellm/issues/30731 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDczMSIsImhlYWRsaW5lIjoiIzMwNzMxIFtCdWddOiBsbG1fYXNfYV9qdWRnZSBndWFyZHJhaWwgZmFpbHMgb3BlbiDigJQgbWlzc2luZyBvdmVyYWxsX3Njb3JlIGRlZmF1bHRzIHRvIDEwMCAocGFzcykiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQEFVVEhFTlNPUiJdLCJleGNlcnB0IjoiIyMgU3VtbWFyeVxuXG5JbiBgbGl0ZWxsbS9wcm94eS9ndWFyZHJhaWxzL2d1YXJkcmFpbF9ob29rcy9sbG1fYXNfYV9qdWRnZS9fX2luaXRfXy5weToxODQtMTg1YCAoYGFwcGx5X2d1YXJkcmFpbGApOlxuXG5gYGBweXRob25cbm92ZXJhbGxfc2NvcmUgPSBtYXgoMC4wLCBtaW4oMTAwLjAsIGZsb2F0KGp1ZGdlX3Jlc3VsdC5nZXQoXCJvdmVyYWxsX3Njb3JlXCIsIDEwMCkpKSlcbi4uLlxucGFzc2VkID0gb3ZlcmFsbF9zY29yZSA+PSBzZWxmLm92ZXJhbGxfdGhyZXNob2xkXG5gYGBcblxuVGhlIGRlZmF1bHQgZm9yIGEgKiptaXNzaW5nKiogYG92ZXJhbGxfc2NvcmVgIGtleSBpcyBgMTAwYCDigJQgdGhlIG1heGltdW0vcGFzc2luZyBzY29yZS4gU28gd2hlbiB0aGUganVkZ2UgcmV0dXJucyBwZXItY3JpdGVyaW9uIHZlcmRpY3RzIHRoYXQgYWxsIGZhaWwgKGUuZy4gYHZlcmRpY3RzOiBbe3NhZmV0eSwgcGFzc2VkOkZhbHNlLCBzY29yZToyfSwge3BvbGljeSwgcGFzc2VkOkZhbHNlLCBzY29yZTo1fV1gKSBidXQgb21pdHMgdGhlIHRvcC1sZXZlbCBgb3ZlcmFsbF9zY29yZWAsIGBwYXNzZWRgIGV2YWx1YXRlcyBUcnVlIGFuZCwgd2l0aCBgb25fZmFpbHVyZT1cImJsb2NrXCJgLCB0aGUgYEhUVFBFeGNlcHRpb24oNDIyKWAgaXMgc2tpcHBlZCBhbmQgdGhlIGZsYWdnZWQgcmVzcG9uc2UgaXMgcmV0dXJuZWQgdG8gdGhlIGNsaWVudC4gVGhlcmUgaXMgbm8gd2FybmluZyBvbiB0aGlzIHBhdGgg4oCUIGl0IHNpbGVudGx5IHBhc3Nlcy5cblxuVGhpcyBzaXRzIGFsb25nc2lkZSB0d28gb3RoZXIgZmFpbC1vcGVuIHBhdGhzIGluIHRoZSBzYW1lIGZ1bmN0aW9uIHRoYXQgKmRvKiB3YXJuOiBhIGp1ZGdlLWNhbGwgZXhjZXB0aW9uIChgZmFpbGluZyBvcGVuYCkgYW5kIGFuIGludmFsaWQvdW5wYXJzZWFibGUgYG92ZXJhbGxfc2NvcmVgIChgZmFpbGluZyBvcGVuYCkuIFNvIHRoZSBndWFyZHJhaWwgZmFpbHMgb3BlbiBpbiB0aHJlZSBwbGFjZXM7IHRoZSBtaXNzaW5nLWtleSBjYXNlIGlzIHRoZSBxdWlldGVzdC5cblxuIyMgUmVwcm9kdWN0aW9uIChkZXRlcm1pbmlzdGljKVxuXG5gYGBcbltmYWlsaW5nX3ZlcmRpY3RzX25vX292ZXJhbGxfc2NvcmVdIGp1ZGdlIHZlcmRpY3RzOiBbc2FmZXR5IHBhc3NlZDpGYWxzZSBzY29yZToyLCBwb2xpY3kgcGFzc2VkOkZhbHNlIHNjb3JlOjVdXG5bZmFpbGluZ192ZXJkaWN0c19ub19vdmVyYWxsX3Njb3JlXSBvdmXigKYifQ==
```
}