https://github.com/berriai/litellm/issues/30730 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDczMCIsImhlYWRsaW5lIjoiIzMwNzMwIFtCdWddOiBMYWtlcmEgdjIgZ3VhcmRyYWlsIOKAlCBmbGFnZ2VkPVRydWUgd2l0aCBlbXB0eSBwYXlsb2FkIHRha2VzIG1hc2stYW5kLWFsbG93IGJyYW5jaCBidXQgbWFza3Mgbm90aGluZyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAQVVUSEVOU09SIl0sImV4Y2VycHQiOiIjIyBTdW1tYXJ5XG5cbkluIGBsaXRlbGxtL3Byb3h5L2d1YXJkcmFpbHMvZ3VhcmRyYWlsX2hvb2tzL2xha2VyYV9haV92Mi5weWAsIHRoZSBBTExPVy12cy1CTE9DSyBkZWNpc2lvbiBhbmQgdGhlIG1hc2tpbmcgdXNlICoqZGlmZmVyZW50IGZpZWxkcyoqIG9mIHRoZSBMYWtlcmEgcmVzcG9uc2U6XG5cbi0gdGhlIGRlY2lzaW9uIChgX2lzX29ubHlfcGlpX3Zpb2xhdGlvbmAsIGA6NDUwLTQ3M2ApIGluc3BlY3RzIGBicmVha2Rvd25gICh0cnVlIGlmZiBldmVyeSBkZXRlY3RlZCBpdGVtIGlzIGBwaWkvKmApIC0+IGlmIFBJSS1vbmx5LCB0YWtlIHRoZSAqKm1hc2stYW5kLWFsbG93KiogYnJhbmNoIGluc3RlYWQgb2YgYmxvY2tpbmc7XG4tIHRoZSBtYXNraW5nIChgX21hc2tfcGlpX2luX21lc3NhZ2VzYCwgYDoxNDMtMjAwYCkgaXMgZHJpdmVuIGJ5IHRoZSBzZXBhcmF0ZSBgcGF5bG9hZGAgZmllbGQgKHRoZSBsaXN0IG9mIGB7c3RhcnQsIGVuZCwgZGV0ZWN0b3JfdHlwZSwgLi4ufWAgc3BhbnMpLCBhbmQgKiplYXJseS1yZXR1cm5zIG9uIGFuIGVtcHR5IHBheWxvYWQqKiAoYDoxNTRgKS5cblxuU28gd2hlbiBMYWtlcmEgcmV0dXJucyBgZmxhZ2dlZD1UcnVlYCB3aXRoIGBicmVha2Rvd249W3tkZXRlY3Rvcl90eXBlOlwicGlpL2VtYWlsXCIsIGRldGVjdGVkOlRydWV9XWAgYnV0IGBwYXlsb2FkPVtdYCDigJQgdGhlICoqZXhhY3QgZW1wdHktcGF5bG9hZCBzaGFwZSB1c2VkIGluIGxpdGVsbG0ncyBvd24gdGVzdCBmaXh0dXJlcyoqIChgdGVzdF9sYWtlcmFfdjIucHk6MTA3YCwgYDoyNzJgKSDigJQgYF9pc19vbmx5X3BpaV92aW9sYXRpb25gIHJldHVybnMgVHJ1ZSAobWFzay1hbmQtYWxsb3cpLCBgX21hc2tfcGlpX2luX21lc3NhZ2VzYCBtYXNrcyBub3RoaW5nLCBhbmQgdGhlIHJlcXVlc3QgaXMgZm9yd2FyZGVkLiBUaGUgaG9vayBuZXZlciB2ZXJpZmllcyB0aGF0IG1hc2tpbmcgYWN0dWFsbHkgaGFwcGVuZWQgYmVmb3JlIGFsbG93aW5nLlxuXG4jIyBSZXByb2R1Y3Rpb24gKGRldGVybWluaXN0aWMpXG5cbmBgYFxuPT09IExha2VyYSB2ZXJkaWN0OiBmbGFnZ2VkPVRydWUsIGJyZWFrZG93bj1waWkvZW1haWwgZGV0ZWN0ZWQsIHBheWxvYWQ9W10gPT09XG5GT1JXQVJERUQgVE8gTExNOiAnTXkgZW1haWwgdGVzdEBleGFtcGxlLmNvbSBoZXJlJ1xucmVxdWVzdCBhbGxvd2VkOiAgVHJ1ZVxuUElJIG1hc2tlZDogICAgICAgRmFsc2VcblBJ4oCmIn0=
```
}