https://github.com/berriai/litellm/issues/30728 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyOCIsImhlYWRsaW5lIjoiIzMwNzI4IFtCdWddOiBQcmVzaWRpbyBQSUkgZ3VhcmRyYWlsIGZhaWxzIG9wZW4gb24gYW5hbHl6ZXIgZXJyb3IgYW5kIHNraXBzIC92MS9yZXNwb25zZXMgaW5wdXQgYW5kIHN0cmVhbWluZyBieXRlcyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAQVVUSEVOU09SIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IlRoZSBQcmVzaWRpbyBtYXNraW5nIGd1YXJkcmFpbCBwcm92aWRlcyBmYWxzZSBhc3N1cmFuY2UgaW4gc2V2ZXJhbCBwbGFjZXM6IGFuIG9wZXJhdG9yIGVuYWJsZXMgaXQgZXhwZWN0aW5nIFBJSSB0byBiZSBtYXNrZWQgYmVmb3JlIHRyYWZmaWMgbGVhdmVzIHRoZSBwcm94eSwgYnV0IHRoZSBmb2xsb3dpbmcgcGF0aHMgZm9yd2FyZCByYXcgUElJLlxuXG4oVGhlIHRvb2wtY2FsbC1hcmd1bWVudCBzbGljZSBvZiB0aGlzIHRoZW1lIGlzIGZpeGVkIGJ5IHRoZSBzZXBhcmF0ZSBQUiBbIzMwNzIzXShodHRwczovL2dpdGh1Yi5jb20vQmVycmlBSS9saXRlbGxtL3B1bGwvMzA3MjMpLilcblxuIyMgMS4gRmFpbHMgT1BFTiBvbiBhbmFseXplciBlcnJvciBpbiB0aGUgZGVmYXVsdCBtYXNrLW9ubHkgZGVwbG95bWVudCAoYHByZXNpZGlvLnB5OjMzNy0zNjZgKVxuXG5gX2ZhaWxfb25faW52YWxpZF9yZXNwb25zZWAgY29tcHV0ZXMgYHNob3VsZF9mYWlsX2Nsb3NlZCA9IGJvb2woc2VsZi5waWlfZW50aXRpZXNfY29uZmlnKSBvciBzZWxmLm91dHB1dF9wYXJzZV9waWkgb3Igc2VsZi5hcHBseV90b19vdXRwdXRgLiBJbiB0aGUgKipiYXNpYyBkb2N1bWVudGVkIG1hc2tpbmcgY29uZmlnKiogKGBndWFyZHJhaWw6IHByZXNpZGlvLCBtb2RlOiBwcmVfY2FsbGApIGFsbCB0aHJlZSBhcmUgZmFsc3ksIHNvIG9uIGFueSBhbmFseXplci1zaWRlIGZhaWx1cmUgKEhUVFAgPj0gNDAwLCBub24tSlNPTiBib2R5LCBge1wiZXJyb3JcIjogLi4ufWApIHRoZSBmdW5jdGlvbiByZXR1cm5zIGBbXWAgaW5zdGVhZCBvZiByYWlzaW5nLiBgYW5vbnltaXplX3RleHQoW10pYCB0aGVuIHJldHVybnMgdGhlICoqb3JpZ2luYWwqKiB0ZXh0LCB3aGljaCBpcyB3cml0dGVuIGJhY2sgaW50byBgZGF0YVtcIm1lc3NhZ2VzXCJdYC4gUmVzdWx0OiB3aGVuIHRoZSBQcmVzaWRpbyBhbmFseXplciBpcyBkb3duL292ZXJsb2FkZWQsIFNTTi9jcmVkaXQtY2FyZC9lbWFpbCBhcmUgZm9yd2FyZGVkIHRvIHRoZSBwcm92aWRlciAqKnVubWFza2VkKiog4oCUIHRoZSBndWFyZHJhaWwgZmFpbHMgb3BlbiBleGFjdGx5IHVuZGVyIGxvYWQuXG5cbmBgYFxucHJlc2lkaW8ucHk6MzUxIC0gUHJlc2lkaW8gYW5hbHl6ZXIgSFRUUCA1MDAgLi4uLCByZXR1cm5pbmcgZW1wdHkgbGlzdFxuQ29udGVudCBmb3J3YXJkZWQgdG8gTExNOiBQYXRpZW50IEpvaG4gU21pdGgsIFNTTiAwNzgtMDXigKYifQ==
```
}