https://github.com/berriai/litellm/issues/30508 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDUwOCIsImhlYWRsaW5lIjoiIzMwNTA4IFtGZWF0dXJlXTogU3VwcG9ydCBDbGF1ZGUgQ29kZSB2aWEgb2ZmaWNpYWwgQ0xJIC8gQWdlbnQgU0RLIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBraXNoYW5pb3MxMjMiLCJMYWJlbHM6IGVuaGFuY2VtZW50LCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uLCBjbGF1ZGUgY29kZSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5BZGQgc3VwcG9ydCBmb3IgdXNpbmcgQ2xhdWRlIENvZGUgdGhyb3VnaCB0aGUgb2ZmaWNpYWwgQ2xhdWRlIENMSSAvIEFnZW50IFNESywgZm9yIGV4YW1wbGUgYGNsYXVkZSAtcGAsIGFzIGEgTGl0ZUxMTSBwcm92aWRlci5cblxuVGhlIGdvYWwgaXMgdG8gYWxsb3cgdXNlcnMgdG8gdXNlIHRoZWlyIGV4aXN0aW5nIG9mZmljaWFsIENsYXVkZSBDb2RlIGF1dGhlbnRpY2F0aW9uIHdpdGhvdXQgZXh0cmFjdGluZyB0b2tlbnMgb3IgcmV1c2luZyBzZXNzaW9uIGNyZWRlbnRpYWxzIG1hbnVhbGx5LlxuXG4jIyMgTW90aXZhdGlvbiwgcGl0Y2hcblxuU29tZSBjdXJyZW50IHVub2ZmaWNpYWwgYXBwcm9hY2hlcyBkZXBlbmQgb24gZXh0cmFjdGluZyBDbGF1ZGUgc3Vic2NyaXB0aW9uL3Nlc3Npb24gdG9rZW5zLiBUaGlzIGlzIHVuc2FmZSBhbmQgbWF5IHZpb2xhdGUgQW50aHJvcGljIHBvbGljaWVzIG9yIHJpc2sgYWNjb3VudCB0ZXJtaW5hdGlvbi5cblxuQSBMaXRlTExNIGludGVncmF0aW9uIHRoYXQgY2FsbHMgdGhlIG9mZmljaWFsIENsYXVkZSBDb2RlIENMSSAvIEFnZW50IFNESyB3b3VsZCBiZSBzYWZlciBhbmQgbW9yZSBjb21wbGlhbnQuXG5cbkRlc2lyZWQgYmVoYXZpb3I6XG4tIENvbmZpZ3VyZSBMaXRlTExNIHRvIHVzZSB0aGUgbG9jYWwgQ2xhdWRlIENvZGUgQ0xJIC8gQWdlbnQgU0RLXG4tIFVzZSBvZmZpY2lhbCBDbGF1ZGUgQ29kZSBhdXRoZW50aWNhdGlvblxuLSBEbyBub3QgZXh0cmFjdCwgc2NyYXBlLCBvciByZXBsYXkgdG9rZW5zXG4tIFN1cHBvcnQgYmFzaWMgY2hhdC9jb21wbGV0aW9uXG4tIFN1cHBvcnQgc3RyZWFtaW5nIGlmIHBvc3NpYmxlXG5cblRoaXMgd291bGQgaGVscCB1c2VycyBpbnRlZ3JhdGUgQ2xhdWRlIENvZGUgd2l0aCBMaXRlTExNIGluIGEgbGVnYWwgYW5kIHBvbGljeS1jb21wbGlhbnQgd2F5LlxuXG4jIyMgV2hhdCBwYXJ0IG9mIExpdGVMTE0gaXMgdGhpcyBhYm91dD9cblxuUHJveHlcblxuIyMjIExpdGVMTE0gaXMgaGlyaW5nIGEgZm91bmRpbmcgYmFja2VuZCBlbmdpbmVlciwgYXJlIHlvdSBpbnRlcmVzdGVkIGluIGpvaW5pbmcgdXMgYW5kIHNoaXBwaW5nIHRvIGHigKYifQ==
```
}