https://github.com/berriai/litellm/issues/30997 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDk5NyIsImhlYWRsaW5lIjoiIzMwOTk3IGZpeChtY3ApOiBPQXV0aCBhdXRob3JpemUvcmVnaXN0ZXIgZW5kcG9pbnRzIGZhaWwgdG8gcmVzb2x2ZSBNQ1Agc2VydmVyIGJ5IHNlcnZlcl9pZCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAS0syOTE4NjAiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgQnVnIERlc2NyaXB0aW9uXG5cblRoZSBPQXV0aCBicm9rZXIgZW5kcG9pbnRzIChgL3YxL21jcC9zZXJ2ZXIvb2F1dGgve21jcF9zZXJ2ZXJfbmFtZX0vYXV0aG9yaXplYCwgYC9yZWdpc3RlcmAsIGAvdG9rZW5gLCBgL2NhbGxiYWNrYCkgdXNlIGBnZXRfbWNwX3NlcnZlcl9ieV9uYW1lKClgIHRvIHJlc29sdmUgdGhlIE1DUCBzZXJ2ZXIgZnJvbSB0aGUgVVJMIHBhdGggcGFyYW1ldGVyLiBIb3dldmVyLCB0aGUgTGl0ZUxMTSBVSSBzZW5kcyB0aGUgKipzZXJ2ZXJfaWQqKiAoU0hBLTI1NiBoYXNoKSBpbiB0aGUgcGF0aCDigJQgbm90IHRoZSBzZXJ2ZXJfbmFtZSBvciBhbGlhcyDigJQgY2F1c2luZyB0aGUgbG9va3VwIHRvIGZhaWwuXG5cblRoaXMgcmVzdWx0cyBpbjpcbmBgYGpzb25cbntcImRldGFpbFwiOiBcIk1DUCBzZXJ2ZXIgYXV0aG9yaXphdGlvbiB1cmwgaXMgbm90IHNldFwifVxuYGBgXG5cbiMjIFJvb3QgQ2F1c2VcblxuSW4gYGRpc2NvdmVyYWJsZV9lbmRwb2ludHMucHlgLCB0aGUgYGF1dGhvcml6ZSgpYCBmdW5jdGlvbiAobGluZSB+NTM1KSBhbmQgYHJlZ2lzdGVyX2NsaWVudCgpYCBmdW5jdGlvbiAobGluZSB+OTk5KSBib3RoIGNhbGw6XG5cbmBgYHB5dGhvblxubWNwX3NlcnZlciA9IGdsb2JhbF9tY3Bfc2VydmVyX21hbmFnZXIuZ2V0X21jcF9zZXJ2ZXJfYnlfbmFtZShcbiAgICBsb29rdXBfbmFtZSwgY2xpZW50X2lwPWNsaWVudF9pcFxuKVxuYGBgXG5cbmBnZXRfbWNwX3NlcnZlcl9ieV9uYW1lKClgIG1hdGNoZXMgYnkgYWxpYXMg4oaSIHNlcnZlcl9uYW1lIOKGkiBuYW1lLCBidXQgKipub3QgYnkgc2VydmVyX2lkKiouXG5cblRoZSBVSSBjb25zdHJ1Y3RzIFVSTHMgbGlrZTpcbmBgYFxuR0VUIC92MS9tY3Avc2VydmVyL29hdXRoL2ExYjJjM2Q0ZTVmNi4uLi9hdXRob3JpemVcbmBgYFxuXG5XaGVyZSBgYTFiMmMzZDRlNWY2Li4uYCBpcyB0aGUgYHNlcnZlcl9pZGAgZnJvbSBgX2dlbmVyYXRlX3N0YWJsZV9zZXJ2ZXJfaWQoKWAuIFNpbmNlIHRoaXMgaXMgYSBoYXNoLCBpdCB3b24ndCBtYXRjaCBhbnkgYWxpYXMsIHNlcnZlcl9uYW1lLCBvciBuYW1lLlxuXG5NZWFud2hpbGUsIGBnZXRfbWNwX3NlcnZlcl9ieV9pZCgpYCBleGlzdHMgYXQgbGluZSB+MzM2NSBpbiBgbWNwX3NlcnZlcl9tYW5hZ2VyLnB5YCBhbmQgY29ycmVjdGx5IG1hdGNoZXMgYnkgYHNlcnZlci5zZXJ2ZXJfaWRgLCBidXQgaXMgbmV2ZXIgY2FsbGVkIGluIHRoZSBPQXV0aCBmbOKApiJ9
```
}