https://github.com/berriai/litellm/issues/30724 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyNCIsImhlYWRsaW5lIjoiIzMwNzI0IFtCdWddOiBCZWRyb2NrIHBhc3MtdGhyb3VnaCBlbmRwb2ludCBkb2VzIG5vdCBsb2cgcmVxdWVzdCBgbWVzc2FnZXNgIHBheWxvYWQiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGFhc2hpc2hyYmhhbmRhcmkiLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5HcmVldGluZ3MgTGl0ZUxMTSBUZWFtLFxuXG4jIyBbUXVpY2sgU3VtbWFyeV1cblxuV2hlbiBpIHVzZSBCZWRyb2NrIFBhc3N0aHJvdWdoIEVuZHBvaW50IChMaW5rOiBodHRwczovL2RvY3MubGl0ZWxsbS5haS9kb2NzL3Bhc3NfdGhyb3VnaC9iZWRyb2NrIzEtdXNpbmctY29uZmlneWFtbC1yZWNvbW1lbmRlZC1mb3ItbW9kZWwtZW5kcG9pbnRzKVxuSSBoYXZlIGNvbmZpZ3VyZWQgYHMzYCBhbmQgYEN1c3RvbSBDYWxsYmFjayBBUElgIGFuZCBvbiBib3RoIGkgZG8gbm90IGhhdmUgdGhlIGFjdHVhbCBgbWVzc2FnZWAgcGF5bG9hZCBzaG93aW5nIChzeXN0ZW0sIHRvb2xzIGFuZCB1c2VyKSByYXRoZXIgaW4gdGhlIFMzIG9iamVjdCBpIHNlZSB0aGUgZGF0YSBhcyBcbmBgYFxuXCJtZXNzYWdlc1wiOiBbXG4gICAgICAgIHtcbiAgICAgICAgICAgIFwicm9sZVwiOiBcInVzZXJcIixcbiAgICAgICAgICAgIFwiY29udGVudFwiOiBcImRlZmF1bHQtbWVzc2FnZS12YWx1ZVwiXG4gICAgICAgIH1cbiAgICBdLFxuYGBgXG5hbmQgb24gdGhlIEFQSSBlbmRwb2ludC5cblxuXG5cbiMjIE15IExpdGVMTE0gU2V0dXBcblxuXG4jIyMgLmVudlxuXG5gYGBiYXNoXG4jPT09PT09PT1bRG9ja2VyICYgRG9ja2VyIENvbXBvc2VdPT09PT09PVxuQ09NUE9TRV9QUk9KRUNUX05BTUU9bGl0ZWxsbS1zdGFja1xuU1RBQ0tfUFJFRklYPWxpdGVsbG0tc3RhY2tcblxuXG4jID09PT09W0xpdGVMTE1dPT09PT09PT09PT09XG5cbiMgTGl0ZUxMTSBDb250YWluZXIgJiBWb2x1bWUgTmFtZXNcbkxJVEVMTE1fQVBQX0NPTlRBSU5FUl9OQU1FPWxpdGVsbG0tYXBwXG5MSVRFTExNX0RCX0NPTlRBSU5FUl9OQU1FPWxpdGVsbG0tZGJcbkxJVEVMTE1fUE9TVEdSRVNfVk9MVU1FX05BTUU9bGl0ZWxsbV9wb3N0Z3Jlc19kYXRhXG5cbiMgUG9zdGdyZXMgc3VwZXJ1c2VyIChib290c3RyYXAgYWRtaW4g4oCUIGRvIG5vdCB1c2UgaW4gYXBwIGNvbm5lY3Rpb24gc3RyaW5ncylcblBPU1RHUkVTX0FETUlOX1VTRVI9cG9zdGdyZXNfYWRtaW5fdXNlclxuUE9TVEdSRVNfQURNSU5fUEFTU1dPUkQ9cDBvc3RyZXNBQGRtaW4xMjNcblxuIyBMaXRlTExNIGFwcCB1c2VyIChsZWFzdC1wcml2aWxlZ+KApiJ9
```
}