https://github.com/berriai/litellm/issues/31857 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTg1NyIsImhlYWRsaW5lIjoiIzMxODU3IFJvdXRlcjogYF91bnJlZ2lzdGVyX3JvdXRlcl9zZWxlY3RvcnNgIGRyb3BzIG9sZCBzZWxlY3RvcnMgZnJvbSBjYWxsYmFja3MgYnV0IG5ldmVyIGNhbmNlbHMgdGhlaXIgYF9zeW5jX3Rhc2tgLCBsZWFraW5nIGFzeW5jaW8gdGFza3Mgb24gYHJvdXRpbmdfZ3JvdXBzYC9gcm91dGluZ19zdHJhdGVneWAgdXBkYXRlcyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAQm9vQjkwIl0sImV4Y2VycHQiOiIjIyMgV2hhdCBoYXBwZW5lZFxuXG5SZXBlYXRlZCBgUm91dGVyLnVwZGF0ZV9zZXR0aW5ncyhyb3V0aW5nX2dyb3Vwcz0uLi4pYCBjYWxscyAob3IgYW55IGByb3V0aW5nX3N0cmF0ZWd5YCBjaGFuZ2UgdGhhdCBnb2VzIHRocm91Z2ggYHJvdXRpbmdfc3RyYXRlZ3lfaW5pdGApIHJlYnVpbGQgdGhlIHJvdXRlcidzIHN0cmF0ZWd5IHNlbGVjdG9ycyB2aWEgYF9pbml0X3JvdXRpbmdfZ3JvdXBzYCAvIGByb3V0aW5nX3N0cmF0ZWd5X2luaXRgLCBib3RoIG9mIHdoaWNoIGNhbGwgYF91bnJlZ2lzdGVyX3JvdXRlcl9zZWxlY3RvcnNgIChgbGl0ZWxsbS9yb3V0ZXIucHk6OTMwYCkgdG8gZHJvcCB0aGUgb2xkIHNlbGVjdG9yIGluc3RhbmNlcyBmcm9tIGBsaXRlbGxtLmNhbGxiYWNrc2AgLyBgbGl0ZWxsbS5pbnB1dF9jYWxsYmFja2AuXG5cblRoYXQgdW5yZWdpc3RlciBzdGVwIG9ubHkgcmVtb3ZlcyB0aGUgc2VsZWN0b3IgZnJvbSB0aGUgdHdvIGNhbGxiYWNrIGxpc3RzIGJ5IGlkZW50aXR5OlxuXG5gYGBweXRob25cbmRlZiBfdW5yZWdpc3Rlcl9yb3V0ZXJfc2VsZWN0b3JzKHNlbGYsIHNlbGVjdG9yczogTGlzdFtBbnldKSAtPiBOb25lOlxuICAgIHNlbGVjdG9yX2lkcyA9IHtpZChzKSBmb3IgcyBpbiBzZWxlY3RvcnMgaWYgcyBpcyBub3QgTm9uZX1cbiAgICBpZiBub3Qgc2VsZWN0b3JfaWRzOlxuICAgICAgICByZXR1cm5cbiAgICBpZiBpc2luc3RhbmNlKGxpdGVsbG0uY2FsbGJhY2tzLCBsaXN0KTpcbiAgICAgICAgbGl0ZWxsbS5jYWxsYmFja3MgPSBbYyBmb3IgYyBpbiBsaXRlbGxtLmNhbGxiYWNrcyBpZiBpZChjKSBub3QgaW4gc2VsZWN0b3JfaWRzXVxuICAgIGlmIGlzaW5zdGFuY2UobGl0ZWxsbS5pbnB1dF9jYWxsYmFjaywgbGlzdCk6XG4gICAgICAgIGxpdGVsbG0uaW5wdXRfY2FsbGJhY2sgPSBbYyBmb3IgYyBpbiBsaXRlbGxtLmlucHV0X2NhbGxiYWNrIGlmIGlkKGMpIG5vdCBpbiBzZWxlY3Rvcl9pZHNdXG5gYGBcblxuSXQgbmV2ZXIgY2FsbHMgYGNsZWFudXAoKWAgKG9yIGAuY2FuY2VsKClgKSBvbiB0aGUgc2VsZWN0b3IuIFN0cmF0ZWdpZXMgYnVpbHQgb24gYEJhc2VSb3V0aW5nU3RyYXRlZ3lgIHdpdGggYHNob3VsZF9iYXRjaF9yZWRpc193cml0ZXM9VHJ1ZWAgKGUuZy4gYExvd2VzdFRQTUxvZ2dpbmdIYW5kbGVyX3YyYCwgYGxpdGVsbG0vcm91dGVyX3N0cmF0ZWd5L2xvd2VzdF90cG1fcnBtX3YyLnB5OjU2YCkgc+KApiJ9
```
}