https://github.com/berriai/litellm/issues/31118 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTExOCIsImhlYWRsaW5lIjoiIzMxMTE4IGV4dHJhX2JvZHkgY2FuIG92ZXJyaWRlIHRoZSByZXF1ZXN0IGBtb2RlbGAgYWNyb3NzIGFsbCBwcm92aWRlcnMsIGJ5cGFzc2luZyBwcm94eSBtb2RlbC1hY2Nlc3MvYnVkZ2V0IGNoZWNrcyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbWF0ZW8tYmVycmkiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgU3VtbWFyeVxuXG5UaGUgc2hhcmVkIGNvbXBsZXRpb24gcGF0aCBpbiBgQmFzZUxMTUhUVFBIYW5kbGVyYCBtZXJnZXMgY2FsbGVyLWNvbnRyb2xsZWQgYGV4dHJhX2JvZHlgIGludG8gdGhlIHJlcXVlc3QgYm9keSBhZnRlciBgdHJhbnNmb3JtX3JlcXVlc3QoKWAgcnVucywgYXQgYGxpdGVsbG0vbGxtcy9jdXN0b21faHR0cHgvbGxtX2h0dHBfaGFuZGxlci5weWA6XG5cbmBgYHB5dGhvblxuaWYgZXh0cmFfYm9keSBpcyBub3QgTm9uZTpcbiAgICBkYXRhID0geyoqZGF0YSwgKipleHRyYV9ib2R5fVxuYGBgXG5cbkJlY2F1c2UgdGhpcyBtZXJnZSBoYXBwZW5zIHdpdGggYGV4dHJhX2JvZHlgIHRha2luZyBwcmVjZWRlbmNlLCBhIGNhbGxlciBjYW4gc2V0IGBleHRyYV9ib2R5OiB7XCJtb2RlbFwiOiBcIjxzb21lLW90aGVyLW1vZGVsPlwifWAgYW5kIG92ZXJyaWRlIHRoZSBgbW9kZWxgIGZpZWxkIHRoYXQgdGhlIHByb3ZpZGVyIHRyYW5zZm9ybSBwcm9kdWNlZC4gRm9yIGFueSBPcGVuQUktY29tcGF0aWJsZSBwcm92aWRlciB0aGF0IHJlYWRzIGBtb2RlbGAgZnJvbSB0aGUgSlNPTiBib2R5IChPcGVuQUksIEF6dXJlLCBHcm9xLCBEZWVwc2VlaywgQ2xvdWRmbGFyZSdzIGAvYWkvdjFgIGVuZHBvaW50LCBhbmQgb3RoZXJzKSwgdGhlIHVwc3RyZWFtIHByb3ZpZGVyIHRoZW4gZXhlY3V0ZXMgdGhlIG1vZGVsIG5hbWVkIGluIGBleHRyYV9ib2R5YCwgbm90IHRoZSBvbmUgdGhlIHJlcXVlc3Qgd2FzIGF1dGhvcml6ZWQgYW5kIGJ1ZGdldGVkIGFnYWluc3QuXG5cblByb3h5IG1vZGVsLWFjY2VzcyBhbmQgYnVkZ2V0IGVuZm9yY2VtZW50IHJ1bnMgYXQgdGhlIGF1dGggbGF5ZXIgb24gdGhlIHRvcC1sZXZlbCBgbW9kZWxgIHBhcmFtZXRlciwgYmVmb3JlIHRoZSByZXF1ZXN0IHJlYWNoZXMgYW55IHByb3ZpZGVyIHRyYW5zZm9ybSwgYW5kIG5ldmVyIGluc3BlY3RzIGBleHRyYV9ib2R5YC4gU28gYSBrZXkgc2NvcGVkIHRvIGEgY2hlYXAgb3IgYWxsb3ctbGlzdGVkIG1vZGVsIGNvdWxkIHJ1biBhIGRpZmZlcmVudCwgbW9yZSBleHBlbnNpdmUsIG9yIG5vbi1hbGxvd2VkIG1vZGVsIHdoaWxlIGFjY291bnRpbmcgaXMgdHJhY2tlZCBhZ2FpbnN0IHRoZSBvcmlnaW5hbCBgbW9kZWxgLlxuXG4jIyBXaHkgdGhpcyBpcyBmaWxlZCBzZXBhcmF0ZWx5XG5cblRoaXMgY2FtZSB1cCBhcyBhIHJldmlldyBmaW5kaW5nIG9uICMzMTA1MyAoQ2xvdWRmbOKApiJ9
```
}