https://github.com/berriai/litellm/issues/31378 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTM3OCIsImhlYWRsaW5lIjoiIzMxMzc4IFtCdWddOiBDdXN0b20gdHJhY2VfaWQgbm90IHRha2luZyBlZmZlY3QgaW4gTGFuZ2Z1c2Ugd2hlbiB1c2luZyBMaXRlTExNIHdyYXBwZWQgT3BlbkFJIGludGVyZmFjZSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbnVvY2hlbmciLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG4jIyBEZXNjcmliZSB0aGUgYnVnXG5cbldoZW4gY2FsbGluZyB0aGUgTExNIGludGVyZmFjZSB3cmFwcGVkIGJ5IExpdGVMTE0gYW5kIHBhc3NpbmcgYSBjdXN0b20gYHRyYWNlX2lkYCB2aWEgYGV4dHJhX2JvZHkubWV0YWRhdGFgLCB0aGUgY3VzdG9tIHRyYWNlIElEIGZhaWxzIHRvIHRha2UgZWZmZWN0IGluIExhbmdmdXNlXFwuIExhbmdmdXNlIHN0aWxsIGdlbmVyYXRlcyBhIGRlZmF1bHQgcmFuZG9tIHRyYWNlIElEIGluc3RlYWQgb2YgdXNpbmcgdGhlIG1hbnVhbGx5IHNwZWNpZmllZCBjdXN0b20gYHRyYWNlX2lkYFxcLlxuXG5JIGZvbGxvd2VkIHRoZSBvZmZpY2lhbCBMaXRlTExNIGFkdmFuY2VkIGNvbmZpZ3VyYXRpb24gZG9jdW1lbnRhdGlvbiB0byBzZXQgdGhlIGB0cmFjZV9pZGAgcGFyYW1ldGVyIGluIG1ldGFkYXRhLCBidXQgdGhlIGNvbmZpZ3VyYXRpb24gZG9lcyBub3Qgd29yayBhcyBleHBlY3RlZFxcLlxuXG5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBDb25maWd1cmUgTGFuZ2Z1c2UgY2FsbGJhY2sgZm9yIExpdGVMTE0gYW5kIGNvbXBsZXRlIGVudmlyb25tZW50IHZhcmlhYmxlIGluaXRpYWxpemF0aW9uXG5cbjIuIFVzZSB0aGUgT3BlbkFJIGNsaWVudCB0byByZXF1ZXN0IHRoZSBMaXRlTExNIHByb3h5IGludGVyZmFjZVxuXG4zLiBQYXNzIGN1c3RvbSBgdHJhY2VfaWRgIGFuZGBnZW5lcmF0aW9uX25hbWVgIHZpYSBgZXh0cmFfYm9keS5tZXRhZGF0YWBcblxuNC4gQ2hlY2sgdHJhY2UgcmVjb3JkcyBpbiBMYW5nZnVzZSBPU1MsIHRoZSBjdXN0b20gdHJhY2UgSUQgaXMgbm90IGFwcGxpZWRcblxuXG4hW10oaHR0cHM6Ly9wcml2YXRlLXVzZXItaW1hZ2VzLmdpdGh1YnVzZXJjb250ZW50LmNvbS8zMTYxMjc0My82MTMwNTI0OTYtZTM3MGNkYmItZGYyNi00Zjg1LTgzMTktMTI3ZmJkYzhjNmY0LnBuZz9qd3Q9ZXlKMGVYQWlPaUpLVjFRaUxDSmhiR2NpT2lKSVV6STFOaUo5LmV5SnBjM01pT2lKbmFYUm9kV0l1WTI5dElpd2lZWFZrSWpvaWNtRjNMbWRwZEdoMVluVnpaWEpqYjI1MFpXNTBMbU52YlNJc0ltdGxlU0k2SW10bGVUVWlMQ0psZUhBaU9qRTNPREkwTXpVeOKApiJ9
```
}