https://github.com/berriai/litellm/issues/31643 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTY0MyIsImhlYWRsaW5lIjoiIzMxNjQzIGZlYXQobWNwKTogc3VwcG9ydCB3aWxkY2FyZC9wcmVmaXggbWF0Y2hpbmcgaW4gZXh0cmFfaGVhZGVycyBmb3IgTUNQIHNlcnZlcnMiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQEtLMjkxODYwIl0sImV4Y2VycHQiOiIjIyBQcm9ibGVtXG5cbmBleHRyYV9oZWFkZXJzYCBvbiBNQ1Agc2VydmVyIGNvbmZpZyBvbmx5IHN1cHBvcnRzIGV4YWN0IGhlYWRlciBuYW1lIG1hdGNoaW5nLiBXaGVuIGRvd25zdHJlYW0gTUNQIHNlcnZpY2VzIGV4cGVjdCBhIGZhbWlseSBvZiBoZWFkZXJzIHdpdGggYSBjb21tb24gcHJlZml4IChlLmcuLCBgeC1mZi0qYCBmb3IgZmVhdHVyZSBmbGFncywgYHgtY3VzdG9tLSpgIGZvciB0ZW5hbnQgY29udGV4dCksIGFkbWlucyBtdXN0IGxpc3QgZXZlcnkgaGVhZGVyIGluZGl2aWR1YWxseSBhbmQgdXBkYXRlIHRoZSBjb25maWcgZWFjaCB0aW1lIGEgbmV3IGhlYWRlciBpcyBhZGRlZC5cblxuYGBgeWFtbFxuIyBDdXJyZW50OiBtdXN0IGxpc3QgZXZlcnkgaGVhZGVyIGV4cGxpY2l0bHlcbm1jcF9zZXJ2ZXJzOlxuICBteV9zZXJ2aWNlOlxuICAgIGV4dHJhX2hlYWRlcnM6XG4gICAgLSB4LWZmLWFzay1hZHZpc29yXG4gICAgLSB4LWZmLWVuYWJsZS1zdHJlYW1pbmdcbiAgICAtIHgtZmYtZmVhdHVyZS1hYmNcbiAgICAjIC4uLiBuZXcgaGVhZGVycyByZXF1aXJlIGNvbmZpZyBjaGFuZ2UgKyBwb2QgcmVzdGFydFxuYGBgXG5cbiMjIFByb3Bvc2VkIFNvbHV0aW9uXG5cblN1cHBvcnQgcHJlZml4L3dpbGRjYXJkIHBhdHRlcm5zIGluIGBleHRyYV9oZWFkZXJzYDpcblxuYGBgeWFtbFxubWNwX3NlcnZlcnM6XG4gIG15X3NlcnZpY2U6XG4gICAgZXh0cmFfaGVhZGVyczpcbiAgICAtIFwieC1mZi0qXCIgICAgICAgICAgICAgICMgZm9yd2FyZCBhbGwgaGVhZGVycyBzdGFydGluZyB3aXRoIHgtZmYtXG4gICAgLSBYLUF0bGFzc2lhbi1BdXRob3JpemF0aW9uICAjIGV4YWN0IG1hdGNoIHN0aWxsIHdvcmtzXG5gYGBcblxuIyMjIEltcGxlbWVudGF0aW9uIHN1Z2dlc3Rpb25cblxuSW4gYHNlcnZlci5weWAgd2hlcmUgYGV4dHJhX2hlYWRlcnNgIGFyZSBhcHBsaWVkICh+bGluZSAxMTQwKSwgdGhlIGN1cnJlbnQgbG9vcCBkb2VzIGV4YWN0IG1hdGNoaW5nOlxuXG5gYGBweXRob25cbmZvciBoZWFkZXIgaW4gc2VydmVyLmV4dHJhX2hlYWRlcnM6XG4gICAgaGVhZGVyX3ZhbHVlID0gbm9ybWFsaXplZF9yYXdfaGVhZGVycy5nZXQoaGVhZGVyLmxvd2VyKCkpXG4gICAgaWYgaGVhZGVyX3ZhbHVlIGlzIE5vbmU6XG4gICAgICAgIGNvbnRpbnVlXG4gICAgZXh0cmFfaGVhZGVyc1toZWFkZXJdID0gaGVhZGVyX3ZhbHVlXG5gYGBcblxuVGhpcyBjb3VsZCBiZSBleHRlbmRlZCB0byBjaGVja+KApiJ9
```
}