https://github.com/berriai/litellm/issues/31055 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA1NSIsImhlYWRsaW5lIjoiIzMxMDU1IFtCdWddOiBSZXNwb25zZXMgQVBJIHJlc3BfIGlkcyAoZW5jcnlwdGVkIGNvbnRlbnQgYWZmaW5pdHkpIGFyZSBvYmplY3Qtc3RvcmFnZS11bnNhZmUgYW5kIGJyZWFrIExhbmdGdXNlL1MzIHRyYWNlIGxvZ2dpbmciLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG1jb25ubGV5IiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBXaGF0IGhhcHBlbmVkXG5cbldoZW4gYSBjbGllbnQgY2FsbHMgdGhlIHByb3h5J3MgYC92MS9yZXNwb25zZXNgIGZvciBhIG5vbi1PcGVuQUkgYmFja2VuZCAoc28gTGl0ZUxMTVxuYnJpZGdlcyBSZXNwb25zZXPihpJDaGF0KSwgdGhlIHJldHVybmVkIGByZXNwb25zZS5pZGAgaXMgYW4gZW5jcnlwdGVkIGJhc2U2NCBibG9iIG9mIHRoZVxuZm9ybSBgcmVzcF88YmFzZTY0dXJsPj1gICh0aGUgXCJlbmNyeXB0ZWQgY29udGVudCBhZmZpbml0eVwiIGlkIGVuY29kaW5nIGBtb2RlbF9pZGAgZXRjLikuXG5cbkxpdGVMTE0ncyBgbGFuZ2Z1c2VgIHN1Y2Nlc3MtY2FsbGJhY2sgdGhlbiBsb2dzIHRoaXMgaWQgYXMgdGhlIG9ic2VydmF0aW9uL2dlbmVyYXRpb25cbmlkLiBMYW5nRnVzZSB2MyB1c2VzIHRoZSBvYnNlcnZhdGlvbiBpZCAqKnZlcmJhdGltIGFzIHRoZSBTMy9NaW5JTyBvYmplY3Qga2V5KipcbihgPHByb2plY3RJZD4vb2JzZXJ2YXRpb24vPGlkPi88dXVpZD4uanNvbmApLiBUaGUgYmFzZTY0IHBhZGRpbmcvY2hhcnNldCBpcyByZWplY3RlZCBieVxuTWluSU86XG5cbmBgYFxuWE1pbmlvSW52YWxpZE9iamVjdE5hbWU6IE9iamVjdCBuYW1lIGNvbnRhaW5zIHVuc3VwcG9ydGVkIGNoYXJhY3RlcnNcbmBgYFxuXG5UaGUgYmxvYiB1cGxvYWQgYWJvcnRzIGF0IExhbmdGdXNlJ3MgaW5nZXN0aW9uICh3ZWIpIHN0YWdlLCBub3RoaW5nIGlzIGVucXVldWVkLCBhbmQgdGhlXG50cmFjZSBzaWxlbnRseSBuZXZlciBhcHBlYXJzLiBUaGUgTGl0ZUxMTSBjYWxsYmFjayBpdHNlbGYgcmV0dXJucyAyMDAsIHNvIGl0IGxvb2tzIGxpa2VcbnRyYWNpbmcgaXMganVzdCBicm9rZW4gd2l0aCBubyBlcnJvciBzdXJmYWNlZCB0byB0aGUgY2FsbGVyLlxuXG4jIyMgV2h5IHRoaXMgbWF0dGVyc1xuXG5gcmVzcF/igKY9YCBpcyB0ZWNobmljYWxseSBhIHZhbGlkIE9wZW5BSSBpZCwgYnV0IHVzaW5nIGJhc2U2NCAqKnBhZGRpbmcgKGA9YCkqKiAoYW5kXG5iYXNlNjR1cmwgY2hhcnNldCkgaW4gYW4gaWQgdGhhdCBkb3duc3RyZWFtIGxvZ2dpbmcgaW50ZWdyYXRpb25zIHJvdXRlIGludG9cbm9iamVjdC1zdG9yYWdlIGtleXMgaXMgdW5zYWZlLiBBV1MgUzMgdG9sZXJhdGVzIGA9YDsgTWluSU8gKGEgZmlyc3QtY2xhc3MsIHZlcnkgY29tbW9uXG5zZWxmLWhvc3RlZCBTMyB0YXJnZXQpIGRvZXMgbm90LiBBbnkgTGl0ZUxMTSB1c2VyIHBhaXJpbmcgdGhlIFJlc3BvbnNlc+KApiJ9
```
}