https://github.com/berriai/litellm/issues/31336 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTMzNiIsImhlYWRsaW5lIjoiIzMxMzM2IFtGZWF0dXJlXTogQWRkIG9wdGlvbiB0byBzZXQgcHJpb3JpdHlDbGFzc05hbWUgdG8gZGVwbG95bWVudHMgZnJvbSBoZWxtIGNoYXJ0Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBtZWh1bHAtc3ludGF4IiwiTGFiZWxzOiBlbmhhbmNlbWVudCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5DdXJyZW50bHkgdGhlIGxpdGVsbG0gaGVsbSBjaGFydCAoYC9kZXBsb3kvY2hhcnRzL2xpdGVsbG0taGVsbWApIGRvZXMgbm90IHByb3ZpZGUgYSB3YXkgdG8gc2V0IGBwcmlvcml0eUNsYXNzTmFtZWAgdG8gZGVwbG95bWVudCBtYW5pZmVzdHMuIFxuXG5UaGUgaW1wbGVtZW50YXRpb24gZm9yIHRoaXMgd291bGQgYmUgYXMgc2ltcGxlIGFzIGFkZGluZyB0byB0aGUgZGVwbG95bWVudCB0ZW1wbGF0ZTpcblxuYGBgXG5zcGVjOlxuICB0ZW1wbGF0ZTpcbiAgICBzcGVjOlxuICAgICAge3stIHdpdGggLlZhbHVlcy5wcmlvcml0eUNsYXNzTmFtZSB9fVxuICAgICAgcHJpb3JpdHlDbGFzc05hbWU6IHt7IC4gfX1cbiAgICAgIHt7LSBlbmQgfX1cbmBgYFxuXG5hbmQgaW4gdGhlIHZhbHVlcy55YW1sOlxuYGBgXG5wcmlvcml0eUNsYXNzTmFtZTogXCJcIlxuYGBgXG5cblRoZSBlcXVpdmFsZW50IGNhbiBhbHNvIGJlIGRvbmUgaW4gdGhlIG90aGVyIGhlbG0gY2hhcnQgKGAvaGVsbS9saXRlbGxtYClcblxuIyMjIE1vdGl2YXRpb24sIHBpdGNoXG5cblRoaXMgaXMgdXNlZnVsIGluIHByb3RlY3RpbmcgbGl0ZWxsbSBmcm9tIHJlc291cmNlIHByZXNzdXJlIGV2aWN0aW9ucyB3aGljaCBjYW4gYmUgY29tbW9uIGluIEt1YmVybmV0ZXMgZW52aXJvbm1lbnRzLiAgV2hpbGUgdGhlc2UgdmFsdWVzIGNhbiBiZSBhZGRlZCBhZnRlciB0aGUgaW5pdGlhbCBkZXBsb3ltZW50LCBpdCBydW5zIHRoZSByaXNrIG9mIGJlaW5nIHJlY29uY2lsZWQgd2hlbiB1c2luZyBDRCB0b29scyB0aGF0IHN5bmMgYWdhaW5zdCB0aGUgY2hhcnQgKGxpa2UgdmlhIEFyZ29DRClcblxuIyMjIFdoYXQgcGFydCBvZiBMaXRlTExNIGlzIHRoaXMgYWJvdXQ/XG5cbk90aGVyXG5cbiMjIyBMaXRlTExNIGlzIGhpcmluZyBhIGZvdW5kaW5nIGJhY2tlbmQgZW5naW5lZXIsIGFyZSB5b3UgaW50ZXJlc3RlZCBpbiBqb2luaW5nIHVzIGFuZCBzaGlwcGluZyB0byBhbGwgb3VyIHVzZXJzP1xuXG5Ob1xuXG4jIyMgVHdpdHRlciAvIExpbmtlZEluIGRldGFpbHNcblxuX05vIHJlc3BvbnNlXyJ9
```
}