https://github.com/berriai/litellm/issues/31475 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTQ3NSIsImhlYWRsaW5lIjoiIzMxNDc1IFtCdWddOiBiZWRyb2NrLW1hbnRsZSBTaWdWNCBhdXRoIHVzZXMgd3Jvbmcgc2lnbmluZyBzZXJ2aWNlIG5hbWUgKFwiYmVkcm9ja1wiIGluc3RlYWQgb2YgXCJiZWRyb2NrLW1hbnRsZVwiKSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbGFpd2VpaHdhIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuQWxsIGBiZWRyb2NrLW1hbnRsZWAgY29kZSBwYXRocyAoYGJlZHJvY2tfbWFudGxlL2Agc3RhbmRhbG9uZSBwcm92aWRlciBhbmQgYGJlZHJvY2svbWFudGxlL2Agcm91dGUpIHNpZ24gU2lnVjQgcmVxdWVzdHMgd2l0aCBgc2VydmljZV9uYW1lPVwiYmVkcm9ja1wiYCwgYnV0IHRoZSBgYmVkcm9jay1tYW50bGVgIGVuZHBvaW50IGlzIGEgc2VwYXJhdGUgQVdTIHNlcnZpY2UgdGhhdCByZXF1aXJlcyBgc2VydmljZV9uYW1lPVwiYmVkcm9jay1tYW50bGVcImAgaW4gdGhlIFNpZ1Y0IGNyZWRlbnRpYWwgc2NvcGUuXG5cbkV2aWRlbmNlOlxuLSBUaGUgQVdTLW1hbmFnZWQgSUFNIHBvbGljeSBbYEFtYXpvbkJlZHJvY2tNYW50bGVJbmZlcmVuY2VBY2Nlc3NgXShodHRwczovL2NvbnNvbGUuYXdzLmFtYXpvbi5jb20vaWFtL2hvbWUjL3BvbGljaWVzL2Fybjphd3M6aWFtOjphd3M6cG9saWN5L0FtYXpvbkJlZHJvY2tNYW50bGVJbmZlcmVuY2VBY2Nlc3MpIHVzZXMgYGJlZHJvY2stbWFudGxlOipgIGFjdGlvbnMgKG5vdCBgYmVkcm9jazoqYClcbi0gQ2xvdWRUcmFpbCBzaG93cyB0aGUgZXZlbnQgc291cmNlIGFzIGBiZWRyb2NrLW1hbnRsZS5hbWF6b25hd3MuY29tYCAobm90IGBiZWRyb2NrLmFtYXpvbmF3cy5jb21gKVxuLSBUaGUgW2BBbWF6b25CZWRyb2NrTWFudGxlRnVsbEFjY2Vzc2BdKGh0dHBzOi8vY29uc29sZS5hd3MuYW1hem9uLmNvbS9pYW0vaG9tZSMvcG9saWNpZXMvYXJuOmF3czppYW06OmF3czpwb2xpY3kvQW1hem9uQmVkcm9ja01hbnRsZUZ1bGxBY2Nlc3MpIG1hbmFnZWQgcG9saWN5IHVzZXMgYGJlZHJvY2stbWFudGxlOipgXG5cblRoaXMgbWVhbnMgd2hlbiBMaXRlTExNIHNpZ25zIHdpdGggYHNlcnZpY2VfbmFtZT1cImJlZHJvY2tcImAsIEFXUyBJQU0gZXZhbHVhdGVzIHRoZSByZXF1ZXN0IGFnYWluc3QgdGhlIGBiZWRyb2NrYCBzZXJ2aWNlIG5hbWVzcGFjZSwgZmluZHMgbm8gbWF0Y2hpbmcgYWxsb3csIGFuZCByZWplY3RzIHdpdGggYSBwZXJtaXNzaW9uIGVycm9yIGV2ZW4gd2hlbiBgYmVkcm9jay1tYW50bGU6Q3JlYXRlSW5mZXJlbmNlYCBpcyBncmFudGVkLlxu4oCmIn0=
```
}