https://github.com/berriai/litellm/issues/31910 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTkxMCIsImhlYWRsaW5lIjoiIzMxOTEwIFtCdWddOiBNQ1AgYXV0by1leGVjdXRlICsgc3RyZWFtOnRydWUgbGVha3MgaW50ZXJtZWRpYXRlIHRvb2wtY2FsbCB0dXJuIChmaW5pc2hfcmVhc29uOlwidG9vbF9jYWxsc1wiKSBpbnRvIGNsaWVudCBzdHJlYW0g4oCUIGNoYXQgVUlzIHJlbmRlciBlbXB0eSBtZXNzYWdlcyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAZ3JhaGFtdG9uIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiB0aGUgcHJveHkgYXV0by1leGVjdXRlcyBNQ1AgdG9vbHMgKGByZXF1aXJlX2FwcHJvdmFsOiBcIm5ldmVyXCJgLCBlLmcuIHRvb2xzIGF0dGFjaGVkIHRvIGEgbW9kZWwvYWdlbnQgZGVmaW5pdGlvbikgd2l0aCBgc3RyZWFtOiB0cnVlYCwgdGhlIGNsaWVudCByZWNlaXZlcyB0aGUgKippbnRlcm1lZGlhdGUgdG9vbC1jYWxsIHR1cm4qKiBpbiB0aGUgU1NFIHN0cmVhbSBiZWZvcmUgdGhlIGZpbmFsIGFuc3dlcjpcblxuMS4gUGhhc2UgMTogY2h1bmtzIG9mIHRoZSBtb2RlbCdzIGZpcnN0IHR1cm4g4oCUIGluY2x1ZGluZyBgZGVsdGEudG9vbF9jYWxsc2AgYW5kIGEgY2h1bmsgd2l0aCBgZmluaXNoX3JlYXNvbjogXCJ0b29sX2NhbGxzXCJgIOKAlCBhcmUgeWllbGRlZCBzdHJhaWdodCB0byB0aGUgY2xpZW50LlxuMi4gVGhlIHByb3h5IHRoZW4gZXhlY3V0ZXMgdGhlIE1DUCB0b29scyBzZXJ2ZXItc2lkZS5cbjMuIFBoYXNlIDI6IHRoZSBmb2xsb3ctdXAgbW9kZWwgdHVybiAodGhlIGFjdHVhbCBhbnN3ZXIpIHN0cmVhbXMgYWZ0ZXJ3YXJkLCBlbmRpbmcgd2l0aCBgZmluaXNoX3JlYXNvbjogXCJzdG9wXCJgLlxuXG5UaGUgY2xpZW50IGVmZmVjdGl2ZWx5IHJlY2VpdmVzICoqdHdvIGNvbXBsZXRlIGFzc2lzdGFudCBtZXNzYWdlcyBpbiBvbmUgc3RyZWFtKiosIHdpdGggYSBgZmluaXNoX3JlYXNvbmAgaW4gdGhlIG1pZGRsZS4gU3RhbmRhcmQgT3BlbkFJLWNvbXBhdGlibGUgY2xpZW50cyB0cmVhdCB0aGUgZmlyc3QgYGZpbmlzaF9yZWFzb25gIGFzIGVuZC1vZi1tZXNzYWdlLiBPcGVuIFdlYlVJLCBmb3IgZXhhbXBsZSwgc2VlcyBgZmluaXNoX3JlYXNvbjogXCJ0b29sX2NhbGxzXCJgIHJlZmVyZW5jaW5nIGEgdG9vbCBjYWxsIGl0IG5ldmVyIHNlbnQsIGVuZHMgdGhlIGFzc2lzdGFudCBtZXNzYWdlIHRoZXJlLCBhbmQgZGlzY2FyZHMgdGhlIFBoYXNlIDIgY29udGVudCDigJQgdGhlIHVzZXIgc2VlcyBhICoqY29tcGxldGVseSBlbXB0eSByZXBseSoqIGV2ZW4gdGhvdWdoIHRoZSBwcm94eSBkaWQgYWxsIHRoZSB3b3JrIGFuZCBwcm9kdWNlZCBhIGNvcnJlY3QgYW5zd2VyLlxuXG5Ob27igKYifQ==
```
}