https://github.com/berriai/litellm/issues/31075 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA3NSIsImhlYWRsaW5lIjoiIzMxMDc1IEFkZCB6YWkvZ2xtLTUuMiBwcmljaW5nIGVudHJ5IOKAlCBHTE0tNS4yIG1pc3NpbmcgZnJvbSBtb2RlbCBjb3N0IG1hcCwgY2F1c2luZyBkb3duc3RyZWFtIG1pc2F0dHJpYnV0aW9uIHRvIEdMTS01Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBtYWppYXl1MDAwIl0sImV4Y2VycHQiOiIjIyBCYWNrZ3JvdW5kIC8g6IOM5pmvXG5cblpoaXB1IEFJICjmmbrosLEpIHJlbGVhc2VkICoqR0xNLTUuMioqIGFzIGl0cyBuZXcgZmxhZ3NoaXAgbW9kZWwgb24gKioyMDI2LTA2LTEzKiosIGFsb25nc2lkZSB0aGUgYHphaWAgKFouQUkgaW50ZXJuYXRpb25hbCkgYW5kIEJpZ01vZGVsICjlm73lhoXlvIDmlL7lubPlj7ApIG9mZmVyaW5ncy4gT2ZmaWNpYWwgcHJpY2luZyBoYXMgYmVlbiBwdWJsaXNoZWQsIGJ1dCBMaXRlTExNJ3MgYG1vZGVsX3ByaWNlc19hbmRfY29udGV4dF93aW5kb3cuanNvbmAgY3VycmVudGx5IGhhcyAqKm5vIGB6YWkvZ2xtLTUuMmAgZW50cnkqKi4gVGhlIG5lYXJlc3QgZXhpc3RpbmcgZW50cnkgaXMgYHphaS9nbG0tNWAsIHdoaWNoIGNhcnJpZXMgdGhlIG9sZGVyIG1vZGVsJ3MgcHJpY2luZy5cblxu5pm66LCxIDIwMjYtMDYtMTMg5Y+R5biD5LqG5paw5LiA5Luj5peX6Iiw5qih5Z6LICoqR0xNLTUuMioq77yM5a6Y5pa55bey5YWs5biD5a6M5pW05a6a5Lu344CC5L2GIExpdGVMTE0g55qEIGBtb2RlbF9wcmljZXNfYW5kX2NvbnRleHRfd2luZG93Lmpzb25gIOebruWJjSoq57y65bCRIGB6YWkvZ2xtLTUuMmAg5p2h55uuKirvvIzlj6rmnInml6fniYjmnKznmoQgYHphaS9nbG0tNWDjgIJcblxuIyMgUHJvYmxlbSAvIOmXrumimFxuXG5CZWNhdXNlIGB6YWkvZ2xtLTUuMmAgaXMgYWJzZW50LCBkb3duc3RyZWFtIHRvb2xzIHRoYXQgcmVzb2x2ZSBtb2RlbCBjb3N0cyBmcm9tIExpdGVMTE0ncyBjb3N0IG1hcCAoZS5nLiB0b2tlbi11c2FnZSBhbmFseXRpY3MgbGlrZSBgY2NzdGF0c2AsIGJpbGxpbmcgcHJveGllcywgZGFzaGJvYXJkcykgKipmYWxsIGJhY2sgdG8gb3IgbWlzLW1hdGNoIGFnYWluc3QgYHphaS9nbG0tNWAqKi4gVGhpcyBwcm9kdWNlcyAqKmluY29ycmVjdCBjb3N0IGNhbGN1bGF0aW9ucyoqOiBHTE0tNS4yJ3MgaW5wdXQgKCQxLjQvTSkgaXMgaGlnaGVyIHRoYW4gR0xNLTUncyAoJDEuMC9NKSBhbmQgb3V0cHV0ICgkNC40L00pIGlzIGhpZ2hlciB0aGFuIEdMTS01J3MgKCQzLjIvTSksIHNvIHJlcG9ydHMgc3lzdGVtYXRpY2FsbHkgdW5kZXItY291bnQgc3BlbmRpbmcgZm9yIEdMTS01LjIgdHJhZmZpYy5cblxu55Sx5LqO57y65bCRIGB6YWkvZ2xtLTUuMmDvvIzkvp3otZYgTGl0ZUxMTSDmiJDmnKzooajnmoTkuIvmuLjlt6XlhbfvvIjlpoIgYGNjc3RhdHNgIOi/meexuyB0b2tlbiDnlKjph4/nu5/orqHjgIHorqHotLnku6PnkIbjgIHnm5HmjqfpnaLmnb/vvInkvJoqKuWbnumAgOaIluivr+WMuemFjeWIsCBgemFpL2dsbS01YCoq77yM5a+86Ie0KirmiJDmnKzorqHnrpfplJnor68qKu+8mkdMTS01LjIg55qE6L6T5YWl77yIJDEuNC9N77yJ5LiO6L6T5Ye677yIJDQuNC9N77yJ5Z2H6auY5LqOIEdMTS0177yI6L6T5YWlICQxLjAvTeOAgei+k+WHuiAkMy4yL03vvInvvIzlm6DmraQgR0xNLTUuMiDnmoTlrp7pmYXoirHotLnkvJrooqvns7vnu5/mgKfkvY7kvLDjgILigKYifQ==
```
}