https://github.com/berriai/litellm/issues/30520 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDUyMCIsImhlYWRsaW5lIjoiIzMwNTIwIGNvbXBsZXRpb24oKSB0ZW1wZXJhdHVyZSBkZWZhdWx0IGlzIGluY29uc2lzdGVudCBiZXR3ZWVuIFB5dGhvbiBkb2NzdHJpbmcgYW5kIGRvY3VtZW50YXRpb24iLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG53b2VicyJdLCJleGNlcnB0IjoiIyMgRGVzY3JpcHRpb25cblxuVGhlIFtkb2N1bWVudGF0aW9uXShodHRwczovL2RvY3MubGl0ZWxsbS5haS9kb2NzL2NvbXBsZXRpb24vaW5wdXQpIGFuZCBQeXRob24gZG9jc3RyaW5nIGZvciB0aGUgYHRlbXBlcmF0dXJlYCBwYXJhbWV0ZXIgb2YgYGxpdGVsbG0uY29tcGVsdGlvbigpYCBhcHBlYXIgdG8gZGVzY3JpYmUgZGlmZmVyZW50IGRlZmF1bHRzLlxuXG5UaGUgb25saW5lIGRvY3VtZW50YXRpb24gc3RhdGVzOlxuPiBgdGVtcGVyYXR1cmVgOiBfbnVtYmVyIG9yIG51bGwgKG9wdGlvbmFsKV8gLSBUaGUgc2FtcGxpbmcgdGVtcGVyYXR1cmUgdG8gYmUgdXNlZCwgYmV0d2VlbiAwIGFuZCAyLiBIaWdoZXIgdmFsdWVzIGxpa2UgMC44IHByb2R1Y2UgbW9yZSByYW5kb20gb3V0cHV0cywgd2hpbGUgbG93ZXIgdmFsdWVzIGxpa2UgMC4yIG1ha2Ugb3V0cHV0cyBtb3JlIGZvY3VzZWQgYW5kIGRldGVybWluaXN0aWMuXG5cbkhvd2V2ZXIsIHRoZSBQeXRob24gZG9jc3RyaW5nIGRpc3BsYXllZCBieSBteSBJREUgc3RhdGVzOlxuPiAgdGVtcGVyYXR1cmUgKGZsb2F0LCBvcHRpb25hbCkgOiBUaGUgdGVtcGVyYXR1cmUgcGFyYW1ldGVyIGZvciBjb250cm9sbGluZyB0aGUgcmFuZG9tbmVzcyBvZiB0aGUgb3V0cHV0IChkZWZhdWx0IGlzIDEuMCkuXG5cbldoaWxlIHRoZSBmdW5jdGlvbiBzaWduYXR1cmUgdXNlczpcbmBgYHB5dGhvblxuZGVmIGNvbXBsZXRpb24oXG4gICAgLi4uXG4gICAgdGVtcGVyYXR1cmU6IGZsb2F0IHwgTm9uZSA9IE5vbmUsXG4gICAgLi4uXG4pXG5gYGBcblxuIyMjIElzc3VlXG5UaGlzIG1ha2VzIGl0IHVuY2xlYXIgd2hldGhlcjpcbmEpIGBOb25lYCBjYXVzZXMgTGl0ZUxMTSB0byBkZWZhdWx0IHRoZSB0ZW1wZXJhdHVyZSB0byBgMS4wYCwgb3JcbmIpIGBOb25lYCBjYXVzZXMgTGl0ZUxMTSB0byBvbWl0IHRoZSB0ZW1wZXJhdHVyZSBwYXJhbWV0ZXIgYW5kIGxldCB0aGUgdXBzdHJlYW0gcHJvdmlkZXIgYXBwbHkgaXRzIG93biBkZWZhdWx0XG5cbiMjIFJlcXVlc3RcbjEuIENsYXJpZnkgaG93IGEgdGVtcGVyYXR1cmUgdmFsdWUgb2YgYE5vbmVgIGlzIHJlc29sdmVkIGJ5IExpdGVMTE1cbjIuIE1ha2UgdGhlIGRvY3VtZW50YXRpb24gYW5kIFB5dGhvbiBkb2NzdHJpbmcgY29uc2lzdGVudCJ9 ``` }