https://github.com/berriai/litellm/issues/30765 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDc2NSIsImhlYWRsaW5lIjoiIzMwNzY1IFtCdWddOiBgL3YxL21lc3NhZ2VzYCBzdHJlYW1pbmcgZHJvcHMgZmlyc3QgdGV4dF9kZWx0YSBhZnRlciB0aGlua2luZyAtPiB0ZXh0IGJsb2NrIHRyYW5zaXRpb24iLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGppbmJhZ2kiLCJMYWJlbHM6IHByb3h5LCBsbG0gdHJhbnNsYXRpb24sIGNsYXVkZSBjb2RlIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IHRoaXMgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiB1c2luZyBMaXRlTExNIGFzIGFuIEFudGhyb3BpYy1jb21wYXRpYmxlIHByb3h5IGZvciBDbGF1ZGUgQ29kZSwgYC92MS9tZXNzYWdlc2Agc3RyZWFtaW5nIGNhbiBkcm9wIHRoZSBsZWFkaW5nIHRleHQgaW1tZWRpYXRlbHkgYWZ0ZXIgYSBgdGhpbmtpbmdgIGJsb2NrIGZpbmlzaGVzIGFuZCB0aGUgZmluYWwgYHRleHRgIGJsb2NrIGJlZ2lucy5cblxuVGhpcyBpcyBub3QganVzdCBhIENsYXVkZSBDb2RlIHJlbmRlcmluZyBpc3N1ZS4gVGhlIG1pc3NpbmcgcHJlZml4IGlzIGFscmVhZHkgdmlzaWJsZSBpbiB0aGUgcmF3IExpdGVMTE0gU1NFIHN0cmVhbS5cblxuVGVzdGVkIHBhdGhzOlxuXG4xLiBgQ2xhdWRlIENvZGUgLT4gTGl0ZUxMTSAvdjEvbWVzc2FnZXMgLT4gYW50aHJvcGljIHByb3ZpZGVyIC0+IHZMTE1gXG4yLiBgQ2xhdWRlIENvZGUgLT4gTGl0ZUxMTSAvdjEvbWVzc2FnZXMgLT4gaG9zdGVkX3ZsbG0gcHJvdmlkZXIgLT4gdkxMTWBcblxuVGhlIGlzc3VlIHJlcHJvZHVjZXMgYWNyb3NzIG11bHRpcGxlIGJhY2tlbmQgbW9kZWxzLCBzbyB0aGlzIGRvZXMgbm90IGFwcGVhciB0byBiZSBwcm92aWRlci1zcGVjaWZpYyBvciBtb2RlbC1zcGVjaWZpYy4gSXQgYXBwZWFycyB0byBiZSBpbiB0aGUgY29tbW9uIEFudGhyb3BpYyBgL3YxL21lc3NhZ2VzYCBzdHJlYW1pbmcgYWRhcHRlci9vdXRwdXQgcGF0aC5cblxuIyMjIEV4cGVjdGVkIGJlaGF2aW9yXG5cbkFmdGVyIGFuIGV4dGVuZGVkIHRoaW5raW5nIGJsb2NrLCBMaXRlTExNIHNob3VsZCBwcmVzZXJ2ZSB0aGUgZmlyc3QgZ2VuZXJhdGVkIGB0ZXh0X2RlbHRhYCB3aGVuIGl0IHN0YXJ0cyB0aGUgZmluYWwgYHRleHRgIGNvbnRlbnQgYmxvY2suXG5cbkZvciBleGFtcGxlLCBpZiB0aGUgcHJvbXB0IHJlcXVpcmVzIHRoZSBmaW5hbCBhbnN3ZXIgdG8gc3RhcnQgd2l0aDpcblxuYGBgdGV4dFxuRklOQUw6IEFCQ1xuYGBgXG5cbnRoZW4gdGhlIGZpcnN0IGBjb250ZW50X2Jsb2NrX2RlbHRhYCBmb3IgdGhlIGZpbmFsIHRleHQgYmxvY2sgc2hvdWxkIGluY2x1ZGUgdGhhdCBwcmVmaXgsIGZvciBleGFtcGxlOlxuXG5gYGB0ZXh0XG5ldmVudDogY2/igKYifQ== ``` }