https://github.com/berriai/litellm/issues/30472 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDQ3MiIsImhlYWRsaW5lIjoiIzMwNDcyIFVwc3RyZWFtIE1DUCBzZXJ2ZXIgVVJMIGV4cG9zZWQgaW4gcHVibGljIG1vZGVsIGh1YiBtb2RhbCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAUnl0aXNTdHJlaW1pa2lzIl0sImV4Y2VycHQiOiJTdW1tYXJ5XG5cblRoZSBNQ1Agc2VydmVyIGRldGFpbCBtb2RhbCBpbiB0aGUgcHVibGljIG1vZGVsIGh1YiBkaXNwbGF5cyB0aGUgdXBzdHJlYW0gVVJMIHRoYXQgTGl0ZUxMTSBwcm94aWVzIHRvIChmb3IgZXhhbXBsZTogaHR0cHM6Ly9tY3AudmVuZG9yLmNvbS92MS92ZW5kb3IvbWNwKS4gVGhpcyByZXZlYWxzIGludGVybmFsIGluZnJhc3RydWN0dXJlIGRldGFpbHMgdG8gZW5kIHVzZXJzLlxuXG5XaGF0IGlzIGN1cnJlbnRseSBleHBvc2VkIHRvIGVuZCB1c2Vyc1xuXG4tIFVwc3RyZWFtIHZlbmRvciBVUkwgKHJldmVhbHMgd2hpY2ggdGhpcmQtcGFydHkgc2VydmljZSBpcyBiZWluZyB1c2VkKVxuLSBEaXJlY3QgdXBzdHJlYW0gZW5kcG9pbnQgKGFsbG93cyBieXBhc3NpbmcgdGhlIExpdGVMTE0gcHJveHkgZW50aXJlbHkgaWYgYSB0b2tlbiBpcyBvYnRhaW5lZClcblxuV2h5IHRoaXMgaXMgYSBwcm9ibGVtXG5cbkV4cG9zaW5nIHVwc3RyZWFtIGVuZHBvaW50cyBhbmQgYXV0aCB0eXBlcyBsZWFrcyBzZW5zaXRpdmUgaW5mcmFzdHJ1Y3R1cmUgaW5mb3JtYXRpb24gdGhhdCBzaG91bGQgYmUgcmVzdHJpY3RlZCB0byBhZG1pbmlzdHJhdG9ycy4gQW4gYXR0YWNrZXIgZ2FpbmluZyBhIHRva2VuIGNvdWxkIHVzZSB0aGUgZGlyZWN0IHVwc3RyZWFtIGVuZHBvaW50IHRvIGJ5cGFzcyB0aGUgcHJveHkgYW5kIHJlYWNoIHRoZSB2ZW5kb3IgQVBJIGRpcmVjdGx5LlxuXG5FeHBlY3RlZCBiZWhhdmlvclxuXG5UaGUgcHVibGljIG1vZGVsIGh1YiBtb2RhbCBzaG91bGQgb25seSBzdXJmYWNlIHRoZSBMaXRlTExNLWZhY2luZyBwcm94eSBlbmRwb2ludCAoZm9yIGV4YW1wbGU6IGh0dHBzOi8veW91ci1saXRlbGxtLWhvc3QvPGFsaWFzPi9tY3ApLiBVcHN0cmVhbSBVUkxzIGFuZCBvdGhlciBiYWNrZW5kIGNvbmZpZ3VyYXRpb24gc2hvdWxkIGJlIHZpc2libGUgb25seSBpbiB0aGUgYWRtaW4gcGFuZWwuXG5cblJlcHJvZHVjdGlvbiBzdGVwc1xuXG4xLiBPcGVuIHRoZSBQdWJsaWMgTW9kZWwgSHViIFVJIChNb2RlbCBIdWIgLT4gTUNQIEh1YiB0YWIpLlxuMi4gQ2xpY2sgYW4gTUNQIHNlcnZlciBlbnRyeSB0byBvcGVuIHRoZSBNQ1AgU2VydmVyIERldGFpbHMgbW9kYWwuXG4zLiBPYnNlcnZlIHRoZSBcIlVSTFwiIC8gXCJVc2FnZSBFeGFtcGxlXCIgc2VjdGlvbnMgd2hpY2ggaW5jbHVkZSB0aGUgdXBzdHJlYW0gdmVuZG9yIFVSTCBhbmQgYXV0aCB0eXBl4oCmIn0= ``` }