https://github.com/berriai/litellm/issues/35068 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zNTA2OCIsImhlYWRsaW5lIjoiIzM1MDY4IFtCdWddOiBGYWlsZWQgcHJveHkgcmVxdWVzdHMgY2FuIGxvc2UgY2FsbF90eXBlIGFuZCByb3V0ZXIgbWV0YWRhdGEgaW4gc3BlbmQgbG9ncyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAc2lsZW5jZWRvY3RvciIsIkxhYmVsczogcHJveHkiXSwiZXhjZXJwdCI6IiMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIFdoYXQgaGFwcGVuZWQ/XG5cbldoZW4gYSBwcm94aWVkIExMTSByZXF1ZXN0IGZhaWxzLCB0aGUgZmFpbHVyZSBzcGVuZCBsb2cgY2FuIGJlIGNyZWF0ZWQgZnJvbSBhIHJlcXVlc3QgcGF5bG9hZCB0aGF0IGRvZXMgbm90IHByZXNlcnZlIHRoZSByb3V0ZSdzIGFjdHVhbCBjYWxsIHR5cGUgYW5kIGRvZXMgbm90IG1lcmdlIExpdGVMTE0ncyBpbnRlcm5hbCBtZXRhZGF0YSBidWNrZXQgaW50byB0aGUgc3BlbmQtdHJhY2tpbmcgbWV0YWRhdGEuXG5cbk9ic2VydmVkIGltcGFjdDpcblxuLSBBIGZhaWxlZCBSZXNwb25zZXMgQVBJIHJlcXVlc3QgY2FuIGJlIGxvZ2dlZCB3aXRoIGEgc3RhbGUvZGVmYXVsdCBjYWxsX3R5cGUgc3VjaCBhcyBhY29tcGxldGlvbiBpbnN0ZWFkIG9mIGFyZXNwb25zZXMuXG4tIFJvdXRlciBtZXRhZGF0YSBzdG9yZWQgaW4gbGl0ZWxsbV9tZXRhZGF0YSwgc3VjaCBhcyBtb2RlbF9ncm91cCBhbmQgbW9kZWxfaW5mby5pZCwgY2FuIGJlIG1pc3NpbmcgZnJvbSB0aGUgZmluYWwgU3BlbmRMb2dzUGF5bG9hZCBmb3IgdGhlIGZhaWxlZCByZXF1ZXN0LlxuLSBSZXRyeSBtZXRhZGF0YSBhbmQgcmVxdWVzdCB0YWdzIGNhbiBiZSBzcGxpdCBhY3Jvc3MgbWV0YWRhdGEvbGl0ZWxsbV9tZXRhZGF0YSBidWNrZXRzIGFuZCBmYWlsIHRvIHJlYWNoIHRoZSBmYWlsdXJlIHNwZW5kIGxvZy5cblxuRXhwZWN0ZWQgYmVoYXZpb3I6XG5cbi0gRmFpbGVkIHJlcXVlc3RzIHNob3VsZCBiZSBhdHRyaWJ1dGVkIHRvIHRoZSBhY3R1YWwgcHJveHkgcm91dGUgY2FsbF90eXBlLlxuLSBGYWlsdXJlIHNwZW5kIGxvZ3Mgc2hvdWxkIHByZXNlcnZlIGludGVybmFsIHJvdXRlciBtZXRhZGF0YSBuZWVkZWQgZm9yIG1vZGVsLWdyb3VwIGFuZCBkZXBsb3ltZW50LWxldmVsIGF0dHJpYnV0aW9uLlxuLSBDYWxsZXItc3VwcGxpZWQgdXNlcl9hcGlfa2V5KiBtZXRhZGF0YSBzaG91bGQgbm90IGJlIHRydXN0ZWQgZm9yIHNwZW5kLWxvZyBpZGVudGl0eSBhdHRyaWJ1dGlvbi5cblxuIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbjEuIFVzZSBhIHByb3h5IHJvdXRlIHRoYXQgc3RvcmVzIGludGVybmFsIG1ldGFkYXRhIGluIGxpdGVsbG1fbWXigKYifQ== ``` }