https://github.com/berriai/litellm/issues/30781 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDc4MSIsImhlYWRsaW5lIjoiIzMwNzgxIFtCdWddOiBSZXVzaW5nIGEgY29kZV9pbnRlcnByZXRlciBjb250YWluZXIgb24gL3YxL3Jlc3BvbnNlcyBpc24ndCByb3V0ZWQvdHJhbnNsYXRlZCAoQXp1cmUgcmVqZWN0cyB0aGUgaWQpIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBkYXZpZC1rdWVobiIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbldoZW4gdGhlIGBjb2RlX2ludGVycHJldGVyYCB0b29sIHByb3Zpc2lvbnMgYW4gQXp1cmUgY29udGFpbmVyLCBMaXRlTExNIHJldHVybnMgYSBjb21wb3NpdGUgY29udGFpbmVyX2lkIChgY250cl9gICsgYmFzZTY0IG9mIGBsaXRlbGxtOmN1c3RvbV9sbG1fcHJvdmlkZXI6YXp1cmU7bW9kZWxfaWQ6PGlkPjtjb250YWluZXJfaWQ6Y250cl88bmF0aXZlPmAsIH4yMzcgY2hhcnMpIHRoYXQgZW5jb2RlcyB0aGUgb3duaW5nIGRlcGxveW1lbnQncyBtb2RlbF9pZC4gQnV0IHRoYXQgaWQgaXMgbm90IHJvdW5kLXRyaXBwYWJsZTogcGFzc2luZyBpdCBiYWNrIGludG8gYHRvb2xzW10uY29udGFpbmVyYCBvbiBhIGZvbGxvdy11cCAqKl8vdjEvcmVzcG9uc2VzXyoqIGNhbGwgZmFpbHMsIGJlY2F1c2UgTGl0ZUxMTSBmb3J3YXJkcyBpdCB0byBBenVyZSB2ZXJiYXRpbSBpbnN0ZWFkIG9mIHRyYW5zbGF0aW5nIGl0IGJhY2sgdG8gdGhlIG5hdGl2ZSBpZCBhbmQgdXNpbmcgaXRzIG1vZGVsX2lkIHRvIHJvdXRlLlxuXG5Ud28gY29uY3JldGUgZmFpbHVyZSBtb2RlczpcblxuMS4gUGFzc2luZyB0aGUgbG9uZy1mb3JtLCBjb21wb3NpdGUgaWQg4oaSIGA0MDAgc3RyaW5nX2Fib3ZlX21heF9sZW5ndGhgIGVycm9yLiBBenVyZSBjYXBzIGB0b29sc1tdLmNvbnRhaW5lcmAgYXQgNjQgY2hhcnMgYW5kIHJlamVjdHMgdGhlIDIzNy1jaGFyIGNvbXBvc2l0ZSBpZC4gTGl0ZUxMTSBuZXZlciByZXZlcnNlLXRyYW5zbGF0ZXMgaXQgdG8gdGhlIG5hdGl2ZSBpZCBiZWZvcmUgY2FsbGluZyB0aGUgcHJvdmlkZXIuXG4yLiBTaG9ydC1mb3JtLCBuYXRpdmUgaWQgKHRoZSB3b3JrYXJvdW5kKSDihpIgYDQwNCBDb250YWluZXIgbm90IGZvdW5kYCBlcnJvci4gSWYgdGhlIGNhbGxlciBleHRyYWN0cyB0aGUgc2hvcnQgbmF0aXZlIGlkIChgY250cl88aGV4PmApIHRvIGRvZGdlICgxKSwgaXQgY2FycmllcyBubyByb3V0aW5nIHBheWxvYWQsIHNvICoqXy92MS9yZXNwb25zZXNfKiogbG9hZC1iYWxhbmNlcyBieSBtb2RlbCBuYW1lLiBBenVyZSBjb250YWluZXJzIGFyZSByZWdpb24tbG9jYWwsIHNvIG9uIGHigKYifQ== ``` }