https://github.com/berriai/litellm/issues/27671 { ```slug-github-card eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yNzY3MSIsImhlYWRsaW5lIjoiIzI3NjcxIFJlc3BvbnNlcyBBUEkgc3RyZWFtaW5nIGJyaWRnZTogbXVsdGktc3RlcCBBbnRocm9waWMgdG9vbCBjYWxscyBlbWl0IHRleHQtZGVsdGEgd2l0aCB1bnJlZ2lzdGVyZWQgY2hhdGNtcGwtIElEIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBrbGx5MTQiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgRGVzY3JpcHRpb25cblxuV2hlbiB1c2luZyBMaXRlTExNJ3MgUmVzcG9uc2VzIEFQSSAoYC92MS9yZXNwb25zZXNgKSB0byBwcm94eSBBbnRocm9waWMgbW9kZWxzLCBtdWx0aS1zdGVwIHRvb2wgY2FsbCBmbG93cyBwcm9kdWNlOlxuXG5gYGBcbnRleHQgcGFydCBjaGF0Y21wbC08aWQ+IG5vdCBmb3VuZFxuYGBgXG5cblRoZSBBSSBTREsgdHJhY2tzIHRleHQgcGFydHMgdmlhIGB0ZXh0LXN0YXJ0YCDihpIgYHRleHQtZGVsdGFgIOKGkiBgdGV4dC1lbmRgIGJ5IElELiBEdXJpbmcgc3RlcCAyKyAodGV4dCBhZnRlciB0b29sIHVzZSksIHRoZSBgdGV4dC1kZWx0YWAgZXZlbnQgYXJyaXZlcyB3aXRoIGEgYGNoYXRjbXBsLWAgcmVzcG9uc2UtbGV2ZWwgSUQgdGhhdCB3YXMgbmV2ZXIgcmVnaXN0ZXJlZCB2aWEgYHRleHQtc3RhcnRgLCBjYXVzaW5nIHRoZSBBSSBTREsgdG8gZHJvcCB0aGUgdGV4dC5cblxuU2luZ2xlLXN0ZXAgdGV4dC1vbmx5IHJlc3BvbnNlcyB3b3JrIGZpbmUuIE9ubHkgbXVsdGktc3RlcCB0b29sIGNhbGwgc2VxdWVuY2VzIGJyZWFrLlxuXG4gICoqVGhlIEJ1ZyoqXG5cbiAgSW4gX3RyYW5zZm9ybV9jaGF0X2NvbXBsZXRpb25fY2h1bmtfdG9fcmVzcG9uc2VfYXBpX2NodW5rOlxuXG5gYGBcbiAgaWYgc2VsZi5fY2FjaGVkX2l0ZW1faWQgaXMgTm9uZSBhbmQgY2h1bmsuaWQ6XG4gICAgICBzZWxmLl9jYWNoZWRfaXRlbV9pZCA9IGNodW5rLmlkICAgICAgICAgICMg4oaQIHNldHMgY2FjaGUgdG8gXCJjaGF0Y21wbC1hYWFcIiBvbiBmaXJzdCBjaHVua1xuICBpdGVtX2lkID0gc2VsZi5fY2FjaGVkX2l0ZW1faWQgb3IgY2h1bmsuaWQgICAjIOKGkCB1c2VzIGNhY2hlZCB2YWx1ZSBmb3IgYWxsIGV2ZW50c1xuXG5gYGBcbiAgU3RlcCAxICh0b29sIGNhbGwpOiBGaXJzdCBjaHVuayBhcnJpdmVzLCBfY2FjaGVkX2l0ZW1faWQgaXMgTm9uZSwgc28gaXQgY2FjaGVzIGNodW5rLmlkID0gXCJjaGF0Y21wbC1hYWFcIi4gVGhlIF9lbnN1cmVfb3V0cHV0X2l0ZW1fZm9yX2NodW5rIG1ldGhvZCB0aGVuIG92ZXJ3cml0ZXMgaXQgdG8gXCJtc2dfe3V1aWR9XCIgZm9yIHRoZSBvdXRwdXQgaXRlbS4gVGV4dCBldmVudHMgdXNlIFwibXNnX3t1dWlkfVwiIOKAlCBjb25zaXN0ZW50LiDinIVcblxuICBTdGVwIDIgKHRleHQgYWZ0ZXIgdG9vbCByZXN1bHQpOiBMaXRlTExNIGludGVybmFsbHkgbWFrZXMgYSBuZXcgQ2hhdCBDb21wbGV0aW9uIGNhbGwsIHdoaWNoIHJldHVybnMgY2jigKYifQ== ``` }