https://github.com/berriai/litellm/issues/20975 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMDk3NSIsImhlYWRsaW5lIjoiIzIwOTc1IFtCdWddOiBMaXRlTExNIFByb3h5IC0gUmVzcG9uc2VzIEFQSSBzdHJlYW1pbmcgb21pdHMgbmVjZXNzYXJ5IFNTRSBldmVudCB0eXBlcyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAamFja2Nvb25leTQ0IiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBzdHJlYW1pbmcgQXp1cmUgUmVzcG9uc2VzIEFQSSByZXF1ZXN0cyB0aHJvdWdoIHRoZSBMaXRlTExNIHByb3h5LCBpdCBzZW5kcyBgcmVzcG9uc2Uub3V0cHV0X3RleHQuZGVsdGFgIGV2ZW50cyBidXQgKipvbWl0cyB0aGUgcmVxdWlyZWQgc2V0dXAgZXZlbnRzKiogKGByZXNwb25zZS5jcmVhdGVkYCwgYHJlc3BvbnNlLmluX3Byb2dyZXNzYCwgYHJlc3BvbnNlLm91dHB1dF9pdGVtLmFkZGVkYCwgYHJlc3BvbnNlLmNvbnRlbnRfcGFydC5hZGRlZGApLCBjYXVzaW5nIGNsaWVudHMgdG8gcmVqZWN0IHRoZSBkZWx0YXMuXG5cbkVuZHBvaW50czpcbmAvb3BlbmFpL3YxL3Jlc3BvbnNlc2BcbmAvdjEvcmVzcG9uc2VzYFxuYC9yZXNwb25zZXNgXG5cblRoaXMgd2FzIGRpc2NvdmVyZWQgd2hlbiB1c2luZyBhbiBBenVyZSBtb2RlbCB2aWEgdGhlIExpdGUgTExNIFByb3h5IHdpdGggQ29kZXguIEVycm9yOiBgY29kZXhfY29yZTo6dXRpbDogT3V0cHV0VGV4dERlbHRhIHdpdGhvdXQgYWN0aXZlIGl0ZW1gXG5cbioqRXhwZWN0ZWQgU1NFIHNlcXVlbmNlIChzb3VyY2VkIGZyb20gQXp1cmUgT3BlbkFJIHJlc3BvbnNlIGRpcmVjdGx5KToqKlxuYGBgXG57XCJ0eXBlXCI6XCJyZXNwb25zZS5jcmVhdGVkXCIsLi4ufSAgICAgXG57XCJ0eXBlXCI6XCJyZXNwb25zZS5pbl9wcm9ncmVzc1wiLC4uLn0gICAgIFxue1widHlwZVwiOlwicmVzcG9uc2Uub3V0cHV0X2l0ZW0uYWRkZWRcIiwuLi59ICAgICBcbntcInR5cGVcIjpcInJlc3BvbnNlLmNvbnRlbnRfcGFydC5hZGRlZFwiLC4uLn0gICBcbntcInR5cGVcIjpcInJlc3BvbnNlLm91dHB1dF90ZXh0LmRlbHRhXCIsXCJkZWx0YVwiOlwiSGVsbG9cIiwuLi59XG57XCJ0eXBlXCI6XCJyZXNwb25zZS5vdXRwdXRfdGV4dC5kZWx0YVwiLFwiZGVsdGFcIjpcIiB0aGVyZVwiLC4uLn1cbntcInR5cGVcIjpcInJlc3BvbnNlLm91dHB1dF90ZXh0LmRvbmVcIiwuLi59ICAgICAgICBcbntcInR5cGVcIjpcInJlc3BvbnNlLmNvbnRlbnRfcGFydC5kb25lXCIsLi4ufSAgICAgIFxue1widHlwZVwiOlwicmVzcG9uc2Uub3V0cHV0X2l0ZW0uZG9uZVwiLC4uLn0gICAgXG57XCJ0eXBlXCI6XCJyZXNwb25zZS5jb21wbGV0ZWRcIiwuLi59XG5gYGBcbioqQWPigKYifQ==
```
}

https://github.com/berriai/litellm/issues/21023 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTAyMyIsImhlYWRsaW5lIjoiIzIxMDIzIFtCdWddOiBJbmNvbnNpc3RlbnQgc3BlbmQgbG9nZ2luZyBmb3IgY3VzdG9tIG1vZGVsIHByaWNpbmcgKGNsYXVkZS1vcHVzLTQuNikgY2F1c2VzIGJ1ZGdldCBjb250cm9sIGZhaWx1cmUiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHM5MDY5MDM5MTIiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuSSBhbSBzZXR0aW5nIGNsYXVkZS1vcHVzLTQuNiBvbiB0aGUgMS44MS42IHZlcnNpb24uIFNpbmNlIHRoaXMgbW9kZWwgaXMgbm90IGluIHRoZSBkZWZhdWx0IGxpc3QsIEkgbWFudWFsbHkgY29uZmlndXJlZCBhIGN1c3RvbSBwcmljZSBmb3IgaXQuXG5cbkhvd2V2ZXIsIEkgbm90aWNlZCB0aGF0IHRoZSBcIlNwZW5kXCIgZmllbGQgaW4gdGhlIGxvZ3MgaXMgaW5jb25zaXN0ZW50OlxuXG5Tb21ldGltZXMgdGhlIGNvc3QgaXMgcmVjb3JkZWQgYW5kIGRpc3BsYXllZCBjb3JyZWN0bHkuXG5cbk90aGVyIHRpbWVzLCB0aGUgbG9ncyBzaG93IG5vIHNwZW5kIChvciAwKSBmb3IgdGhlIHJlcXVlc3RzLlxuXG5DcnVjaWFsbHksIHRoaXMgbWFrZXMgS2V5LWxldmVsIGJ1ZGdldCBjb250cm9sIGluZWZmZWN0aXZlLiBCZWNhdXNlIHRoZSBzeXN0ZW0gZmFpbHMgdG8gdHJhY2sgdGhlIGNvc3QgYWNjdXJhdGVseSwgdGhlIGJ1ZGdldCBsaW1pdHMgSSBzZXQgZm9yIHNwZWNpZmljIGtleXMgYXJlIG5vdCBiZWluZyB0cmlnZ2VyZWQsIGFsbG93aW5nIHVzYWdlIHRvIGV4Y2VlZCB0aGUgaW50ZW5kZWQgbGltaXRzLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbioqQ29uZmlndXJhdGlvbjoqKlxuLSBBZGQgYSBjdXN0b20gbW9kZWwgbmFtZWQgY2xhdWRlLW9wdXMtNC42IGluIHRoZSBzZXR0aW5ncy5cbi0gU2V0IGEgY3VzdG9tIHByaWNlIGZvciBpdCAoZS5nLiwgSW5wdXQ6ICQ1LzFNLCBPdXRwdXQ6ICQyNS8xTSkgdG8gZW5zdXJlIHRoZSBzeXN0ZW0gc2hvdWxkIGJlIGNhbGN1bGF0aW5nIGNvc3RzLlxuXG4qKkJ1ZGdldCBTZXR1cDoqKlxuLSBDcmVhdGUgYSBuZXcgQVBJIEtleS5cbi0gU2V0IGEgdmVyeSBzbWFsbCBCdWRnZXQgTGltaXQgZm9yIHRoaXMga2V5IHNvIGl0IHNob3VsZCBiZSBleGhhdXN0ZWQgcXVpY2tseS5cblxuR28gdG8gdGhlIExvZ3MgcGFnZS5cblxuTm90aWNlIHRoYXQgd2hpbGUgc29tZSByZXF1ZXN0cyBzaG93IHRoZSBjb3JyZWN0IGNvc3QsIG90aGVycyBzaG93ICQwIHNwZW5kIGRlc3BpdGUgaGF2aW5nIHRva2VuIHVzYWdlLlxuXG48aW1nIHdpZHRoPVwiMjM0NlwiIGhlaWdodD1cIjM34oCmIn0=
```
}

https://github.com/berriai/litellm/issues/21026 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTAyNiIsImhlYWRsaW5lIjoiIzIxMDI2IFtCdWddOiAgRnJlcXVlbnQgZXJyb3JzIG9jY3VycmluZyB3aGVuIGNhbGxpbmcgdGhlIFRlYW0gTGlzdCAvIFVzZXIgTGlzdCBBUEkgZW5kcG9pbnQiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHM5MDY5MDM5MTIiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBJIHVzZSB0aGUgQVBJIHRvIGFjY2VzcyB0aGUgVGVhbSBMaXN0IGVuZHBvaW50LCBJIGZyZXF1ZW50bHkgZW5jb3VudGVyIGFuIGVycm9yLlxuXG5JdCBkb2Vzbid0IGhhcHBlbiAxMDAlIG9mIHRoZSB0aW1lLCBidXQgdGhlIGZhaWx1cmUgcmF0ZSBpcyBzaWduaWZpY2FudC4gVGhlIHNwZWNpZmljIGVycm9yIG1lc3NhZ2UgcmV0dXJuZWQgaXMgYXMgZm9sbG93czpcblxuYGBgXG5BbGVydCB0eXBlOiBgZGJfZXhjZXB0aW9uc2BcbkxldmVsOiBgSGlnaGBcblRpbWVzdGFtcDogYDExOjQ3OjQ1YFxuXG5NZXNzYWdlOiBEQiByZWFkL3dyaXRlIGNhbGwgZmFpbGVkOiBBbGwgY29ubmVjdGlvbiBhdHRlbXB0cyBmYWlsZWRMaXRlTExNIFByaXNtYSBDbGllbnQgRXhjZXB0aW9uIGRpc2Nvbm5lY3QoKTogQWxsIGNvbm5lY3Rpb24gYXR0ZW1wdHMgZmFpbGVkXG5UcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6XG4gIEZpbGUgXCIvdXNyL2xpYi9weXRob24zLjEzL3NpdGUtcGFja2FnZXMvaHR0cHgvX3RyYW5zcG9ydHMvZGVmYXVsdC5weVwiLCBsaW5lIDEwMSwgaW4gbWFwX2h0dHBjb3JlX2V4Y2VwdGlvbnNcbiAgICB5aWVsZFxuICBGaWxlIFwiL3Vzci9saWIvcHl0aG9uMy4xMy9zaXRlLXBhY2thZ2VzL2h0dHB4L190cmFuc3BvcnRzL2RlZmF1bHQucHlcIiwgbGluZSAzOTQsIGluIGhhbmRsZV9hc3luY19yZXF1ZXN0XG4gICAgcmVzcCA9IGF3YWl0IHNlbGYuX3Bvb2wuaGFuZGxlX2FzeW5jX3JlcXVlc3QocmVxKVxuICAgICAgICAgICBeXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5eXl5cbiAgRmlsZSBcIi91c3IvbGliL3B5dGhvbjMuMTMvc2l0ZS1wYWNrYWdlcy9odHRwY29yZS9fYXN5bmMvY29ubmVjdGlvbl9wb29sLnB5XCIsIGxpbmUgMjU2LCBpbiBoYW5kbGVfYXN5bmNfcmVxdWVzdFxuICAgIHJhaXNlIGV4YyBmcm9tIE5vbmVcbiAgRmlsZSBcIi91c3IvbGliL3B5dGhvbjMuMTMvc2l0ZS1wYWNrYWdlcy9odHRwY29yZS9fYXN5bmMvY29ubmVjdGlvbl9wb29sLnB5XCIsIGxpbmUgMjM2LCBpbiBoYW5kbGVfYXN5bmNfcmVxdWVzdFxuICAgIHJlc3BvbnNlID0gYeKApiJ9
```
}

https://github.com/berriai/litellm/issues/21036 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTAzNiIsImhlYWRsaW5lIjoiIzIxMDM2IFtCdWddOiAgVmVydGV4IEFJOiBEbyBub3QgZW5mb3JjZSBjcmVkZW50aWFscyB3aGVuIHVzaW5nIGdsb2JhbCBhcGkgZW5kcG9pbnQvdmVydGV4IGV4cHJlc3MgdG9rZW4iLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGRlbXBvOTMiLCJMYWJlbHM6IGJ1ZywgbGxtIHRyYW5zbGF0aW9uLCBTREsiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuU2ltaWxhcmx5IHRvICMxOTEzOCwgc2VlbXMgdGhhdCBsaXRlbGxtIGZvcmNlcyB2ZXJ0ZXggc2VydmljZSBhY2NvdW50IGNyZWRlbnRpYWxzIGZvciBlbmRwb2ludHMgdGhhdCBvbmx5IHJlcXVpcmUgYSB0b2tlbi5cblxuVGhlIHNpdHVhdGlvbiBpcyBhcyBmb2xsb3dzOlxuLSBSZWdpb25hbCBlbmRwb2ludHMgKHN1Y2ggYXMgYHVzLWNlbnRyYWwxLWFpcGxhdGZvcm0uZ29vZ2xlYXBpcy5jb21gKSByZXF1aXJlIHNlcnZpY2UgYWNjb3VudCBhdXRoZW50aWNhdGlvbiBhbmQgdG9rZW5cbi0gR2xvYmFsIChleHByZXNzKSBlbmRwb2ludHMgKHN1Y2ggYXMgYGFpcGxhdGZvcm0uZ29vZ2xlYXBpcy5jb21gKSBkbyBub3QgcmVxdWlyZSBhdXRoZW50aWNhdGlvbiwgaW4gcGFydGljdWxhcjpcbiAgLSBWZXJ0ZXggQUkgXCJzdGFuZGFyZFwiIHVzZXJzIGNhbiB1c2UgdGhlIGdsb2JhbCBlbmRwb2ludCB3aXRob3V0IGF1dGhlbnRpY2F0aW5nIHdpdGggdGhlaXIgc2VydmljZSBhY2NvdW50XG4gIC0gVmVydGV4IEV4cHJlc3MgdXNlcnMgZG8gbm90IGV2ZW4gaGF2ZSBhIHNlcnZpY2UgYWNjb3VudCBhdCBhbGwgYm91bmQgdG8gdGhlaXIgdG9rZW5zXG4gXG5cbiMjIyBTdGVwcyB0byBSZXByb2R1Y2VcblxuMS4gTWFrZSBzdXJlIHlvdSBhcmUgdW5hdXRoZW50aWNhdGVkIG9uIFZlcnRleCBBSSwgYW5kIHlvdSBoYXZlIGFuIEFQSSBrZXlcbjIuIENoZWNrIHRoYXQgdGhlIGdsb2JhbCBlbmRwb2ludCBpcyB3b3JraW5nIHVuYXV0aGVudGljYXRlZFxuYGBgXG5jdXJsIC1YIFBPU1QgXCJodHRwczovL2FpcGxhdGZvcm0uZ29vZ2xlYXBpcy5jb20vdjEvcHVibGlzaGVycy9nb29nbGUvbW9kZWxzL2dlbWluaS0zLWZsYXNoLXByZXZpZXc6Z2VuZXJhdGVDb250ZW50P2tleT08bXlfa2V5PlwiIFxcXG4tSCBcIkNvbnRlbnQtVHlwZTogYXBwbGljYXRpb24vanNvblwiIFxcXG4tZCAne1xuICBcImNvbnRlbnRzXCI6IFtcbiAgICB7XG4gICAgICBcInJvbGVcIjogXCJ1c2VyXCIsXG4gICAgICBcInBhcnRzXCI6IFtcbiAgICAgICAge1xuICAgICAgICAgIFwidGV4dFwiOiBcIldoeSBpcyB0aGUgc2t5IGJsdWU/XCJcbiAgICAgICAgfVxuICAgICAgXVxuICAgIOKApiJ9
```
}

https://github.com/berriai/litellm/issues/21102 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTEwMiIsImhlYWRsaW5lIjoiIzIxMTAyIFtCdWddOiBtb2RlbHMgb24gYW4gYWNjZXNzX2dyb3VwIG5vdCBzaG93biBvbiBVSSBmb3IgdXNlcnMgb24gYSB0ZWFtIHdpdGggYWNjZXNzIHRvIGl0Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBhbmRyZXNDOTgiLCJMYWJlbHM6IGJ1ZywgdWktZGFzaGJvYXJkIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbkluIGEgc2V0dXAgd2hlcmUsIGluIHRoZSBtb2RlbCBsaXN0LCBjZXJ0YWluIG1vZGVscyBhcmUgb24gYW4gYGFjY2Vzc19ncm91cGAgLCB3aGVuIGEgdGVhbSBoYXMgc2NvcGUgdG8gYWNjZXNzIHN1Y2ggbW9kZWwgZ3JvdXAsIHRoZSBtb2RlbCBsaXN0IFVJIGRvZXMgbm90IHNob3cgdGhlbSBhcyBhdmFpbGFibGUgbW9kZWxzIGV2ZW4gdGhvdWdoIHRoZXkgYXJlIGFjY2Vzc2libGUgcHJvZ3JhbW1hdGljYWxseS5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG5Db25maWd1cmF0aW9uOlxuXG5gYGBcbnByb3h5X2NvbmZpZzpcbiAgICBtb2RlbF9saXN0OlxuICAgIC0gbW9kZWxfbmFtZTogZ2VtbWEzLTRiXG4gICAgICBsaXRlbGxtX3BhcmFtczpcbiAgICAgICAgLi4uXG4gICAgICBtb2RlbF9pbmZvOlxuICAgICAgICAuLi5cbiAgICAgICAgYWNjZXNzX2dyb3VwczogW1wib24tcHJlbVwiXVxuICAgICAgICAuLi5cbiAgICAtIG1vZGVsX25hbWU6IHF3ZW4zLWVtYmVkZGluZy04YlxuICAgICAgbGl0ZWxsbV9wYXJhbXM6XG4gICAgICAgIC4uLlxuICAgICAgbW9kZWxfaW5mbzpcbiAgICAgICAgLi4uXG4gICAgICAgIGFjY2Vzc19ncm91cHM6IFtcIm9uLXByZW1cIl1cbiAgICAgICAgLi4uXG5gYGBcblxuXG5UaGVuIGEgdGVhbSB3aXRoIGFjY2VzcyB0byBzdWNoIG1vZGVsIGdyb3VwOlxuXG48aW1nIHdpZHRoPVwiMTI5NVwiIGhlaWdodD1cIjM1NlwiIGFsdD1cIkltYWdlXCIgc3JjPVwiaHR0cHM6Ly9naXRodWIuY29tL3VzZXItYXR0YWNobWVudHMvYXNzZXRzLzdlZDVkZmVhLWZhYTYtNDc0Yy05ZjUwLTJmNmEwYjE0ZDM2Y1wiIC8+XG5cbndoZW4gYSB1c2VyIG9uIHRoYXQgdGVhbSBjaGVja3MgdGhlIE1vZGVscytFbmRwb2ludHMgdWksIGV2ZW4gaWYgc2VsZWN0aW5nIGl0cyBjdXJyZW50IHRlYW0sIG5vdGhpbmcgc2hvd3MgaW4gdGhlIG1vZGVscyBsaXN0XG5cbjxpbWcgd2lkdGg9XCIxNjAyXCIgaGVpZ2h0PVwiNzQ3XCIgYWx0PVwiSW1hZ2VcIiBzcmM9XCJodHRwczovL2dpdGh1Yi5jb20vdXNlci1hdHRhY2htZW50cy9hc3NldHMvNDMwZjliMDktNjEyOC00YjBjLWE5ZWEtMDc2MjE1ZDQ2MDZlXCIgLz5cblxuIyMjIFJlbGV2YW50IGxvZyDigKYifQ==
```
}

https://github.com/berriai/litellm/issues/21115 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTExNSIsImhlYWRsaW5lIjoiIzIxMTE1IHJlcXVlc3QgdG8gdXBkYXRlIGNsb3VkZmxhcmUgd29ya2VycyBhaSBwcm92aWRlciBpbXBsZW1lbnRhdGlvbiB0byByZWZsZWN0IGNsb3VkZmxhcmXigJlzIGV4cGFuZGVkIGFpIGFwaSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAcHJkYWkiXSwiZXhjZXJwdCI6ImhpLFxuXG5p4oCZbSB0cnlpbmcgdG8gdXNlIHRoZSBjbG91ZGZsYXJlIHdvcmtlcnMgYWkgcHJvdmlkZXIgdGhyb3VnaCBsaXRlbGxtLCBidXQgdGhlIGN1cnJlbnQgaW1wbGVtZW50YXRpb24gaXMgb3V0ZGF0ZWQuIGNsb3VkZmxhcmXigJlzIGFpIGFwaSBoYXMgZXhwYW5kZWQgc2lnbmlmaWNhbnRseSBzaW5jZSB0aGlzIHByb3ZpZGVyIHdhcyBsYXN0IHVwZGF0ZWQgKH4xMCBtb250aHMgYWdvKSwgbm93IHN1cHBvcnRpbmcgbWFueSBtb3JlIGVuZHBvaW50cyBhbmQgbW9kZWxzIChpbmNsdWRpbmcgdGV4dC10by1pbWFnZSwgdGV4dC10by1zcGVlY2gsIGVtYmVkZGluZ3MsIGltYWdlIGNsYXNzaWZpY2F0aW9uLCBzdW1tYXJpemF0aW9uLCBhbmQgYSBtdWNoIGxhcmdlciBzZXQgb2YgbW9kZWxzKS5cblxudGhlIGV4aXN0aW5nIHByb3ZpZGVyIGltcGxlbWVudGF0aW9uIGluIGxpdGVsbG0gb25seSBzdXBwb3J0cyBiYXNpYyBjaGF0IHVzYWdlIGFuZCBkb2VzIG5vdCBhbGlnbiB3aXRoIHRoZSBjdXJyZW50IGNsb3VkZmxhcmUgYWkgYXBpIHN1cmZhY2UsIHdoaWNoIGxpbWl0cyBmdW5jdGlvbmFsaXR5IGFuZCBtYWtlcyBpdCBkaWZmaWN1bHQgdG8gdXNlIHRoZSBmdWxsIHJhbmdlIG9mIGNsb3VkZmxhcmUgYWkgZmVhdHVyZXMgdGhyb3VnaCBsaXRlbGxtLlxuXG50aGlzIGlzIGJvdGggYSBidWcgYW5kIGEgbWlzc2luZyBmZWF0dXJlOiBpZiBwb3NzaWJsZSwgcGxlYXNlIHVwZGF0ZSB0aGUgY2xvdWRmbGFyZSBwcm92aWRlciB0byBzdXBwb3J0IHRoZSBleHBhbmRlZCBjbG91ZGZsYXJlIGFpIGFwaS5cblxudGhhbmtzLlxuXG5yZWZzOlxuLSBodHRwczovL2RldmVsb3BlcnMuY2xvdWRmbGFyZS5jb20vYXBpL3Jlc291cmNlcy9haS9tZXRob2RzL3J1bi9cbi0gaHR0cHM6Ly9naXRodWIuY29tL0JlcnJpQUkvbGl0ZWxsbS9ibG9iL21haW4vbGl0ZWxsbS9sbG1zL2Nsb3VkZmxhcmUvY2hhdC90cmFuc2Zvcm1hdGlvbi5weVxuLSBodHRwczovL2RvY3MubGl0ZWxsbS5haS9kb2NzL3Byb3ZpZGVycy9jbG91ZGZsYXJlX3dvcmtlcnMifQ==
```
}

https://github.com/berriai/litellm/issues/21312 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTMxMiIsImhlYWRsaW5lIjoiIzIxMzEyIFtCdWddOiBGYWlsZWQgcmVxdWVzdHMgbm90IGNvdW50aW5nIHRvd2FyZHMgUlBNIGxpbWl0cyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAeXVyaS1hbGlhcyIsIkxhYmVsczogYnVnLCBwcm94eSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIHZpcnR1YWwga2V5cyBtYWtlIGEgZmFpbGVkIHJlcXVlc3QgdG8gdGhlIHByb3h5LCB0aGUgcmVxdWVzdCBhcHBlYXJzIHRvIG5vdCBiZSBjb3VudGVkIHRvd2FyZHMgdGhlIGtleSdzIFJQTSBsaW1pdHMgdW5sZXNzIGl0IGlzIHJlcGxpZWQgdG8gc3VjY2Vzc2Z1bGx5LiBcblxuV2UgaGF2ZSBvYnNlcnZlZCB0aGlzIGJlaGF2aW91ciBjYXVzaW5nIHNlcnZpY2UgZGVncmFkYXRpb24gaW4gc29tZSBpbnN0YW5jZXMgd2hlcmUgdGhlIGxpdGVMTE0gcHJveHkgc3RydWdnbGVzIGFmdGVyIGEgdmlydHVhbCBrZXkga2VlcHMgbWFraW5nIHJlcXVlc3RzIHRoYXQgZmFpbCB3aXRob3V0IGhpdHRpbmcgdGhlIFJQTSBsaW1pdC4gXG5cbldvdWxkIGl0IGJlIHBvc3NpYmxlIHRvIGFkZHJlc3MgdGhpcywgZWl0aGVyIGNvcnJlY3RpbmcgdGhlIGJlaGF2aW91ciBvciAoSWYgdGhpcyBiZWhhdmlvdXIgaXMgaW50ZW5kZWQpIGFkZGluZyBhIGNvbmZpZ3VyYXRpb24gdG8gY291bnQgaW5jb3JyZWN0IHJlcXVlc3RzIHRvd2FyZHMgdGhlIGxpbWl0P1xuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbjEuIENvbmZpZ3VyZSBhIHZpcnR1YWwga2V5IHdpdGggYSBnaXZlbiBUUE0gKGUuZy4gMjApXG4yLiAgTWFrZSBpbmNvcnJlY3QgcmVxdWVzdCBjb25zaXN0ZW50bHkgIChlLmcuIHJldHVybmluZyA0MDApXG4zLiBWaXJ0dWFsIGtleSBpcyBhbGxvd2VkIHRvIG1ha2Ugb3ZlciAyMFJQTVxuXG4jIyMgUmVsZXZhbnQgbG9nIG91dHB1dFxuXG5gYGBzaGVsbFxuXG5gYGBcblxuIyMjIFdoYXQgcGFydCBvZiBMaXRlTExNIGlzIHRoaXMgYWJvdXQ/XG5cblByb3h5XG5cbiMjIyBXaGF0IExpdGVMTE0gdmVyc2lvbiBhcmUgeW91IG9uID9cblxuMS44MS4zXG5cbiMjIyBUd2l0dGVyIC8gTGlua2VkSW4gZGV0YWlsc1xuXG5fTm8gcmVzcG9uc2VfIn0=
```
}

https://github.com/berriai/litellm/issues/21347 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTM0NyIsImhlYWRsaW5lIjoiIzIxMzQ3IFZhbGlkYXRlIExpdGVMTE0gb3V0cHV0IGFuZCBwcm92aWRlciBtYXBwaW5ncyB1c2luZyBBUEkgc3BlY3MiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQENoZXNhcnMiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgU3VtbWFyeVxuXG5MaXRlTExNJ3MgY29yZSB2YWx1ZSBwcm9wb3NpdGlvbiBpczogY2FsbCBhbnkgTExNIHByb3ZpZGVyLCBnZXQgT3BlbkFJLWNvbXBhdGlibGUgb3V0cHV0LiBUb2RheSwgdGhpcyBjb21wYXRpYmlsaXR5IGlzIHZlcmlmaWVkIGluZGlyZWN0bHkg4oCUIHRocm91Z2ggaW50ZWdyYXRpb24gdGVzdHMgdGhhdCBtYWtlIHJlYWwgQVBJIGNhbGxzIGFuZCBjaGVjayBzcGVjaWZpYyBmaWVsZHMgbWFudWFsbHkuIFRoZXJlIGlzIG5vIHN5c3RlbWF0aWMgdmFsaWRhdGlvbiB0aGF0IHRoZSBvdXRwdXQgZm9ybWF0IG1hdGNoZXMgdGhlIE9wZW5BSSBzcGVjaWZpY2F0aW9uLlxuXG4jIyBPcGVuQUkgcHVibGlzaGVzIHRoZWlyIGZ1bGwgQVBJIHNwZWNcblxuT3BlbkFJIG1haW50YWlucyBhbiBPcGVuQVBJIDMuMS4wIHNwZWNpZmljYXRpb24gKH43NSwwMDAgbGluZXMgWUFNTCkgYXQgW29wZW5haS9vcGVuYWktb3BlbmFwaV0oaHR0cHM6Ly9naXRodWIuY29tL29wZW5haS9vcGVuYWktb3BlbmFwaSkgd2l0aCBldmVyeSBlbmRwb2ludCdzIHJlcXVlc3QgYW5kIHJlc3BvbnNlIHNjaGVtYXMsIGluY2x1ZGluZzpcbi0gQWxsIGZpZWxkIG5hbWVzLCB0eXBlcywgcmVxdWlyZWQvb3B0aW9uYWwgbWFya2Vyc1xuLSBFbnVtIHZhbHVlcyAoZS5nLiwgYGZpbmlzaF9yZWFzb25gOiBgc3RvcGAsIGBsZW5ndGhgLCBgdG9vbF9jYWxsc2AsIGBjb250ZW50X2ZpbHRlcmAsIGBmdW5jdGlvbl9jYWxsYClcbi0gTmVzdGVkIG9iamVjdCBzdHJ1Y3R1cmVzIChzdHJlYW1pbmcgY2h1bmtzLCB0b29sIGNhbGxzLCB1c2FnZSwgZXRjLilcblxuTGl0ZUxMTSBkb2VzIG5vdCB1c2UgdGhpcyBzcGVjIGFueXdoZXJlLlxuXG4jIyBXaHkgdGhpcyBtYXR0ZXJzIOKAlCByZWFsIGV4YW1wbGVcblxuUFIgIzE5NTU4IG1lcmdlZCBjb2RlIHRoYXQgcGFzc2VzIFZlcnRleCBBSS9HZW1pbmkgZmluaXNoIHJlYXNvbnMgKGBtYWxmb3JtZWRfZnVuY3Rpb25fY2FsbGAsIGBmaW5pc2hfcmVhc29uX3Vuc3BlY2lmaWVkYCkgZGlyZWN0bHkgdG8gdXNlcnMuIFRoaXMgd2FzIGZsYWdnZWQgZHVyaW5nIHJldmlldzpcblxuPiBAa3JyaXNoZGhvbGFraWE6IFwiaXNuJ3QgdGhpcyBiYWQsIHNpbmNlIGl0IGJyZWFrcyBvcGVuYWkgY29uc2lzdGVuY3k/XCJcblxuVGhlIE9wZW5BSSBTREsgdGhyb3dzIGBsaXRlcmFsX2Vycm9yYCDigJQgdGhlIGVudGlyZSByZXNwb25zZSBpcyBsb3N0LCBp4oCmIn0=
```
}

https://github.com/berriai/litellm/issues/21371 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTM3MSIsImhlYWRsaW5lIjoiIzIxMzcxIFtCdWddOiAvdjEvbW9kZWxzIHJldHVybnMgb3V0ZGF0ZWQgJ2NyZWF0ZWQnIHRpbWVzdGFtcCBjYXVzaW5nIGludGVncmF0aW9uIGlzc3VlcyB3aXRoIEFuZHJvaWQgU3R1ZGlvIGFuZCBYY29kZSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAaXNha3VsYWtzaXoiLCJMYWJlbHM6IGJ1ZywgbGxtIHRyYW5zbGF0aW9uLCBTREsiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuKipEZXNjcmlwdGlvbioqXG5XaGVuIHRyeWluZyB0byBpbnRlZ3JhdGUgbG9jYWwgTExNcyBpbnRvIEFuZHJvaWQgU3R1ZGlvICgyMDI1LjIuMykgYW5kIFhjb2RlICgyNi4yKSB1c2luZyB0aGUgL3YxL21vZGVscyBlbmRwb2ludCwgdGhlIG1vZGVscyBmYWlsIHRvIGFwcGVhciBpbiB0aGUgSURFIG1vZGVsIGxpc3Qgd2hlbiByb3V0ZWQgdGhyb3VnaCBMaXRlTExNLlxuXG5Ib3dldmVyLCB3aGVuIGNvbm5lY3RpbmcgZGlyZWN0bHkgdG8gdkxMTSwgdGhlIG1vZGVscyBhcmUgY29ycmVjdGx5IGlkZW50aWZpZWQuIEFmdGVyIGludmVzdGlnYXRpb24sIHdlIG5vdGljZWQgYSBzaWduaWZpY2FudCBkaWZmZXJlbmNlIGluIHRoZSBjcmVhdGVkIHRpbWVzdGFtcCBhbmQgdGhlIHN0cnVjdHVyZSBvZiB0aGUgcmVzcG9uc2UuXG5cbkxpdGVMTE0gcmV0dXJucyBhIHZlcnkgb2xkL3N0YXRpYyB0aW1lc3RhbXAgKDE2Nzc2MTA2MDIpLCB3aGVyZWFzIHZMTE0gYW5kIG90aGVyIHByb3ZpZGVycyByZXR1cm4gYSBjdXJyZW50IFVuaXggdGltZXN0YW1wLiBJdCBhcHBlYXJzIHRoYXQgbW9kZXJuIElERXMgbWlnaHQgYmUgZmlsdGVyaW5nIG9yIHJlamVjdGluZyBtb2RlbHMgd2l0aCBvbGRlciB0aW1lc3RhbXBzIG9yIG1pc3NpbmcgZGV0YWlsZWQgcGVybWlzc2lvbiBmaWVsZHMuXG5cblxuKipDb21wYXJpc29uIG9mIFJlc3BvbnNlcyoqXG5cbjEuIExpdGVMTE0gUmVzcG9uc2UgKElzc3VlKVxuXG5Ob3RlOiBUaGUgY3JlYXRlZCB2YWx1ZSBpcyBvdXRkYXRlZCBhbmQgc29tZSBtZXRhZGF0YSBpcyBtaXNzaW5nIGNvbXBhcmVkIHRvIHZMTE0uXG5gYGBcbntcbiAgICBcImRhdGFcIjogW1xuICAgICAgICB7XG4gICAgICAgICAgICBcImlkXCI6IFwiUXdlbi9Rd2VuMy1Db2Rlci0zMEItQTNCLUluc3RydWN0XCIsXG4gICAgICAgICAgICBcIm9iamVjdFwiOiBcIm1vZGVsXCIsXG4gICAgICAgICAgICBcImNyZWF0ZWRcIjogMTY3NzYxMDYwMixcbiAgICAgICAgICAgIFwib3duZWRfYnlcIjogXCJvcGVuYWlcIlxuICAgICAgICB9XG4gICAgXSxcbiAgICBcIm9iamVjdFwiOiBcImxpc3RcIlxufVxuXG5gYGBcblxuMi4gdkxMTSBSZXNwb25zZSAoV29ya2luZylcbk7igKYifQ==
```
}

https://github.com/berriai/litellm/issues/21409 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8yMTQwOSIsImhlYWRsaW5lIjoiIzIxNDA5IFtGZWF0dXJlXTogU3VwcG9ydCBjdXN0b20gYW5kIGR5bmFtaWMgaGVhZGVycyBmb3IgQTJBIEFnZW50cyIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbWV0YWxzaGFua2VkIiwiTGFiZWxzOiBlbmhhbmNlbWVudCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG4qKkRlc2NyaXB0aW9uOioqXG5DdXJyZW50bHksIHdoZW4gTGl0ZUxMTSBpbnZva2VzIGFuIEEyQSAoQWdlbnQtdG8tQWdlbnQpIGFnZW50LCBpdCBoYXMgbGltaXRlZCBzdXBwb3J0IGZvciBjdXN0b20gaGVhZGVycy4gV2hpbGUgc29tZSBzdGF0aWMgaGVhZGVycyBjYW4gYmUgY29uZmlndXJlZCB2aWEgYGNvbmZpZy55YW1sYCwgdGhlcmUgaXMgbm8gZmxleGlibGUgd2F5IHRvIHByb3ZpZGUgaGVhZGVycyB0aGF0IG1pZ2h0IGNoYW5nZSBvciBuZWVkIHRvIGJlIGZldGNoZWQgKGUuZy4sIHJvdGF0aW5nIEFQSSBrZXlzLCBzZXNzaW9uIHRva2Vucywgb3IgcGVyLXVzZXIgYXV0aGVudGljYXRpb24pLlxuXG4qKlByb3Bvc2VkIFNvbHV0aW9uOioqXG4tIEFkZCBhIGBoZWFkZXJzYCBvciBgZXh0cmFfaGVhZGVyc2AgZmllbGQgdG8gdGhlIEEyQSBhZ2VudCBjb25maWd1cmF0aW9uIGluIGJvdGggYGNvbmZpZy55YW1sYCBhbmQgdGhlIEFkbWluIFVJLlxuLSBTdXBwb3J0IGVudmlyb25tZW50IHZhcmlhYmxlIGV4cGFuc2lvbiAoZS5nLiwgYFwiQXV0aG9yaXphdGlvblwiOiBcIkJlYXJlciBvcy5lbnZpcm9uL01ZX0FHRU5UX0tFWVwiYCkgZm9yIHRoZXNlIGhlYWRlcnMuXG4tIChPcHRpb25hbCkgQWxsb3cgYSBob29rIG9yIGEgd2F5IHRvIGZvcndhcmQgc3BlY2lmaWMgaGVhZGVycyBmcm9tIHRoZSBpbmNvbWluZyBjbGllbnQgcmVxdWVzdCB0byB0aGUgQTJBIGFnZW50IChlLmcuLCBmb3J3YXJkaW5nIGFuIGB4LWFwaS1rZXlgKS5cblxuKipXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0PyoqXG5Qcm94eSAvIEEyQSBBZ2VudCBHYXRld2F5XG5cblxuXG4jIyMgTW90aXZhdGlvbiwgcGl0Y2hcblxuXG4qKk1vdGl2YXRpb246Kipcbk1hbnkgYWdlbnRzIGFyZSBob3N0ZWQgYmVoaW5kIHNlY3VyaXR5IGdhdGV3YXlzIG9yIHByb3h5IGxheWVycyAobGlrZSBBcGlnZWUsIEFXUyBBUEkgR2F0ZXdheSwgb3IgY3VzdG9tIGF1dGggc2VydmljZXMpIHRoYXQgcmVxdWlyZSBzcGVjaWZpYyBoZWFkZXJzIGZvciBhdXRoZW50aWNhdGlvbi4gSW4gc29tZSBjYXNlcywgdGhlc2Uga2V5cyBhcmUgZHluYW1p4oCmIn0=
```
}