https://github.com/berriai/litellm/issues/30641 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDY0MSIsImhlYWRsaW5lIjoiIzMwNjQxIFtGZWF0dXJlXTogU3VyZmFjZSBIZWxtL2Vudi1jb25maWd1cmVkIFNTTyBzZXR0aW5ncyBpbiB0aGUgQWRtaW4gVUkgKHRyZWF0IGRlY2xhcmF0aXZlIGNvbmZpZyBhcyBhIGZpcnN0LWNsYXNzIGNpdGl6ZW4pIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBuaWtsYXNmcmljayIsIkxhYmVsczogZW5oYW5jZW1lbnQsIHVpLWRhc2hib2FyZCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG4jIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgdGhpcyBpcyBub3QgYSBkdXBsaWNhdGUuXG5cblJlbGF0ZWQgYnV0IGRpc3RpbmN0OlxuLSAjMTE2MjMgKGNvbmZpZy1maWxlIG1vZGVscyBpbnRlcm1pdHRlbnRseSBhcHBlYXIvZGlzYXBwZWFyIGluIHRoZSBVSSB1bmRlciBgU1RPUkVfTU9ERUxfSU5fREJgKVxuLSAjMTUwNjEgKFVJLWNyZWF0ZWQgTUNQIHNlcnZlcnMgbm9uLWZ1bmN0aW9uYWwgd2hlbiBgU1RPUkVfTU9ERUxfSU5fREI9ZmFsc2VgKVxuLSAjMjU3NzAgKGNhbm5vdCBjaGFuZ2UgYHVpX3NldHRpbmdzYCBmcm9tIHRoZSBVSSB3aGVuIHN0b3JlLW1vZGVscy1pbi1kYiBpcyBkaXNhYmxlZClcbi0gIzE5MzEyIC8gIzE5NjIwIChTU08gcm9sZSBtYXBwaW5nIC8gcm9sZSBzeW5jKSDigJQgdGhlc2UgY29uY2VybiByb2xlIHByb3BhZ2F0aW9uLCBub3QgY29uZmlnIHZpc2liaWxpdHkuXG5cbk5vbmUgb2YgdGhlc2UgdHJhY2sgdGhlIGdhcCBiZWxvdzogU1NPIHByb3ZpZGVycyBjb25maWd1cmVkIGRlY2xhcmF0aXZlbHkgKGVudiB2YXJzIC8gSGVsbSB2YWx1ZXMgLyBgcHJveHlfY29uZmlnLnlhbWxgKSBhcmUgbm90IHJlZmxlY3RlZCBpbiB0aGUgQWRtaW4gVUkncyBTU08gc2V0dGluZ3MuXG5cbiMjIFRoZSBwcm9ibGVtXG5cbldoZW4gU1NPIGlzIGNvbmZpZ3VyZWQgZGVjbGFyYXRpdmVseSByYXRoZXIgdGhhbiB0aHJvdWdoIHRoZSBVSSwgZS5nLiB2aWEgdGhlIG9mZmljaWFsIGVudi12YXIgYXBwcm9hY2g6XG5cbmBgYHlhbWxcbiMgSGVsbSB2YWx1ZXMgLT4gcmVuZGVyZWQgaW50byB0aGUgRGVwbG95bWVudCBlbnZcbmVudjpcbiAgR0VORVJJQ19DTElFTlRfSUQ6IFwiLi4uXCJcbiAgR0VORVJJQ19DTElFTlRfU0VDUkVUOiBcIi4uLlwiXG4gIEdFTkVSSUNfQVVUSE9SSVpBVElPTl9FTkRQT0lOVDogXCJodHRwczovL2lkcC5leGFtcGxlLmNvbS9hdXRoXCJcbiAgR0VORVJJQ19UT0tFTl9FTkRQT0lOVDogXCJodHRwczovL2lkcC5leGFtcGxlLmNvbS90b2tlblwiXG4gIEdFTkVSSUNfVVNFUklO4oCmIn0=
```
}

https://github.com/berriai/litellm/issues/30657 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDY1NyIsImhlYWRsaW5lIjoiIzMwNjU3IFtCdWddOiBBZGQgR2VtbWEgNCB3aGljaCBpcyByZWFjaGFibGUgdmlhIG1hbnRsZSBlbmRwb2ludCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBASWFuYS1LYXNpbW92YS1UUiIsIkxhYmVsczogZW5oYW5jZW1lbnQsIGxsbSB0cmFuc2xhdGlvbiwgU0RLIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFRoZSBGZWF0dXJlXG5cbkkgc2F3IHRoaXMgbWVyZ2VkIFBSKGh0dHBzOi8vZ2l0aHViLmNvbS9CZXJyaUFJL2xpdGVsbG0vcHVsbC8zMDI2NCkuIEJ1dCBnZW1tYSB3b24ndCB3b3JrIG9uIGJlZHJvY2sgbm93IHZpYSBsaXRlbGxtLCBiZWNhdXNlIGl0IG5vdyBpcyBsb2NhdGVkIG9uIG1hbnRsZSBlbmRwb2ludCBhbmQgdGhlcmUgc2hvdWxkIGJlIGFub3RoZXIgYmFzZSB1cmwgLSBodHRwczovL2F3cy5hbWF6b24uY29tL2Jsb2dzL21hY2hpbmUtbGVhcm5pbmcvaW50cm9kdWNpbmctZ2VtbWEtNC1tb2RlbHMtb24tYW1hem9uLWJlZHJvY2svXG5cbiMjIyBNb3RpdmF0aW9uLCBwaXRjaFxuXG5JIGFtIHRyeWluZyB0byB1c2UgR2VtbWEgaW4gb3VyIGFwcGxpY2F0aW9uIGZyb20gYmVkcm9jayBtYW50bGUgLSBhbmQgbm93IEkgY3JlYXRlZCB3b3JrYXJvdW5kIGZvciBzZXR0aW5nIGNvcnJlY3QgYmFzZSB1cmwsIGJ1dCBpdCB3b3VsZCBiZSBuaWNlIHRvIGhhdmUgcHJvZHVjdGlvbiBjb2RlIGNsZWFuXG5cbnNvIHRoaXMgY29kZTpcblxuYGltcG9ydCBsaXRlbGxtXG5pbXBvcnQgb3NcblxucmVzcG9uc2UgPSBsaXRlbGxtLnJlc3BvbnNlcyhcbiAgICBtb2RlbD1cImJlZHJvY2tfbWFudGxlL2dvb2dsZS5nZW1tYS00LTMxYlwiLFxuICAgIGlucHV0PVwiSGVsbG8hIEhvdyBjYW4geW91IGhlbHAgbWUgdG9kYXk/XCIsXG4pXG5wcmludChyZXNwb25zZSlgXG5cbmZhaWxlZCB3aXRoIHRoZSBleGNlcHRpb246XG5NYXNrZWRIVFRQU3RhdHVzRXJyb3I6IENsaWVudCBlcnJvciAnNDAxIFVuYXV0aG9yaXplZCcgZm9yIHVybCAnaHR0cHM6Ly9iZWRyb2NrLW1hbnRsZS51cy1lYXN0LTEuYXBpLmF3cy92MS9jaGF0L2NvbXBsZXRpb25zJ1xuRm9yIG1vcmUgaW5mb3JtYXRpb24gY2hlY2s6IGh0dHBzOi8vZGV2ZWxvcGVyLm1vemlsbGEub3JnL2VuLVVTL2RvY3MvV2ViL0hUVFAvU3RhdHVzLzQwMVxubGl0ZWxsbS5BUElDb25uZWN0aW9uRXJyb3I6IEJlZHJvY2tfbWFudGxlRXhjZXB0aW9uIC0ge1wiZXJyb3JcIjp7XCJjb2RlXCI6XCJhY2Nlc3NfZGVuaWVkXCIsXCJtZXNzYWdlXCI6XCJCZXJtIGlzIG5vdCBlbmFibGVkIGZvciB0aGlzIGFjY291bnRcIixcInBhcuKApiJ9
```
}

https://github.com/berriai/litellm/issues/30662 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDY2MiIsImhlYWRsaW5lIjoiIzMwNjYyIFtCdWddOiBBbnRocm9waWMgL3YxL21lc3NhZ2VzIHBhc3N0aHJvdWdoIHNlcmlhbGl6ZXMgY2FsbGJhY2staW5qZWN0ZWQgbm9uLXNlcmlhbGl6YWJsZSBtZXRhZGF0YSBpbnRvIHRoZSByZXF1ZXN0IGJvZHkiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGpncmVlcjAxMyIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG7imJEgU2VhcmNoZWQg4oCUIG5vdCBhIGR1cGxpY2F0ZS4gQ2xvc2VzdCBpcyAjMTIzNTQgKGBfU3BhbiBpcyBub3QgSlNPTiBzZXJpYWxpemFibGVgLCBidXQgc3BlbmQtbG9ncyAvIGBsaXRlbGxtX3BhcmVudF9vdGVsX3NwYW5gLCBub3QgdGhlIEFudGhyb3BpYyBwYXNzdGhyb3VnaCByZXF1ZXN0IGJvZHkpLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBhIGxpdGVsbG0gYGlucHV0X2NhbGxiYWNrYCBhZGRzIGEgbm9uLUpTT04tc2VyaWFsaXphYmxlIHZhbHVlIHRvIG1ldGFkYXRhLCB0aGUgQW50aHJvcGljIGAvdjEvbWVzc2FnZXNgIHBhc3N0aHJvdWdoIHNlcmlhbGl6ZXMgdGhhdCBwb2xsdXRlZCBtZXRhZGF0YSBpbnRvIHRoZSAqKm91dGJvdW5kIHJlcXVlc3QgYm9keSoqIHZpYSBhIGJhcmUgYGpzb24uZHVtcHMocmVxdWVzdF9ib2R5KWAsIGNyYXNoaW5nIHRoZSBjYWxsLiBSZWFsLXdvcmxkIHRyaWdnZXI6IFNlbnRyeSdzIGBMaXRlTExNSW50ZWdyYXRpb25gIHN0b3JlcyBhIGxpdmUgYFNwYW5gIGF0IGBtZXRhZGF0YVtcIl9zZW50cnlfc3BhblwiXWAgKHJvb3QgY2F1c2UgZmlsZWQgYXQgZ2V0c2VudHJ5L3NlbnRyeS1weXRob24jNjU5NikuXG5cbk5vdGU6IGNhbGxlci1zdXBwbGllZCBtZXRhZGF0YSBpcyBhbHJlYWR5IGNvcnJlY3RseSBzYW5pdGl6ZWQg4oCUIGB2YWxpZGF0ZV9hbnRocm9waWNfYXBpX21ldGFkYXRhYCBzdHJpcHMgdW5rbm93biBrZXlzICh2ZXJpZmllZDogcGFzc2luZyBgbWV0YWRhdGE9e1widXNlcl9pZFwiOlwieFwiLFwiZXZpbFwiOjxvYmo+fWAgeWllbGRzIGJvZHkgYHtcInVzZXJfaWRcIjpcInhcIn1gKS4gVGhlIGdhcCBpcyBzcGVjaWZpY2FsbHkgdmFsdWVzIGluamVjdGVkIGludG8gYGxpdGVsbG1fcGFyYW1zW1wibWV0YWRhdGFcIl1gIGJ5IGlucHV0LWNhbGxiYWNrcyAqKmFmdGVyKiogdmFsaWRhdGlvbiwgd2hpY2ggc3RpbGwgcmVhY2ggdGhlIHNlcmlhbGl6ZWQgcmVxdWVzdCBib2R5LlxuXG4qKkV4cGVjdGVkOioqIHRoZSBwYXNzdGhyb3VnaCBib2R5IGJ1aWxkZXIgc2hvdWxkIG5vdCBsZXQgbm9uLXNlcmlhbGl6YWJsZSBjYWxsYmFjay1pbmplY3RlZCBtZXRhZGF0YSBpbnRvIHRoZSBwcm92aWRlciByZXF1ZXN0IOKAlCBzdHJpcCBpdCAoYXMgIzE1NzI4IGRpZCBmb3IgYGxpdGVsbG1fcGFyZW50X290ZWxfc3BhbmApIG9yIHNlcmlhbGl6ZSB3aeKApiJ9
```
}

https://github.com/berriai/litellm/issues/30667 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDY2NyIsImhlYWRsaW5lIjoiIzMwNjY3IFtCdWddOiBTdHJlYW1pbmcgcGFzcy10aHJvdWdoIHJlcXVlc3RzIHRoYXQgZmFpbCBtaWQtc3RyZWFtICh0aW1lb3V0IC8gY29ubmVjdGlvbiBlcnJvcikgbG9nIG5vIHVzYWdlL2Nvc3QiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGJpbGx5YW5nLXNjYWxlIiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5Gb3IgcHJvdmlkZXIgKipwYXNzLXRocm91Z2gqKiBlbmRwb2ludHMgd2l0aCBzdHJlYW1pbmcgKGUuZy4gYFBPU1QgL2FudGhyb3BpYy92MS9tZXNzYWdlc2Agd2l0aCBgc3RyZWFtOiB0cnVlYCksIHVzYWdlL2Nvc3QgaXMgbG9nZ2VkICoqb25seSB3aGVuIHRoZSBzdHJlYW0gY29tcGxldGVzIHN1Y2Nlc3NmdWxseSoqLiBJZiB0aGUgdXBzdHJlYW0gc3RyZWFtIHJhaXNlcyAqKm1pZC1mbGlnaHQqKiDigJQgcmVxdWVzdCB0aW1lb3V0LCBjb25uZWN0aW9uIHJlc2V0LCBvciBhIHByb3ZpZGVyIDV4eCBtaWQtc3RyZWFtIOKAlCB0aGUgcmVxdWVzdCBsb2dzICoqbm8gdXNhZ2UgYXQgYWxsKiosIGV2ZW4gdGhvdWdoIHRoZSBwcm92aWRlciBoYXMgYWxyZWFkeSBnZW5lcmF0ZWQgYW5kICoqYmlsbGVkKiogdGhlIHRva2VucyBwcm9kdWNlZCBiZWZvcmUgdGhlIGZhaWx1cmUuXG5cblRoaXMgY2F1c2VzIGEgc3lzdGVtYXRpYywgb2Z0ZW4gbGFyZ2UsIHVuZGVyLWNvdW50IG9mIHRyYWNrZWQgc3BlbmQgdnMgdGhlIHByb3ZpZGVyIGludm9pY2Ug4oCUIGFuZCBpdCdzIHdvcnN0IGV4YWN0bHkgd2hlcmUgaXQgaHVydHMgbW9zdDogKipsb25nIGFnZW50aWMgc3RyZWFtcyoqIChsYXJnZS9jYWNoZWQgY29udGV4dCArIHNlcnZlciB0b29scyBsaWtlIHdlYl9zZWFyY2gpIGFyZSBib3RoIHRoZSBiaWdnZXN0IHRva2VuIGNvbnN1bWVycyAqYW5kKiB0aGUgbW9zdCBsaWtlbHkgdG8gaGl0IHRoZSByZXF1ZXN0IHRpbWVvdXQuIFNvIHRoZSBsYXJnZXN0IHJlcXVlc3RzIGNvbnRyaWJ1dGUgKip6ZXJvKiogdG8gU3BlbmRMb2dzLlxuXG4qKlJvb3QgY2F1c2UqKiDigJQgYGxpdGVsbG0vcHJveHkvcGFzc190aHJvdWdoX2VuZHBvaW50cy9zdHJlYW1pbmdfaGFuZGxlci5weWAsIGBQYXNzVGhyb3VnaFN0cmVhbWluZ0hhbmRsZXIuY2h1bmtfcHJvY2Vzc29yKClgOlxuXG5gYGBweXRob25cbmFzeW5jIGZvciBjaHVuayBpbiByZXNwb25zZS5haXRlcl9ieXRlcygpOlxuICAgIHJhd19ieXRlcy5hcHBlbmQoY2h1bmspXG4gICAgLi4uXG4gICAgeWllbGQgY2h1bmtcbiMgbG9nZ2luZyBpcyBzY2hlZHVsZWQgT05MWSBoZXJlLCBhZnRlciB0aGUgbG9vcCBjb21wbGV0ZXM6XG5hc3luY2lvLmNyZWF0ZV90YXNrKFBhc3NUaHJvdWdoU3RyZWFtaW5nSGFuZGxlci5fcm91dGVfc3RyZWFtaW5nX2xvZ2dpbmdfdG9faGFuZGxlciguLi7igKYifQ==
```
}

https://github.com/berriai/litellm/issues/30670 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDY3MCIsImhlYWRsaW5lIjoiIzMwNjcwIFtTZWN1cml0eV06IHZpcnR1YWwga2V5IGxlYWthZ2UgaW4gbG9ncyB3aGVuIEJ1ZGdldEV4Y2VlZGVkRXJyb3Igb2NjdXJzIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBpYXZhZWwiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBCdWRnZXRFeGNlZWRlZEVycm9yIG9jY3VycywgbGl0ZWxsbSB3cml0ZXMgYW4gUmVxdWVzdCBMb2dzIGVudHJ5IHdpdGggcGxhaW50ZXh0IHZpcnR1YWwga2V5IChCZWFyZXIgc2stPGV0Yz4pIGluIHVzZXJfYXBpX2tleSBmaWVsZCBpbnN0ZWFkIG9mIGtleSBoYXNoXG5cbiMjIyBTdGVwcyB0byBSZXByb2R1Y2VcblxuMS4g0JV4Y2VlZCBidWRnZXRcbjIuIE1ha2UgcmVxdWVzdCB0byBtb2RlbCBhbmQgZ2V0IEJ1ZGdldEV4Y2VlZGVkRXJyb3JcbjMuIE9ic2VydmUgdmlydHVhbCBrZXkgaW4gcGxhaW50ZXh0IGluIFwiS2V5IEhhc2hcIiBjb2x1bW4gb2YgTG9ncyBzZWN0aW9uIGluIFVJXG5cblxuIyMjIFJlbGV2YW50IGxvZyBvdXRwdXRcblxuYGBgc2hlbGxcblN0YWNrdHJhY2U6XG5cbkJ1ZGdldEV4Y2VlZGVkRXJyb3I6IEJ1ZGdldCBoYXMgYmVlbiBleGNlZWRlZCEgVGVhbT1cIltSRURBQ1RFRF1cIiBDdXJyZW50IGNvc3Q6IFwiW1JFREFDVEVEXVwiLCBNYXggYnVkZ2V0OiBcIltSRURBQ1RFRF1cIlxuICBGaWxlIFwibGl0ZWxsbS9wcm94eS9hdXRoL3VzZXJfYXBpX2tleV9hdXRoLnB5XCIsIGxpbmUgMjE0MywgaW4gdXNlcl9hcGlfa2V5X2F1dGhcbiAgICBhd2FpdCBfcnVuX2NlbnRyYWxpemVkX2NvbW1vbl9jaGVja3MoXG4gIEZpbGUgXCJsaXRlbGxtL3Byb3h5L2F1dGgvdXNlcl9hcGlfa2V5X2F1dGgucHlcIiwgbGluZSAyMDA0LCBpbiBfcnVuX2NlbnRyYWxpemVkX2NvbW1vbl9jaGVja3NcbiAgICBfID0gYXdhaXQgY29tbW9uX2NoZWNrcyhcbiAgRmlsZSBcImxpdGVsbG0vcHJveHkvYXV0aC9hdXRoX2NoZWNrcy5weVwiLCBsaW5lIDYyNiwgaW4gY29tbW9uX2NoZWNrc1xuICAgIGF3YWl0IF90ZWFtX21heF9idWRnZXRfY2hlY2soXG4gIEZpbGUgXCJsaXRlbGxtL3Byb3h5L2F1dGgvYXV0aF9jaGVja3MucHlcIiwgbGluZSAzNzM2LCBpbiBfdGVhbV9tYXhfYnVkZ2V0X2NoZWNrXG4gICAgcmFpc2UgbGl0ZWxsbS5CdWRnZXRFeGNlZWRlZEVycm9yKFxuYGBgXG5cbiMjIyBXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0P1xuXG5Qcm94eVxuXG4jIyMgV2hhdCBMaXRlTExNIHZlcnNpb24gYXJlIHlvdSBvbiDigKYifQ==
```
}

https://github.com/berriai/litellm/issues/30705 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcwNSIsImhlYWRsaW5lIjoiIzMwNzA1IFtCdWddOiBBbnRocm9waWMgL3YxL21lc3NhZ2VzIHNob3VsZCBub3JtYWxpemUgb3IgcmVqZWN0IG1lc3NhZ2VzW10gZW50cmllcyB3aXRoIHJvbGU9c3lzdGVtIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBtY2hsa2ltIiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuIyMgU3VtbWFyeVxuXG5BbnRocm9waWMgYC92MS9tZXNzYWdlc2AgcmVxdWVzdHMgc2VudCB0aHJvdWdoIExpdGVMTE0gY2FuIGZhaWwgd2l0aCBhIDQwMCBlcnJvciB3aGVuIHRoZSByZXF1ZXN0IGJvZHkgY29udGFpbnMgYSBgc3lzdGVtYCByb2xlIGluc2lkZSBgbWVzc2FnZXNbXWAuXG5cbkFudGhyb3BpYyBNZXNzYWdlcyBBUEkgZXhwZWN0cyBzeXN0ZW0gcHJvbXB0cyB0byBiZSBwYXNzZWQgdGhyb3VnaCB0aGUgdG9wLWxldmVsIGBzeXN0ZW1gIHBhcmFtZXRlciwgbm90IGFzIGFuIGl0ZW0gaW4gYG1lc3NhZ2VzW11gLlxuXG4jIyBFcnJvclxuXG5gYGB0ZXh0XG57XCJtZXNzYWdlXCI6XCJtZXNzYWdlczogVW5leHBlY3RlZCByb2xlIFxcXCJzeXN0ZW1cXFwiLiBUaGUgTWVzc2FnZXMgQVBJIGFjY2VwdHMgYSB0b3AtbGV2ZWwgYHN5c3RlbWAgcGFyYW1ldGVyLCBub3QgXFxcInN5c3RlbVxcXCIgYXMgYW4gaW5wdXQgbWVzc2FnZSByb2xlLlwifVxuYGBgXG5cbiMjIEVudmlyb25tZW50XG5cbi0gTGl0ZUxMTSB2ZXJzaW9uOiBgMS44OC4xYFxuLSBFbmRwb2ludDogYC92MS9tZXNzYWdlc2AgLyBBbnRocm9waWMgTWVzc2FnZXMgQVBJIGNvbXBhdGlibGUgZW5kcG9pbnRcbi0gUHJvdmlkZXIgcGF0aDogTGl0ZUxMTSBQcm94eSAtPiBCZWRyb2NrIEFudGhyb3BpY1xuLSBNb2RlbDogQ2xhdWRlIFNvbm5ldCA0LjZcbi0gUmVxdWVzdCB0eXBlOiBgYW50aHJvcGljX21lc3NhZ2VzYFxuXG4jIyBPYnNlcnZlZCBCZWhhdmlvclxuXG5XaGVuIGEgY2xpZW50IHNlbmRzIGEgcmVxdWVzdCBjb250YWluaW5nIGByb2xlOiBcInN5c3RlbVwiYCBpbnNpZGUgYG1lc3NhZ2VzW11gLCBMaXRlTExNIGZvcndhcmRzIHRoZSByZXF1ZXN0IHRvIHRoZSBBbnRocm9waWMtY29tcGF0aWJsZSBwcm92aWRlciB3aXRob3V0IG5vcm1hbGl6aW5nIHRoZSBwYXlsb2FkLlxuXG5UaGUgdXBzdHJlYW0gcHJvdmlkZXIgcmVqZWN0cyB0aGUgcmVxdWVzdCBpbW1lZGlhdGVseSB3aXRoIEhUVFAgNDAwLlxuXG5FeGFtcGxlIGludmFsaWQgcmVxdWVzdCBzaGFwZTpcblxuYGBganNvblxue1xuICBcIm1vZGVsXCI6IFwiQ2xhdWRlIFNvbm5ldCA0LjZcIixcbiAgXCJtZXNzYWdlc1wiOuKApiJ9
```
}

https://github.com/berriai/litellm/issues/30707 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcwNyIsImhlYWRsaW5lIjoiIzMwNzA3IGdlbmVyYXRlX2NvbnRlbnQgYWRhcHRlciBwYXRoIHJhaXNlcyBWYWx1ZUVycm9yOiBodHRweF9yZXNwb25zZSBpcyBOb25lIGluIGxvZ2dpbmciLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGZrdHBwMjAyMiIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyBTdW1tYXJ5XG5cbldoZW4gYGxpdGVsbG0uZ29vZ2xlX2dlbmFpLmdlbmVyYXRlX2NvbnRlbnQoKWAgcm91dGVzIHRocm91Z2ggdGhlIGFkYXB0ZXIgcGF0aCAoaS5lLiwgYGdlbmVyYXRlX2NvbnRlbnRfcHJvdmlkZXJfY29uZmlnIGlzIE5vbmVgKSwgdGhlIHN1Y2Nlc3MgbG9nZ2luZyBoYW5kbGVyIGNyYXNoZXMgd2l0aDpcblxuYGBgXG5WYWx1ZUVycm9yOiBHb29nbGUgR2VuQUkgR2VuZXJhdGUgQ29udGVudDogaHR0cHhfcmVzcG9uc2UgaXMgTm9uZVxuYGBgXG5cblRoZSBhY3R1YWwgTExNIGNhbGwgc3VjY2VlZHMgKEhUVFAgMjAwIGlzIHJldHVybmVkIHRvIHRoZSBjYWxsZXIpLCBidXQgdGhlIGJhY2tncm91bmQgbG9nZ2luZyB3b3JrZXIgZmFpbHMgYmVjYXVzZSB0aGUgbG9nZ2luZyBoYW5kbGVyIGFzc3VtZXMgYSByYXcgYGh0dHB4LlJlc3BvbnNlYCBpcyBhbHdheXMgYXZhaWxhYmxlLCB3aGljaCBpcyBub3QgdHJ1ZSBmb3IgdGhlIGFkYXB0ZXIgcGF0aC5cblxuIyMgUmVwcm9kdWN0aW9uXG5cbiMjIyBTZXR1cFxuXG5EZWZpbmUgYW4gT3BlbkFJLWNvbXBhdGlibGUgcHJvdmlkZXIgd2l0aCBhIEdlbWluaSBhbGlhcyBpbiB5b3VyIHByb3h5IGNvbmZpZzpcblxuYGBgeWFtbFxubW9kZWxfbGlzdDpcbiAgLSBtb2RlbF9uYW1lOiBcInNlbnNlbm92YS02LjctZmxhc2gtbGl0ZVwiXG4gICAgbGl0ZWxsbV9wYXJhbXM6XG4gICAgICBtb2RlbDogb3BlbmFpL3NlbnNlbm92YS02LjctZmxhc2gtbGl0ZVxuICAgICAgYXBpX2Jhc2U6IGh0dHBzOi8vdG9rZW4uc2Vuc2Vub3ZhLmNuL3YxXG5cbnJvdXRlcl9zZXR0aW5nczpcbiAgbW9kZWxfZ3JvdXBfYWxpYXM6XG4gICAgZ2VtaW5pLTMuNS1mbGFzaC1saXRlOiBzZW5zZW5vdmEtNi43LWZsYXNoLWxpdGVcbiAgICBnZW1pbmktMi41LWZsYXNoLWxpdGU6IHNlbnNlbm92YS02LjctZmxhc2gtbGl0ZVxuICAgIGdlbWluaS0zLjEtZmxhc2gtbGl0ZTogc2Vuc2Vub3ZhLTYuNy1mbGFzaC1saXRlXG4gICAgZmxhc2gtbGl0ZTogc2Vuc2Vub3ZhLTYuNy1mbGFzaC1saXRlXG5cbmdlbmVyYWxfc2V0dGluZ3M6XG4gIG1hc3Rlcl9rZXk6IHNrLTEyMzRcblxubGl0ZWxsbV9zZXR0aW5nczpcbiAgZHJvcF9wYXJhbXM6IFRydWVcbmBgYFxuXG4jIyMgQ2FsbFxuXG5gYGBiYXNoXG5jdXJsIC1YIFBPU1QgaHR0cDovL2xvY2FsaG9zdDo0MDAwL3YxYmV0YS9tb2RlbHMvZ2VtaW5pLTMuMS1mbGFzaC1saXRlJTNBZ2VuZXJhdGVDb250ZW50IFxc4oCmIn0=
```
}

https://github.com/berriai/litellm/issues/30720 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyMCIsImhlYWRsaW5lIjoiIzMwNzIwIFtGZWF0dXJlXTogRGF0YURvZyBtZXRyaWNzIGFnZ3JlZ2F0ZXMgYnkgdmlydHVhbCBrZXkgaWRlbnRpZnllciIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAbWFyY3VzLWxpbmt0cmVlIiwiTGFiZWxzOiBlbmhhbmNlbWVudCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5DdXJyZW50bHkgYGxpdGVsbG1gIG1ldHJpY3MgaW4gZGF0YWRvZyBjYW4gYmUgYnJva2VuIGRvd24gYnkgTGl0ZUxMTSBUZWFtOlxuXG48aW1nIHdpZHRoPVwiOTQzXCIgaGVpZ2h0PVwiMjg1XCIgYWx0PVwiSW1hZ2VcIiBzcmM9XCJodHRwczovL2dpdGh1Yi5jb20vdXNlci1hdHRhY2htZW50cy9hc3NldHMvYTI5ODZhM2UtM2ZiZC00MjFiLTg5N2EtNDA2ZTI4MzYyMzk0XCIgLz5cblxuSXQgd291bGQgYmUgZ3JlYXQgdG8gYmUgYWJsZSB0byBoYXZlIG9ic2VydmFiaWxpdHkgb24gdGhlIFZpcnR1YWwgS2V5IGxldmVsIHRvby5cblxuIyMjIE1vdGl2YXRpb24sIHBpdGNoXG5cblNvIHdlIGhhdmUgb2JzZXJ2ZSB0cmFmZmljLCBsYXRlbmN5IGV0YyBvbiBWaXJ0dWFsIEtleSBsZXZlbCB3aGljaCBpcyBmaW5lciBncmFpbmVkIHRoYXQgdGhlIFRlYW0uIENhbiBiZSBpbXBvcnRhbnQgdG8gdHJhY2sgdGhpcyBhcyBpdCBjb3VsZCByZXByZXNlbnQgc3ViLXRlYW0gb3IgbWljcm9zZXJ2aWNlcywgZm9yIGV4YW1wbGUsIHdpdGhpbiBhIGNvbXBhbnkvb3JnYW5pc2F0aW9uLlxuXG4jIyMgV2hhdCBwYXJ0IG9mIExpdGVMTE0gaXMgdGhpcyBhYm91dD9cblxuX05vIHJlc3BvbnNlX1xuXG4jIyMgTGl0ZUxMTSBpcyBoaXJpbmcgYSBmb3VuZGluZyBiYWNrZW5kIGVuZ2luZWVyLCBhcmUgeW91IGludGVyZXN0ZWQgaW4gam9pbmluZyB1cyBhbmQgc2hpcHBpbmcgdG8gYWxsIG91ciB1c2Vycz9cblxuTm9cblxuIyMjIFR3aXR0ZXIgLyBMaW5rZWRJbiBkZXRhaWxzXG5cbl9ObyByZXNwb25zZV8ifQ==
```
}

https://github.com/berriai/litellm/issues/30721 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyMSIsImhlYWRsaW5lIjoiIzMwNzIxIFtGZWF0dXJlXTogQWxsb3cgdXNpbmcgYW4gZXhpc3Rpbmcgc2VjcmV0IGZvciBkYXRhYmFzZSBjcmVkZW50aWFscyBvbiB0aGUgc3RhbmRhbG9uZSBQb3N0Z3JlcyBwYXRoIChoZWxtIGNoYXJ0KSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAd2l6Y2hlIiwiTGFiZWxzOiBlbmhhbmNlbWVudCJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBUaGUgRmVhdHVyZVxuXG5XaGVuIGBkYi5kZXBsb3lTdGFuZGFsb25lOiB0cnVlYCwgdGhlIGNoYXJ0IGFsd2F5cyBjcmVhdGVzIGl0cyBvd24gKi1kYmNyZWRlbnRpYWxzIFNlY3JldCBmcm9tIHBsYWludGV4dCBwb3N0Z3Jlc3FsLmF1dGguKiB2YWx1ZXMgYW5kIGhhcmRjb2RlcyB0aGUgZGVwbG95bWVudCBhbmQgbWlncmF0aW9uIGpvYiB0byByZWFkIGl0LiBcblxuVGhlcmUncyBubyB3YXkgdG8gc291cmNlIGNyZWRlbnRpYWxzIGZyb20gYW4gZXhpc3Rpbmcgc2VjcmV0IChlLmcuIEV4dGVybmFsU2VjcmV0L3ZhdWx0KSwgc28gdGhlIHByb3h5IGFuZCBQb3N0Z3JlcyBjYW4gZW5kIHVwIHdpdGggbWlzbWF0Y2hlZCBjcmVkZW50aWFscy5cblxuIyMjIE1vdGl2YXRpb24sIHBpdGNoXG5cbkRlcGxveWluZyBMaXRlTExNIHdpdGggdGhlIGNoYXJ0LW1hbmFnZWQgc3RhbmRhbG9uZSBQb3N0Z3JlcyBhbmQgd2FudCB0byBrZWVwIGRhdGFiYXNlIGNyZWRlbnRpYWxzIGluIGEgdmF1bHQgKHN5bmNlZCB2aWEgRXh0ZXJuYWxTZWNyZXQpIHJhdGhlciB0aGFuIGluIHBsYWludGV4dCB2YWx1ZXMuXG5cbiMjIyBXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0P1xuXG5IZWxtIENoYXJ0XG5cbiMjIyBMaXRlTExNIGlzIGhpcmluZyBhIGZvdW5kaW5nIGJhY2tlbmQgZW5naW5lZXIsIGFyZSB5b3UgaW50ZXJlc3RlZCBpbiBqb2luaW5nIHVzIGFuZCBzaGlwcGluZyB0byBhbGwgb3VyIHVzZXJzP1xuXG5Ob1xuXG4jIyMgVHdpdHRlciAvIExpbmtlZEluIGRldGFpbHNcblxuX05vIHJlc3BvbnNlXyJ9
```
}

https://github.com/berriai/litellm/issues/30724 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyNCIsImhlYWRsaW5lIjoiIzMwNzI0IFtCdWddOiBCZWRyb2NrIHBhc3MtdGhyb3VnaCBlbmRwb2ludCBkb2VzIG5vdCBsb2cgcmVxdWVzdCBgbWVzc2FnZXNgIHBheWxvYWQiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGFhc2hpc2hyYmhhbmRhcmkiLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5HcmVldGluZ3MgTGl0ZUxMTSBUZWFtLFxuXG4jIyBbUXVpY2sgU3VtbWFyeV1cblxuV2hlbiBpIHVzZSBCZWRyb2NrIFBhc3N0aHJvdWdoIEVuZHBvaW50IChMaW5rOiBodHRwczovL2RvY3MubGl0ZWxsbS5haS9kb2NzL3Bhc3NfdGhyb3VnaC9iZWRyb2NrIzEtdXNpbmctY29uZmlneWFtbC1yZWNvbW1lbmRlZC1mb3ItbW9kZWwtZW5kcG9pbnRzKVxuSSBoYXZlIGNvbmZpZ3VyZWQgYHMzYCBhbmQgYEN1c3RvbSBDYWxsYmFjayBBUElgIGFuZCBvbiBib3RoIGkgZG8gbm90IGhhdmUgdGhlIGFjdHVhbCBgbWVzc2FnZWAgcGF5bG9hZCBzaG93aW5nIChzeXN0ZW0sIHRvb2xzIGFuZCB1c2VyKSByYXRoZXIgaW4gdGhlIFMzIG9iamVjdCBpIHNlZSB0aGUgZGF0YSBhcyBcbmBgYFxuXCJtZXNzYWdlc1wiOiBbXG4gICAgICAgIHtcbiAgICAgICAgICAgIFwicm9sZVwiOiBcInVzZXJcIixcbiAgICAgICAgICAgIFwiY29udGVudFwiOiBcImRlZmF1bHQtbWVzc2FnZS12YWx1ZVwiXG4gICAgICAgIH1cbiAgICBdLFxuYGBgXG5hbmQgb24gdGhlIEFQSSBlbmRwb2ludC5cblxuXG5cbiMjIE15IExpdGVMTE0gU2V0dXBcblxuXG4jIyMgLmVudlxuXG5gYGBiYXNoXG4jPT09PT09PT1bRG9ja2VyICYgRG9ja2VyIENvbXBvc2VdPT09PT09PVxuQ09NUE9TRV9QUk9KRUNUX05BTUU9bGl0ZWxsbS1zdGFja1xuU1RBQ0tfUFJFRklYPWxpdGVsbG0tc3RhY2tcblxuXG4jID09PT09W0xpdGVMTE1dPT09PT09PT09PT09XG5cbiMgTGl0ZUxMTSBDb250YWluZXIgJiBWb2x1bWUgTmFtZXNcbkxJVEVMTE1fQVBQX0NPTlRBSU5FUl9OQU1FPWxpdGVsbG0tYXBwXG5MSVRFTExNX0RCX0NPTlRBSU5FUl9OQU1FPWxpdGVsbG0tZGJcbkxJVEVMTE1fUE9TVEdSRVNfVk9MVU1FX05BTUU9bGl0ZWxsbV9wb3N0Z3Jlc19kYXRhXG5cbiMgUG9zdGdyZXMgc3VwZXJ1c2VyIChib290c3RyYXAgYWRtaW4g4oCUIGRvIG5vdCB1c2UgaW4gYXBwIGNvbm5lY3Rpb24gc3RyaW5ncylcblBPU1RHUkVTX0FETUlOX1VTRVI9cG9zdGdyZXNfYWRtaW5fdXNlclxuUE9TVEdSRVNfQURNSU5fUEFTU1dPUkQ9cDBvc3RyZXNBQGRtaW4xMjNcblxuIyBMaXRlTExNIGFwcCB1c2VyIChsZWFzdC1wcml2aWxlZ+KApiJ9
```
}