https://github.com/berriai/litellm/issues/30984 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDk4NCIsImhlYWRsaW5lIjoiIzMwOTg0IEEyQSBBZ2VudHMgcGFnZSBhbHdheXMgc2hvd3MgXCJOZWVkcyBTZXR1cFwiOiBhZ2VudHMga2V5LWxpc3QgdXNlcyBzaXplPTUwMCBidXQgL2tleS9saXN0IGNhcHMgc2l6ZSBhdCAxMDAgKDQyMikiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQGJpYXV0b21hdG9yIl0sImV4Y2VycHQiOiIjIyMgV2hhdCBoYXBwZW5lZD9cblxuT24gdGhlICoqQWdlbnRzKiogcGFnZSBvZiB0aGUgQWRtaW4gVUksIGV2ZXJ5IHJlZ2lzdGVyZWQgQTJBIGFnZW50IHNob3dzIHRoZSBzdGF0dXMgYmFkZ2UgKipcIk5lZWRzIFNldHVwXCIqKiBldmVuIHdoZW4gdGhlIGFnZW50IGlzIGNvcnJlY3RseSBjb25maWd1cmVkIGFuZCBoYXMgYSB2aXJ0dWFsIGtleSBsaW5rZWQgdG8gaXQgKGEga2V5IHdob3NlIGBhZ2VudF9pZGAgbWF0Y2hlcyB0aGUgYWdlbnQpLlxuXG5Sb290IGNhdXNlOiB0aGUgYWdlbnRzIHBhZ2UgYnVpbGRzIGl0cyBcImhhcyBrZXk/XCIgbG9va3VwIGJ5IGNhbGxpbmcgYGtleUxpc3RDYWxsKC4uLilgIHdpdGggKipgc2l6ZT01MDBgKiosIGJ1dCB0aGUgYC9rZXkvbGlzdGAgZW5kcG9pbnQgdmFsaWRhdGVzIGBzaXplYCB3aXRoIGBsZT0xMDBgLCBzbyB0aGUgcmVxdWVzdCBmYWlscyB3aXRoICoqSFRUUCA0MjIqKiBhbmQgdGhlIGxvb2t1cCBtYXAgZW5kcyB1cCBlbXB0eSDigJQgc28gdGhlIGJhZGdlIGZhbGxzIHRocm91Z2ggdG8gXCJOZWVkcyBTZXR1cFwiIGZvciAqKmFsbCoqIGFnZW50cy5cblxuKipGcm9udGVuZCAoQWRtaW4gVUkgYnVuZGxlKSoqIOKAlCB0aGUgYmFkZ2UgbG9naWM6XG5cbmBgYGpzXG5uW2UuYWdlbnRfaWRdPy5oYXNfa2V5XG4gID8gQmFkZ2Uoe2NvbG9yOlwiZ3JlZW5cIiwgIGNoaWxkcmVuOlwiQWN0aXZlXCJ9KVxuICA6IEJhZGdlKHtjb2xvcjpcInllbGxvd1wiLCBjaGlsZHJlbjpcIk5lZWRzIFNldHVwXCJ9KVxuYGBgXG5cbuKApmFuZCB0aGUgbWFwIGBuYCBpcyBidWlsdCBmcm9tIGEga2V5IGxpc3QgcmVxdWVzdGVkIHdpdGggYHNpemU9NTAwYDpcblxuYGBganNcbmNvbnN0IHsga2V5cyA9IFtdIH0gPSBhd2FpdCBrZXlMaXN0Q2FsbChhY2Nlc3NUb2tlbiwgbnVsbCwgbnVsbCwgbnVsbCwgbnVsbCwgbnVsbCwgMSwgNTAwKTtcbmNvbnN0IHIgPSB7fTtcbmZvciAoY29uc3QgayBvZiBrZXlzKSB7IGlmIChrLmFnZW50X2lkICYmICFyW2suYWdlbnRfaWRdKSByW2suYWdlbnRfaWRdID0geyBoYXNfa2V5OiB0cnVlLCAuLi4gfTsgfVxuYGBgXG5cbioqQmFja2VuZCoqIOKAlCBgL2tleS9saXN0YCByZWplY3RzIGBzaXplID4gMTAwYDpcblxuYGBgXG5HRVQgL2tleS9saXN0P3NpemU9NTAwXG7ihpIgNDIyIHtcImRldGFpbFwiOlt7XCJ0eXBlXCI6XCJsZXNzX3RoYW5fZXF1YWxcIixcImxvY1wiOltcInF1ZXJ5XCIsXCJzaXplXCJdLFxuICAgICAgICBcIm1zZ1wiOlwiSW5wdXQgc2hvdWzigKYifQ==
```
}

https://github.com/berriai/litellm/issues/30997 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDk5NyIsImhlYWRsaW5lIjoiIzMwOTk3IGZpeChtY3ApOiBPQXV0aCBhdXRob3JpemUvcmVnaXN0ZXIgZW5kcG9pbnRzIGZhaWwgdG8gcmVzb2x2ZSBNQ1Agc2VydmVyIGJ5IHNlcnZlcl9pZCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAS0syOTE4NjAiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgQnVnIERlc2NyaXB0aW9uXG5cblRoZSBPQXV0aCBicm9rZXIgZW5kcG9pbnRzIChgL3YxL21jcC9zZXJ2ZXIvb2F1dGgve21jcF9zZXJ2ZXJfbmFtZX0vYXV0aG9yaXplYCwgYC9yZWdpc3RlcmAsIGAvdG9rZW5gLCBgL2NhbGxiYWNrYCkgdXNlIGBnZXRfbWNwX3NlcnZlcl9ieV9uYW1lKClgIHRvIHJlc29sdmUgdGhlIE1DUCBzZXJ2ZXIgZnJvbSB0aGUgVVJMIHBhdGggcGFyYW1ldGVyLiBIb3dldmVyLCB0aGUgTGl0ZUxMTSBVSSBzZW5kcyB0aGUgKipzZXJ2ZXJfaWQqKiAoU0hBLTI1NiBoYXNoKSBpbiB0aGUgcGF0aCDigJQgbm90IHRoZSBzZXJ2ZXJfbmFtZSBvciBhbGlhcyDigJQgY2F1c2luZyB0aGUgbG9va3VwIHRvIGZhaWwuXG5cblRoaXMgcmVzdWx0cyBpbjpcbmBgYGpzb25cbntcImRldGFpbFwiOiBcIk1DUCBzZXJ2ZXIgYXV0aG9yaXphdGlvbiB1cmwgaXMgbm90IHNldFwifVxuYGBgXG5cbiMjIFJvb3QgQ2F1c2VcblxuSW4gYGRpc2NvdmVyYWJsZV9lbmRwb2ludHMucHlgLCB0aGUgYGF1dGhvcml6ZSgpYCBmdW5jdGlvbiAobGluZSB+NTM1KSBhbmQgYHJlZ2lzdGVyX2NsaWVudCgpYCBmdW5jdGlvbiAobGluZSB+OTk5KSBib3RoIGNhbGw6XG5cbmBgYHB5dGhvblxubWNwX3NlcnZlciA9IGdsb2JhbF9tY3Bfc2VydmVyX21hbmFnZXIuZ2V0X21jcF9zZXJ2ZXJfYnlfbmFtZShcbiAgICBsb29rdXBfbmFtZSwgY2xpZW50X2lwPWNsaWVudF9pcFxuKVxuYGBgXG5cbmBnZXRfbWNwX3NlcnZlcl9ieV9uYW1lKClgIG1hdGNoZXMgYnkgYWxpYXMg4oaSIHNlcnZlcl9uYW1lIOKGkiBuYW1lLCBidXQgKipub3QgYnkgc2VydmVyX2lkKiouXG5cblRoZSBVSSBjb25zdHJ1Y3RzIFVSTHMgbGlrZTpcbmBgYFxuR0VUIC92MS9tY3Avc2VydmVyL29hdXRoL2ExYjJjM2Q0ZTVmNi4uLi9hdXRob3JpemVcbmBgYFxuXG5XaGVyZSBgYTFiMmMzZDRlNWY2Li4uYCBpcyB0aGUgYHNlcnZlcl9pZGAgZnJvbSBgX2dlbmVyYXRlX3N0YWJsZV9zZXJ2ZXJfaWQoKWAuIFNpbmNlIHRoaXMgaXMgYSBoYXNoLCBpdCB3b24ndCBtYXRjaCBhbnkgYWxpYXMsIHNlcnZlcl9uYW1lLCBvciBuYW1lLlxuXG5NZWFud2hpbGUsIGBnZXRfbWNwX3NlcnZlcl9ieV9pZCgpYCBleGlzdHMgYXQgbGluZSB+MzM2NSBpbiBgbWNwX3NlcnZlcl9tYW5hZ2VyLnB5YCBhbmQgY29ycmVjdGx5IG1hdGNoZXMgYnkgYHNlcnZlci5zZXJ2ZXJfaWRgLCBidXQgaXMgbmV2ZXIgY2FsbGVkIGluIHRoZSBPQXV0aCBmbOKApiJ9
```
}

https://github.com/berriai/litellm/issues/31004 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTAwNCIsImhlYWRsaW5lIjoiIzMxMDA0IFtCdWddOiBHdWFyZHJhaWxzIGFyZSB0cmlnZ2VyZWQgb24gZXJyb3JzIGZyb20gcHJvdmlkZXIncyBBUEkgYW5kIGNvbXBsaWNhdGUgdHJvdWJsZXNob290aW5nIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBpYXZhZWwiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuR3VhcmRyYWlscyBjYW4gdHJpZ2dlciBkdXJpbmcgaGFuZGxpbmcgb2YgZXJyb3IgcmVzcG9uc2UgZnJvbSBwcm92aWRlciB3aGljaCBsZWFkcyB0byBcImV4Y2VwdGlvbiByYWlzZWQgZHVyaW5nIGV4Y2VwdGlvbiBoYW5kbGluZ1wiIG5vdCBiZWluZyBwcm9wZXJseSBoYW5kbGVkXG5cbiMjIyBTdGVwcyB0byBSZXByb2R1Y2VcblxuMS4gQ3JlYXRlIGd1YXJkcmFpcyB3aGljaCB3b3VsZCB0cmlnZ2VyIG9uIGNvbnRlbnQgb2YgZXJyb3IgbWVzc2FnZSBmcm9tIHByb3ZpZGVyXG4yLiBNYWtlIHN1Y2ggcmVxdWVzdCB3aGljaCB3b3VsZCBsZWFkIHRvIGVycm9yIHJlc3BvbnNlIGZyb20gcHJvdmlkZXJcbjMuIE9ic2VydmUgYnJva2VuIGV4Y2VwdGlvbiBoYW5kbGluZyBpbiBsb2dzXG5cblxuIyMjIFJlbGV2YW50IGxvZyBvdXRwdXRcblxuYGBgc2hlbGxcbjE0OjM3OjUxIC0gTGl0ZUxMTSBQcm94eTpFUlJPUjogcHJveHlfc2VydmVyLnB5OjcwOTYgLSBsaXRlbGxtLnByb3h5LnByb3h5X3NlcnZlci5hc3luY19kYXRhX2dlbmVyYXRvcigpOiBFeGNlcHRpb24gb2NjdXJlZCAtIGxpdGVsbG0uQVBJRXJyb3I6IEFQSUVycm9yOiBPcGVucm91XG50ZXJFeGNlcHRpb24gLSBNZXNzYWdlOiBQcm92aWRlciByZXR1cm5lZCBlcnJvciwgTWV0YWRhdGE6IHsnZXJyb3JfdHlwZSc6ICdwZXJtaXNzaW9uX2RlbmllZCd9LCBVc2VyIElEOiBcblRyYWNlYmFjayAobW9zdCByZWNlbnQgY2FsbCBsYXN0KTpcbiAgRmlsZSBcIi9hcHAvLnZlbnYvbGliL3B5dGhvbjMuMTMvc2l0ZS1wYWNrYWdlcy9saXRlbGxtL2xpdGVsbG1fY29yZV91dGlscy9zdHJlYW1pbmdfaGFuZGxlci5weVwiLCBsaW5lIDIwODcsIGluIF9fYW5leHRfX1xuICAgIGFzeW5jIGZvciBjaHVuayBpbiBzZWxmLmNvbXBsZXRpb25fc3RyZWFtOiAgIyB0eXBlOiBpZ25vcmVbdW5pb24tYXR0cl1cbiAgICAuLi48ODQgbGluZXM+Li4uXG4gICAgICAgIHJldHVybiBwcm9jZXNzZWRfY2h1bmtcbiAgRmlsZSBcIi9hcHAvLnZlbnYvbGliL3B5dGhvbjMuMTMvc2l0ZS1wYWNrYWdlcy9saXRlbGxtL2xsbXMvYmFzZV9sbG0vYmFzZV9tb2RlbF9pdGVyYXRvci5weeKApiJ9
```
}

https://github.com/berriai/litellm/issues/31008 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTAwOCIsImhlYWRsaW5lIjoiIzMxMDA4IFtCdWddOiBCYWNrZ3JvdW5kIGhlYWx0aCBjaGVja3MgZmFpbCBmb3IgT3BlblJvdXRlciBtb2RlbHMgd2l0aCBleHRyYV9ib2R5LnRvb2xzIChvcGVucm91dGVyOndlYl9zZWFyY2gpOyByZWFsIGNvbXBsZXRpb25zIHN1Y2NlZWQiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHBsaXNzamUiLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5PcGVuUm91dGVyIG1vZGVscyBjb25maWd1cmVkIHdpdGggZ2F0ZXdheS13aWRlIHdlYiBzZWFyY2ggdmlhIGBsaXRlbGxtX3BhcmFtcy5leHRyYV9ib2R5LnRvb2xzYCAoYG9wZW5yb3V0ZXI6d2ViX3NlYXJjaGAsIG9wdGlvbmFsbHkgYG9wZW5yb3V0ZXI6ZGF0ZXRpbWVgKSBhcmUgbWFya2VkICoqdW5oZWFsdGh5KiogYnkgTGl0ZUxMTSBiYWNrZ3JvdW5kIGhlYWx0aCBjaGVja3MsIHdoaWxlIG5vcm1hbCBjaGF0IGNvbXBsZXRpb25zIG9uIHRoZSBzYW1lIGRlcGxveW1lbnQgc3VjY2VlZC5cblxuKipFeHBlY3RlZDoqKiBIZWFsdGggY2hlY2tzIHBhc3MgZm9yIGEgZGVwbG95bWVudCB0aGF0IGNhbiBjb21wbGV0ZSByZWFsIGNoYXQgcmVxdWVzdHMsIG9yIHByb2JlcyBzaG91bGQgbm90IGluaGVyaXQgc2VydmVyLXRvb2wgYGV4dHJhX2JvZHlgIHRoYXQgY2hhbmdlcyByZXF1ZXN0IHNlbWFudGljcy5cblxuKipBY3R1YWw6KiogUmVtb3ZpbmcgYGV4dHJhX2JvZHlgIG1ha2VzIGhlYWx0aCBjaGVja3MgcGFzcy4gQWRkaW5nIG9ubHkgYG9wZW5yb3V0ZXI6d2ViX3NlYXJjaGAgaW4gYGV4dHJhX2JvZHlgIG1ha2VzIGhlYWx0aCBjaGVja3MgZmFpbCBhZ2Fpbi4gSW5jcmVhc2luZyBgbW9kZWxfaW5mby5oZWFsdGhfY2hlY2tfbWF4X3Rva2Vuc2AgZGlkIG5vdCBoZWxwLlxuXG4qKkVudmlyb25tZW50KipcblxuLSBMaXRlTExNIHYxLjg5LjIgKHByb2R1Y3Rpb24pIGFuZCB2MS44OS4zIChsb2NhbCBkb2NrZXIpIOKAlCBzYW1lIGJlaGF2aW9yXG4tIFByb3ZpZGVyOiBPcGVuUm91dGVyXG4tIEV4YW1wbGUgbW9kZWxzOiBgb3BlbnJvdXRlci9hbnRocm9waWMvY2xhdWRlLWhhaWt1LTQuNWAsIGBvcGVucm91dGVyL2dvb2dsZS9nZW1pbmktMy1mbGFzaC1wcmV2aWV3YFxuLSBNb2RlbHMgc3RvcmVkIGluIERCIHZpYSBBZG1pbiBVSSAoYFNUT1JFX01PREVMX0lOX0RCPVRydWVgKVxuXG4qKlN1c3BlY3RlZCBjYXVzZSoqXG5cbmBsaXRlbGxtL3Byb3h5L2hlYWx0aF9jaGVjay5weWAgZnVuY3Rpb24gYF91cGRhdGVfbGl0ZWxsbV9wYXJhbXNfZm9yX2hlYWx0aF9jaGVjaygpYCBvdmVycmlkZXMgYG3igKYifQ==
```
}

https://github.com/berriai/litellm/issues/31030 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTAzMCIsImhlYWRsaW5lIjoiIzMxMDMwIFtCdWddOiBWZXJ0ZXggQUkgSGFpa3UgZmFpbHMgd2l0aCB0aGlua2luZzp7XCJ0eXBlXCI6XCJhZGFwdGl2ZVwifSBvbiAvdjEvbWVzc2FnZXMg4oCUIGRyb3BfcGFyYW1zIG5vdCBhcHBsaWVkIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEB3b29qdW5nMyIsIkxhYmVsczogYnVnLCBwcm94eSwgbGxtIHRyYW5zbGF0aW9uLCBjbGF1ZGUgY29kZSJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIGEgcmVxdWVzdCBpcyBzZW50IHRvIHRoZSBBbnRocm9waWMtbmF0aXZlIHBhc3MtdGhyb3VnaCBlbmRwb2ludCBgUE9TVCAvdjEvbWVzc2FnZXNgLCBMaXRlTExNIGZvcndhcmRzIHRoZSByZXF1ZXN0IGJvZHkgdG8gVmVydGV4IEFJIGVzc2VudGlhbGx5IHZlcmJhdGltLiBQcm92aWRlci9tb2RlbC1zcGVjaWZpYyBwYXJhbWV0ZXJzIHRoYXQgdGhlIHRhcmdldCBtb2RlbCBkb2VzIG5vdCBzdXBwb3J0IGFyZSBub3Qgc2FuaXRpemVkIOKAlCBldmVuIHdpdGggYGRyb3BfcGFyYW1zOiB0cnVlYCBzZXQgZ2xvYmFsbHkgaW4gYGxpdGVsbG1fc2V0dGluZ3NgLCBhbmQgZXZlbiB3aXRoIG5vIGBhZGRpdGlvbmFsX2Ryb3BfcGFyYW1zYCBvdmVycmlkZSBhbnl3aGVyZSBpbiB0aGUgY29uZmlnLlxuXG5UaGUgcHJvb2YgaXMgdGhhdCB0aGUgc2FtZSBtb2RlbCBhbmQgdGhlIHNhbWUgcGFyYW1ldGVyIGJlaGF2ZSBkaWZmZXJlbnRseSBkZXBlbmRpbmcgb24gdGhlIHJvdXRlOlxuLSBgUE9TVCAvdjEvbWVzc2FnZXNgIHdpdGggYG1vZGVsPWhhaWt1YCAoZm9yd2FyZGVkIHRvIGB2ZXJ0ZXhfYWkvY2xhdWRlLWhhaWt1LTQtNWApLCBgdGhpbmtpbmc6e1widHlwZVwiOlwiYWRhcHRpdmVcIn1gIOKGkiAqKkhUVFAgNDAwKiogKFZlcnRleCByZWplY3RzIGl0KS5cbi0gYFBPU1QgL3YxL2NoYXQvY29tcGxldGlvbnNgIHdpdGggdGhlIHNhbWUgbW9kZWwgYW5kIHNhbWUgYHRoaW5raW5nYCBwYXlsb2FkIOKGkiAqKkhUVFAgMjAwKiogKExpdGVMTE0gc2VlbXMgdG8gZHJvcCBgdGhpbmtpbmdgIGJlZm9yZSBmb3J3YXJkaW5nOyByZXNwb25zZSBzaG93cyBgcmVhc29uaW5nX3Rva2VuczowYCwgYHRoaW5raW5nX2Jsb2NrczpudWxsYCkuXG5cblRoaXMgaXMgbm90IGJlY2F1c2UgYGFkYXB0aXZlYCBpcyBhbiBpbnZhbGlkIHZhbHVlIGluIGdlbmVyYWwg4oCUIGBjbGF1ZGUtb3B1cy00LThgIGFjY2VwdHMgYHRoaW5raW5nOntcInR5cGVcIjpcImFkYXB0aXZlXCJ9YCB2aWEgdGhlIHNhbWUgYC92MS9tZXNzYWdlc2Agcm91dGUgd2l0aCBIVFRQIDIwMC4gSXQncyBhIG1vZGVsLWNhcGFiaWxpdHkgbWlzbWF0Y2ggKOKApiJ9
```
}

https://github.com/berriai/litellm/issues/31050 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA1MCIsImhlYWRsaW5lIjoiIzMxMDUwIFtCdWddOiBNQ1Agc3RhdGljX2hlYWRlcnMgd2l0aCBvcy5lbnZpcm9uL1ZBUiBhcmUgbm90IHJlc29sdmVkIHdoZW4gc2F2ZWQgdmlhIFVJL0RCIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBoYXJzaGlscHJhamFwYXRpOTYiLCJMYWJlbHM6IGJ1ZywgcHJveHkiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuKipXaGF0IGhhcHBlbmVkOioqICBcbldoZW4gY29uZmlndXJpbmcgYW4gTUNQIHNlcnZlciBpbiB0aGUgQWRtaW4gVUksIHNldHRpbmcgYSAqKlN0YXRpYyBIZWFkZXIqKiB2YWx1ZSB0byBgb3MuZW52aXJvbi88RU5WX1ZBUl9OQU1FPmAgZG9lcyBub3QgcmVzb2x2ZSB0byB0aGUgYWN0dWFsIGVudmlyb25tZW50IHZhcmlhYmxlIGF0IHJ1bnRpbWUuIFRoZSBsaXRlcmFsIHN0cmluZyBgb3MuZW52aXJvbi88RU5WX1ZBUl9OQU1FPmAgaXMgc3RvcmVkIGluIHRoZSBEQiBhbmQgc2VudCBvbiBvdXRib3VuZCBNQ1AgcmVxdWVzdHMsIHNvIGF1dGggZmFpbHMuXG5cblBhc3RpbmcgdGhlIHJlYWwgc2VjcmV0IHZhbHVlIG1hbnVhbGx5IGluIHRoZSBzYW1lIFN0YXRpYyBIZWFkZXJzIGZpZWxkIHdvcmtzLlxuXG4qKkV4cGVjdGVkOioqICBcbmBvcy5lbnZpcm9uLzxWQVI+YCBpbiBNQ1AgYHN0YXRpY19oZWFkZXJzYCBzaG91bGQgcmVzb2x2ZSB2aWEgYGdldF9zZWNyZXQoKWAgLyBgb3MuZ2V0ZW52KClgLCBjb25zaXN0ZW50IHdpdGggb3RoZXIgcHJveHkgY29uZmlnIGZpZWxkcyBhbmQgWUFNTCBgbWNwX3NlcnZlcnNgIGNvbmZpZy5cblxuKipSb290IGNhdXNlIChmb3IgbWFpbnRhaW5lcnMpOioqICBcbmBQcm94eUNvbmZpZy5fY2hlY2tfZm9yX29zX2Vudmlyb25fdmFycygpYCByZXNvbHZlcyBgb3MuZW52aXJvbi9gIHJlZmVyZW5jZXMgZm9yIFlBTUwgY29uZmlnIGF0IGxvYWQgdGltZSwgYnV0IGBidWlsZF9tY3Bfc2VydmVyX2Zyb21fdGFibGUoKWAgZGVzZXJpYWxpemVzIGBzdGF0aWNfaGVhZGVyc2AgZnJvbSB0aGUgREIgd2l0aG91dCByZXNvbHZpbmcgdGhlbS4gVGhlIFRlc3QgQ29ubmVjdGlvbiBwYXRoIGFsc28gcGFzc2VzIGByZXF1ZXN0LnN0YXRpY19oZWFkZXJzYCB0aHJvdWdoIHVuY2hhbmdlZC5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBTZXQgYSBzZWNyZXQgaW4gdGhlIHByb3h5IHByb2Nlc3MgZW52aXJvbm1lbnQsIGUuZy46XG4gICBleHBvcnQgTVlfU0VDUkVUPVwic29tZS12YWx1ZVwiXG5cbjIuIFN0YXJ0IExpdGVMTE0gcHJveHkgd2l0aCBEQiBlbmFibGVkLuKApiJ9
```
}

https://github.com/berriai/litellm/issues/31052 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA1MiIsImhlYWRsaW5lIjoiIzMxMDUyIFRlYW0gYWRtaW5zIGNhbiBleGZpbHRyYXRlIHByb3h5IGVudiBzZWNyZXRzIHZpYSBvcy5lbnZpcm9uLyBpbiBEQi1zdG9yZWQgdGVhbSBtb2RlbHMiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHNkdWRoYW5pIl0sImV4Y2VycHQiOiIjIyMgU3VtbWFyeVxuXG5XaXRoIGBTVE9SRV9NT0RFTF9JTl9EQj10cnVlYCwgYG9zLmVudmlyb24vYCByZWZlcmVuY2VzIGluIGEgREItc3RvcmVkIG1vZGVsJ3MgYGxpdGVsbG1fcGFyYW1zYCBhcmUgcmVzb2x2ZWQgc2VydmVyLXNpZGUsIHVzaW5nIHRoZSBwcm94eSBwcm9jZXNzIGVudmlyb25tZW50LCBhdCBkZXBsb3ltZW50IGxvYWQgdGltZS4gYC9tb2RlbC9uZXdgIGlzIGEgc2VsZi1tYW5hZ2VkIHJvdXRlLCBzbyBhIHRlYW0gYWRtaW4gKG5vdCBvbmx5IGEgcHJveHkgYWRtaW4pIGNhbiBjcmVhdGUgYSB0ZWFtLXNjb3BlZCBtb2RlbCBieSBwYXNzaW5nIGEgYHRlYW1faWRgLCBhbmQgdGhlcmUgaXMgbm8gdmFsaWRhdGlvbiBvZiB0aGUgYGxpdGVsbG1fcGFyYW1zYCB0aGV5IHN1Ym1pdC4gQSB0ZWFtIGFkbWluIGNhbiB0aGVyZWZvcmUgc2V0IGBhcGlfa2V5OiBvcy5lbnZpcm9uLzxBTllfUFJPWFlfRU5WX1ZBUj5gIHRvZ2V0aGVyIHdpdGggYW4gYGFwaV9iYXNlYCB0aGV5IGNvbnRyb2wsIGludm9rZSB0aGUgbW9kZWwsIGFuZCByZWNlaXZlIHRoZSByZXNvbHZlZCBzZWNyZXQgYXMgdGhlIHVwc3RyZWFtIGBBdXRob3JpemF0aW9uYCBoZWFkZXIuXG5cblRoZSBlc2NhbGF0aW9uIGlzIHNwZWNpZmljYWxseSB0aGUgYG9zLmVudmlyb24vYCByZXNvbHV0aW9uLiBXaXRob3V0IGl0IGEgdGVhbSBhZG1pbiBjYW4gb25seSBmb3J3YXJkIHNlY3JldHMgdGhleSBhbHJlYWR5IGtub3c7IHdpdGggaXQgdGhleSBjYW4gcmVmZXJlbmNlIGFuZCBleGZpbHRyYXRlIHNlY3JldHMgdGhleSBkbyBub3Qga25vdywgaW5jbHVkaW5nIGBMSVRFTExNX01BU1RFUl9LRVlgLCBvdGhlciBwcm92aWRlcnMnIEFQSSBrZXlzLCBgREFUQUJBU0VfVVJMYCwgYW5kIGFueXRoaW5nIGVsc2UgaW4gdGhlIHByb3h5IGVudmlyb25tZW50LlxuXG5UaGlzIGlzIHByZS1leGlzdGluZyBiZWhhdmlvciByYXRoZXIgdGhhbiBzb21ldGhpbmcgbmV3bHkgaW50cm9kdWNlZDsgdGhlIHJlc29sdXRpb24gZm9yIERCLXN0b3JlZCBtb2RlbHMgcmVncmVzc2VkIGFyb3VuZCB2MS44OS4zIChzZWUgIzMwOTY5KSBhbmQgaXMgYmVpbmcgcmVzdG9yZWQgaW4gIzMxMDQxLiBUaGUgcmVzdG9yYXRpb24gaXMgY29ycmVjdCBmb3IgdGhlIG9wZXJhdG9yIHVzZSBjYXNlLCBidXQgaXQgcmVvcGVucyB0aGlzIHRlYW0tYWRtaW4gdmVjdG9yLCBzbyB0aGUgYWNjZXPigKYifQ==
```
}

https://github.com/berriai/litellm/issues/31055 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA1NSIsImhlYWRsaW5lIjoiIzMxMDU1IFtCdWddOiBSZXNwb25zZXMgQVBJIHJlc3BfIGlkcyAoZW5jcnlwdGVkIGNvbnRlbnQgYWZmaW5pdHkpIGFyZSBvYmplY3Qtc3RvcmFnZS11bnNhZmUgYW5kIGJyZWFrIExhbmdGdXNlL1MzIHRyYWNlIGxvZ2dpbmciLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG1jb25ubGV5IiwiTGFiZWxzOiBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBXaGF0IGhhcHBlbmVkXG5cbldoZW4gYSBjbGllbnQgY2FsbHMgdGhlIHByb3h5J3MgYC92MS9yZXNwb25zZXNgIGZvciBhIG5vbi1PcGVuQUkgYmFja2VuZCAoc28gTGl0ZUxMTVxuYnJpZGdlcyBSZXNwb25zZXPihpJDaGF0KSwgdGhlIHJldHVybmVkIGByZXNwb25zZS5pZGAgaXMgYW4gZW5jcnlwdGVkIGJhc2U2NCBibG9iIG9mIHRoZVxuZm9ybSBgcmVzcF88YmFzZTY0dXJsPj1gICh0aGUgXCJlbmNyeXB0ZWQgY29udGVudCBhZmZpbml0eVwiIGlkIGVuY29kaW5nIGBtb2RlbF9pZGAgZXRjLikuXG5cbkxpdGVMTE0ncyBgbGFuZ2Z1c2VgIHN1Y2Nlc3MtY2FsbGJhY2sgdGhlbiBsb2dzIHRoaXMgaWQgYXMgdGhlIG9ic2VydmF0aW9uL2dlbmVyYXRpb25cbmlkLiBMYW5nRnVzZSB2MyB1c2VzIHRoZSBvYnNlcnZhdGlvbiBpZCAqKnZlcmJhdGltIGFzIHRoZSBTMy9NaW5JTyBvYmplY3Qga2V5KipcbihgPHByb2plY3RJZD4vb2JzZXJ2YXRpb24vPGlkPi88dXVpZD4uanNvbmApLiBUaGUgYmFzZTY0IHBhZGRpbmcvY2hhcnNldCBpcyByZWplY3RlZCBieVxuTWluSU86XG5cbmBgYFxuWE1pbmlvSW52YWxpZE9iamVjdE5hbWU6IE9iamVjdCBuYW1lIGNvbnRhaW5zIHVuc3VwcG9ydGVkIGNoYXJhY3RlcnNcbmBgYFxuXG5UaGUgYmxvYiB1cGxvYWQgYWJvcnRzIGF0IExhbmdGdXNlJ3MgaW5nZXN0aW9uICh3ZWIpIHN0YWdlLCBub3RoaW5nIGlzIGVucXVldWVkLCBhbmQgdGhlXG50cmFjZSBzaWxlbnRseSBuZXZlciBhcHBlYXJzLiBUaGUgTGl0ZUxMTSBjYWxsYmFjayBpdHNlbGYgcmV0dXJucyAyMDAsIHNvIGl0IGxvb2tzIGxpa2VcbnRyYWNpbmcgaXMganVzdCBicm9rZW4gd2l0aCBubyBlcnJvciBzdXJmYWNlZCB0byB0aGUgY2FsbGVyLlxuXG4jIyMgV2h5IHRoaXMgbWF0dGVyc1xuXG5gcmVzcF/igKY9YCBpcyB0ZWNobmljYWxseSBhIHZhbGlkIE9wZW5BSSBpZCwgYnV0IHVzaW5nIGJhc2U2NCAqKnBhZGRpbmcgKGA9YCkqKiAoYW5kXG5iYXNlNjR1cmwgY2hhcnNldCkgaW4gYW4gaWQgdGhhdCBkb3duc3RyZWFtIGxvZ2dpbmcgaW50ZWdyYXRpb25zIHJvdXRlIGludG9cbm9iamVjdC1zdG9yYWdlIGtleXMgaXMgdW5zYWZlLiBBV1MgUzMgdG9sZXJhdGVzIGA9YDsgTWluSU8gKGEgZmlyc3QtY2xhc3MsIHZlcnkgY29tbW9uXG5zZWxmLWhvc3RlZCBTMyB0YXJnZXQpIGRvZXMgbm90LiBBbnkgTGl0ZUxMTSB1c2VyIHBhaXJpbmcgdGhlIFJlc3BvbnNlc+KApiJ9
```
}

https://github.com/berriai/litellm/issues/31059 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA1OSIsImhlYWRsaW5lIjoiIzMxMDU5IFtCdWddIFN0cmVhbWluZyBSZXNwb25zZXMtQVBJIHNwZW5kIGxvZ3MgY2FuIGJlIGxvc3Q6IHN1Y2Nlc3MtaGFuZGxlciBhc3luY2lvLmNyZWF0ZV90YXNrKCkgaXMgbmV2ZXIgcmVmZXJlbmNlZCAoR0MgcmFjZSkiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHpoaXNodWkxMTAiXSwiZXhjZXJwdCI6IiMjIFdoYXQgaGFwcGVuZWRcblxuSW4gYFJlc3BvbnNlc0FQSVN0cmVhbWluZ0l0ZXJhdG9yYCwgdGhlIHN1Y2Nlc3MtbG9nZ2luZyBwYXRoIHNjaGVkdWxlcyBgbG9nZ2luZ19vYmouYXN5bmNfc3VjY2Vzc19oYW5kbGVyKC4uLilgIHZpYSBhIGJhcmUgYGFzeW5jaW8uY3JlYXRlX3Rhc2soLi4uKWAgd2hvc2UgcmV0dXJuZWQgYFRhc2tgIGlzICoqbmV2ZXIgc3RvcmVkIGFueXdoZXJlKiouXG5cblBlciB0aGUgYXN5bmNpbyBkb2NzLCB0aGUgZXZlbnQgbG9vcCBrZWVwcyBvbmx5IGEgKndlYWsqIHJlZmVyZW5jZSB0byB0YXNrcywgc28gYW4gdW4tcmVmZXJlbmNlZCB0YXNrIFwibWF5IGdldCBnYXJiYWdlIGNvbGxlY3RlZCBhdCBhbnkgdGltZSwgZXZlbiBiZWZvcmUgaXQncyBkb25lLlwiIFVuZGVyIGxvYWQg4oCUIG9yIHdoZW4gdGhlIGNsaWVudCBjb25uZWN0aW9uIGNsb3NlcyByaWdodCBhZnRlciB0aGUgc3RyZWFtIGVuZHMg4oCUIHRoaXMgc3VjY2Vzcy1sb2dnaW5nIHRhc2sgY2FuIGJlIGNvbGxlY3RlZCBiZWZvcmUgaXQgZmluaXNoZXMsIGFuZCB0aGUgc3BlbmQtbG9nIHJvdyBpcyB0aGVuIHNpbGVudGx5IG5ldmVyIHdyaXR0ZW4uIFRoZSBIVFRQIHJlc3BvbnNlIHRvIHRoZSBjbGllbnQgaXMgdW5hZmZlY3RlZCwgc28gdGhlIGxvc3MgaXMgaW52aXNpYmxlIGZyb20gdGhlIG91dHNpZGUuXG5cbiMjIFdoZXJlXG5cbmBsaXRlbGxtL3Jlc3BvbnNlcy9zdHJlYW1pbmdfaXRlcmF0b3IucHlgIChjdXJyZW50IGBtYWluYCwgY29tbWl0IGBkY2YxYjQ0NWU2YCwgdjEuOTAuMCkuXG5cbmBfbG9nX2NvbXBsZXRlZF9yZXNwb25zZSgpYCDigJQgdGhlIHNwZW5kLWxvZyBzdWNjZXNzIGhhbmRsZXIsICoqbm8gcmVmZXJlbmNlIGtlcHQqKjpcblxuYGBgcHl0aG9uXG4jIH5saW5lIDMyMlxuYXN5bmNpby5jcmVhdGVfdGFzayhcbiAgICBzZWxmLmxvZ2dpbmdfb2JqLmFzeW5jX3N1Y2Nlc3NfaGFuZGxlcihcbiAgICAgICAgcmVzdWx0PWxvZ2dpbmdfcmVzcG9uc2UsXG4gICAgICAgIHN0YXJ0X3RpbWU9c2VsZi5zdGFydF90aW1lLFxuICAgICAgICBlbmRfdGltZT1lbmRfdGltZSxcbiAgICAgICAgY2FjaGVfaGl0PXNlbGYuX2NvbXBsZXRlZF9yZXNwb25zZV9jYWNoZV9oaXQsXG4gICAgKVxuKVxuYGBgXG5cblNhbWUgcGF0dGVybiBhdCB+bGluZSAxMzQ4IChXZWJTb2NrZXQgcmVzcG9uc2VzIHN1Y2Nlc3MgcGF0aCk6XG5cbmBgYHB5dGhvblxuYXN5bmNpby5jcmVhdGVf4oCmIn0=
```
}

https://github.com/berriai/litellm/issues/31061 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA2MSIsImhlYWRsaW5lIjoiIzMxMDYxIHRpbWVvdXQgaXNzdWUgaW4gbG9uZyBwZGYiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHB2c3NyaWthbnRoIl0sImV4Y2VycHQiOiJIaSBcblxud2hlbiBsb2FkaW5nIGJpZyBkb2N1bWVudCAzMDArIHBhZ2VzIFxuXG5nZXR0aW5nIHRpbWVvdXQgZXJyb3Igd2l0aCBsb2NhbCBtb2RlbCAgIHJldHVybiBzZWxmLl9fcHlkYW50aWNfc2VyaWFsaXplcl9fLnRvX3B5dGhvbihcbnRvYyBmb3VuZFxuc3RhcnQgZGV0ZWN0X3BhZ2VfaW5kZXhcbmluZGV4IGZvdW5kXG5wcm9jZXNzX3RvY193aXRoX3BhZ2VfbnVtYmVyc1xuc3RhcnRfaW5kZXg6IDFcbnN0YXJ0IHRvY190cmFuc2Zvcm1lclxuXG5HaXZlIEZlZWRiYWNrIC8gR2V0IEhlbHA6IGh0dHBzOi8vZ2l0aHViLmNvbS9CZXJyaUFJL2xpdGVsbG0vaXNzdWVzL25ld1xuTGl0ZUxMTS5JbmZvOiBJZiB5b3UgbmVlZCB0byBkZWJ1ZyB0aGlzIGVycm9yLCB1c2UgYGxpdGVsbG0uX3R1cm5fb25fZGVidWcoKScuXG5cblxuUHJvdmlkZXIgTGlzdDogaHR0cHM6Ly9kb2NzLmxpdGVsbG0uYWkvZG9jcy9wcm92aWRlcnNcblxuKioqKioqKioqKioqKiBSZXRyeWluZyAqKioqKioqKioqKioqXG5FUlJPUjpyb290OkVycm9yOiBsaXRlbGxtLlRpbWVvdXQ6IEFQSVRpbWVvdXRFcnJvciAtIFJlcXVlc3QgdGltZWQgb3V0LiBFcnJvcl9zdHI6IFJlcXVlc3QgdGltZWQgb3V0LlxuXG5cbldJTEwgVEhJUyBTVVJFTFkgV09SSyBGT1IgSFVHRSBQREZTIDEwMDArIHBhZ2VzID8gXG5cbkhvdyB0byByZXNvbHZlIHRoZXNlIHRpbWVzb3V0cyJ9
```
}