https://github.com/berriai/litellm/issues/31551 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU1MSIsImhlYWRsaW5lIjoiIzMxNTUxIFtCdWddOiAgQW50aHJvcGljIC92MS9tZXNzYWdlcyByZXR1cm5zIEFQSUVycm9yIGZvciB2YWxpZCBPcGVuQUkgUmVzcG9uc2VzIEFQSSByZXNwb25zZSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAc3VtaXRhd3MiLCJMYWJlbHM6IGJ1ZywgbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbkhlbGxvIExpdGVMTE0gVGVhbSxcblxuSSdtIGVuY291bnRlcmluZyB3aGF0IGFwcGVhcnMgdG8gYmUgYSBidWcgaW4gTGl0ZUxMTSdzIEFudGhyb3BpYyBNZXNzYWdlcyBjb21wYXRpYmlsaXR5IGxheWVyLlxuYGBgXG5cbioqRW52aXJvbm1lbnQqKlxuXG4qIExpdGVMTE06IDEuOTAuMFxuKiBQcm92aWRlcjogT3BlbkNvZGUgQUlcbiogQVBJIEJhc2U6IGh0dHBzOi8vb3BlbmNvZGUuYWkvemVuL3YxXG4qIE1vZGVsOiBkZWVwc2Vlay12NC1mbGFzaC1mcmVlXG5cbioqQ29uZmlndXJhdGlvbioqXG5cbmBgYHlhbWxcbm1vZGVsX2xpc3Q6XG4gIC0gbW9kZWxfbmFtZTogZGVlcHNlZWstdjQtZmxhc2gtZnJlZVxuICAgIGxpdGVsbG1fcGFyYW1zOlxuICAgICAgbW9kZWw6IG9wZW5haS9kZWVwc2Vlay12NC1mbGFzaC1mcmVlXG4gICAgICBhcGlfYmFzZTogaHR0cHM6Ly9vcGVuY29kZS5haS96ZW4vdjFcbiAgICAgIGFwaV9rZXk6IDxSRURBQ1RFRD5cbmBgYFxuXG4qKk9ic2VydmVkIGJlaGF2aW9yKipcblxuVGhlIENoYXQgQ29tcGxldGlvbnMgZW5kcG9pbnQgd29ya3MgY29ycmVjdGx5OlxuXG5gYGBcblBPU1QgL3YxL2NoYXQvY29tcGxldGlvbnNcbmBgYFxuXG5yZXR1cm5zIGEgbm9ybWFsIHJlc3BvbnNlLlxuXG5Ib3dldmVyLCB0aGUgQW50aHJvcGljIE1lc3NhZ2VzIGVuZHBvaW50OlxuXG5gYGBcblBPU1QgL3YxL21lc3NhZ2VzXG5gYGBcblxuZmFpbHMgd2l0aDpcblxuYGBgXG5saXRlbGxtLkFQSUVycm9yOiBBUElFcnJvcjogT3BlbkFJRXhjZXB0aW9uIC4uLlxuYGBgXG5gYGBcblxuZXZlbiB0aG91Z2ggdGhlIHVwc3RyZWFtIHByb3ZpZGVyIHJldHVybnMgSFRUUCAyMDAgd2l0aCBhIHZhbGlkIE9wZW5BSSBSZXNwb25zZXMgQVBJIG9iamVjdCBzdWNoIGFzOlxuXG5gYGBcbmBgYGpzb25cbntcbiAgXCJvYmplY3RcIjogXCJyZXNwb25zZVwiLFxuICBcIm1vZGVsXCI6IFwiZGVlcHNlZWstdjQtZmxhc2gtZnJlZVwiLFxuICBcIm91dHB1dFwiOiBbXG4gICAge1xuICAgICAgXCJ0eXBlXCI6IFwibWVzc2FnZVwiLFxuICAgICAgXCJyb2xlXCI6IFwiYXNzaXN0YW50XCIsXG4gICAgICBcInN0YXR1c1wiOiBcImNvbXBsZXRlZFwiLFxuICAgICAgXCJjb250ZW50XCI6IFtcbiAgICAgICAge1xuICAgICAgICDigKYifQ==
```
}

https://github.com/berriai/litellm/issues/31553 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU1MyIsImhlYWRsaW5lIjoiIzMxNTUzIFtCdWddOiB1bmV4cGVjdGVkIGJsYW5rIGFzc2lzdGFudCBtZXNzYWdlIGFmdGVyIGFuIGFzc2lzdGFudCBtZXNzYWdlIHdpdGggXCJ0b29sIGNhbGxzXCIiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQEJpb3RpY1IiLCJMYWJlbHM6IGJ1ZywgcHJveHksIGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMjIENoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcblxuLSBbeF0gSSBoYXZlIHNlYXJjaGVkIHRoZSBleGlzdGluZyBpc3N1ZXMgYW5kIGNoZWNrZWQgdGhhdCBteSBpc3N1ZSBpcyBub3QgYSBkdXBsaWNhdGUuXG5cbiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5BbiB1bmV4cGVjdGVkIGJsYW5rIGFzc2lzdGFudCBtZXNzYWdlIGVtZXJnZWQgaW4gdGhlIExpdGVsbG0gQUkgR2F0ZXdheSdzIGNvbm5lY3Rpb24gd2l0aCBEZWVwc2VlaydzIHNlcnZlcidzIGNoYXQgY29tcGxldGlvbiBBUEkgd2hpbGUgSSB3YXMgdXNpbmcgY29kZXgsIHdoaWNoIHVzZWQgdGhlIGAvcmVzcG9uc2VzYCBlbmRwb2ludCBvZiB0aGUgTGl0ZWxsbSBBSSBHYXRld2F5IGFuZCB0aGUgbW9kZWwgYGRlZXBzZWVrIHY0IGZsYXNoYC4gVGhpcyByYWlzZWQgYW4gYEhUVFAgNDAwYCBlcnJvciBmcm9tIERlZXBzZWVrJ3Mgc2VydmVyOiBcbmB7XCJlcnJvclwiOntcIm1lc3NhZ2VcIjpcIkFuIGFzc2lzdGFudCBtZXNzYWdlIHdpdGggJ3Rvb2xfY2FsbHMnIG11c3QgYmUgZm9sbG93ZWQgYnkgdG9vbCBtZXNzYWdlcyByZXNwb25kaW5nIHRvIGVhY2ggJ3Rvb2xfY2FsbF9pZCcuIChpbnN1ZmZpY2llbnQgdG9vbCBtZXNzYWdlcyBmb2xsb3dpbmcgdG9vbF9jYWxscyBtZXNzYWdlKVwiLFwidHlwZVwiOlwiaW52YWxpZF9yZXF1ZXN0X2Vycm9yXCIsXCJwYXJhbVwiOm51bGwsXCJjb2RlXCI6XCJpbnZhbGlkX3JlcXVlc3RfZXJyb3JcIn19LiBSZWNlaXZlZCBNb2RlbCBHcm91cD1kZWVwc2Vlay12NC1mbGFzaFxuQXZhaWxhYmxlIE1vZGVsIEdyb3VwIEZhbGxiYWNrcz1Ob25lYFxuSW52b2x2ZWQgbWVzc2FnZXMgd2VyZTogYFt7XCJ0b29sX2NhbGxzXCI6IFt7XCJpZFwiOiBcImNhbGxfMDBfc3ByNlpsaHFGdjc0dkpFbWlEYko4NDAwXCIsXCJ0eXBlXCI6IFwiZnVuY3Rpb25cIixcImZ1bmN0aW9uXCI6IHtcIm5hbWVcIjogXCJzaGVsbF9jb21tYW5kXCIsXCJhcmd1bWVudHNcIjogXCJ7XFxcImNvbW1hbmRcXFwiOiBcXFwiR2V0LUNoaWxkSXRlbSAtUGF0aCBcXFxcXFxcIkQ6XFxcXFxcXFw2Mjblt6XnqItcXFxcXFxcIiAtRGVwdGggMFxcXCIsIFxcXCJ0aW1lb3V0X21zXFxcIjo1MDAwfVwifSxcImluZGV4XCI6IDB9XSxcInJvbGVcIjogXCJhc3Npc3RhbnRcIn0se1wicm9sZVwiOiBcImFzc2lzdGFudFwiLFwiY29udGVudFwiOiBbe1widHlwZVwiOiBcInRleHRcIixcInRleHRcIjogXCJcIn1dfV1gXG5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBDb25maWd1cmUgdGhlIExpdGVsbG0gQUkgR2F0ZXdheSDigKYifQ==
```
}

https://github.com/berriai/litellm/issues/31555 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU1NSIsImhlYWRsaW5lIjoiIzMxNTU1IFtGZWF0dXJlXTogT3B0aW9uYWwgTWFya292LUJhc2VkIFJvdXRpbmcgU3RyYXRlZ3kgZm9yIEFkYXB0aXZlIFRva2VuIENvc3QgQXJiaXRyYWdlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBUaWJvMjQwMyIsIkxhYmVsczogZW5oYW5jZW1lbnQiXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgVGhlIEZlYXR1cmVcblxuSW50cm9kdWNlIGFuIG9wdGlvbmFsIHJvdXRpbmcgc3RyYXRlZ3kgYmFzZWQgb24gYSBNYXJrb3YgZGVjaXNpb24gcHJvY2VzcyB0aGF0IGNvbnRpbnVvdXNseSBhZGp1c3RzIHByb3ZpZGVyIHNlbGVjdGlvbiBhY2NvcmRpbmcgdG8gcmVhbC10aW1lIG9wZXJhdGlvbmFsIG1ldHJpY3MuXG5cbkluc3RlYWQgb2YgcmVseWluZyBzb2xlbHkgb24gc3RhdGljIHByaW9yaXRpZXMgb3IgcmVhY3RpdmUgZmFsbGJhY2tzLCB0aGUgcm91dGVyIHdvdWxkIGR5bmFtaWNhbGx5IGFkYXB0IHRyYW5zaXRpb24gcHJvYmFiaWxpdGllcyBiZXR3ZWVuIHByb3ZpZGVycyB1c2luZyBzaWduYWxzIHN1Y2ggYXM6XG5cbi0gdG9rZW4gY29zdFxuLSBsYXRlbmN5XG4tIGVycm9yIHJhdGVcbi0gcHJvdmlkZXIgaGVhbHRoXG4tIHF1b3RhIG9yIHJhdGUtbGltaXQgdXRpbGl6YXRpb25cbi0gb3B0aW9uYWwgcXVhbGl0eSBtZXRyaWNzXG5cbkFzIHByb3ZpZGVyIGNvbmRpdGlvbnMgZXZvbHZlLCB0cmFmZmljIHdvdWxkIG5hdHVyYWxseSBzaGlmdCB0b3dhcmQgcHJvdmlkZXJzIGRlbGl2ZXJpbmcgdGhlIGJlc3Qgb3ZlcmFsbCBjb3N0LXBlcmZvcm1hbmNlLXJlbGlhYmlsaXR5IGJhbGFuY2UuXG5cblRoZSBzdHJhdGVneSB3b3VsZCByZW1haW4gZW50aXJlbHkgb3B0LWluIGFuZCBkaXNhYmxlZCBieSBkZWZhdWx0LCBwcmVzZXJ2aW5nIGZ1bGwgYmFja3dhcmQgY29tcGF0aWJpbGl0eSB3aXRoIExpdGVMTE0ncyBleGlzdGluZyByb3V0aW5nIGJlaGF2aW9yLlxuXG4jIyMgTW90aXZhdGlvbiwgcGl0Y2hcblxuTGl0ZUxMTSBhbHJlYWR5IHByb3ZpZGVzIGV4Y2VsbGVudCByZXRyeSwgZmFsbGJhY2ssIGFuZCBsb2FkLWJhbGFuY2luZyBjYXBhYmlsaXRpZXMuIFRoZXNlIG1lY2hhbmlzbXMgYXJlIGhpZ2hseSBlZmZlY3RpdmUgb25jZSBhIHByb3ZpZGVyIGhhcyBmYWlsZWQgb3IgYmVjb21lIHVuYXZhaWxhYmxlLlxuXG5Ib3dldmVyLCBtYW55IHByb2R1Y3Rpb24gaXNzdWVzIGFyaXNlIGJlZm9yZSBhIHByb3ZpZGVyIGFjdHVhbGx5IGZhaWxzLlxuXG5Gb3IgZXhhbXBsZSwgYSBwcm92aWRlciBtYXkgZ3JhZHVhbGx5IGJlY29tZSBtb+KApiJ9
```
}

https://github.com/berriai/litellm/issues/31557 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU1NyIsImhlYWRsaW5lIjoiIzMxNTU3IEZhbGxiYWNrIGNoYWluIHNpbGVudGx5IGZhaWxzIHdoZW4gZmFsbGJhY2sgbW9kZWwgaGFzIHNtYWxsZXIgY29udGV4dCB3aW5kb3cgdGhhbiBwcmltYXJ5Iiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEB0dHhzNjkiLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiJdLCJleGNlcnB0IjoiIyMgT2JzZXJ2ZWQgYmVoYXZpb3JcblxuV2hlbiBhIFJvdXRlciBpcyBjb25maWd1cmVkIHdpdGggYSBnZW5lcmljIGBmYWxsYmFja3NgIGxpc3QgYW5kIHRoZSBwcmltYXJ5IG1vZGVsIGZhaWxzIGZvciBhIG5vbi1jb250ZXh0IHJlYXNvbiAocmF0ZSBsaW1pdCwgdGltZW91dCwgc2VydmVyIGVycm9yKSwgdGhlIHNhbWUgYG1lc3NhZ2VzYCBwYXlsb2FkIGlzIGZvcndhcmRlZCB0byBlYWNoIGZhbGxiYWNrIG1vZGVsIGFzLWlzLiBJZiBhIGZhbGxiYWNrIG1vZGVsIGhhcyBhIHNtYWxsZXIgYG1heF9pbnB1dF90b2tlbnNgIHRoYW4gdGhlIHByaW1hcnkgYW5kIHRoZSByZXF1ZXN0IGV4Y2VlZHMgdGhlIGZhbGxiYWNrJ3MgY29udGV4dCB3aW5kb3csIHRoZSBmYWxsYmFjayByYWlzZXMgYENvbnRleHRXaW5kb3dFeGNlZWRlZEVycm9yYCBhbmQgdGhlIGNoYWluIGVuZHMuIE5vIHByZWZsaWdodCB0b2tlbiBjb3VudGluZyBvciBtZXNzYWdlIHRyaW1taW5nIGhhcHBlbnMgYmV0d2VlbiBmYWxsYmFja3MuXG5cblJlcHJvIChyb3V0ZXIgY29uZmlnKTpcblxuYGBgeWFtbFxubW9kZWxfbGlzdDpcbiAgLSBtb2RlbF9uYW1lOiBncHQtNC10dXJib1xuICAgIGxpdGVsbG1fcGFyYW1zOlxuICAgICAgbW9kZWw6IGdwdC00LXR1cmJvXG4gICAgICBhcGlfa2V5OiBvcy5lbnZpcm9uL09QRU5BSV9BUElfS0VZXG4gIC0gbW9kZWxfbmFtZTogZ3B0LTRcbiAgICBsaXRlbGxtX3BhcmFtczpcbiAgICAgIG1vZGVsOiBncHQtNFxuICAgICAgYXBpX2tleTogb3MuZW52aXJvbi9PUEVOQUlfQVBJX0tFWVxucm91dGVyX3NldHRpbmdzOlxuICBmYWxsYmFja3M6XG4gICAgLSBncHQtNC10dXJibzogW2dwdC00XVxuYGBgXG5cblNlbmQgYSB+MTBLLXRva2VuIHJlcXVlc3QuIElmIHRoZSBwcmltYXJ5IGZhaWxzIG9uIGEgcmF0ZSBsaW1pdCAob3IgYW55IG5vbi1jb250ZXh0IGVycm9yKSwgdGhlIGZhbGxiYWNrIGBncHQtNGAgKGBtYXhfaW5wdXRfdG9rZW5zPTgxOTJgKSByZWNlaXZlcyB0aGUgc2FtZSBwYXlsb2FkIGFuZCBmYWlscyB3aXRoIGBDb250ZXh0V2luZG93RXhjZWVkZWRFcnJvcmAuIFRoZSB1c2VyIGdldHMgYSBjb250ZXh0LXdpbmRvdyBlcnJvciBmcm9tIHRoZSBmYWxsYmFjaywgd2l0aCBubyBpbmRpY2F0aW9uIHRoYXQgdGhlIGZhbGxiYWNrIHdhcyBhIGJhZCBjaG9pY2UuXG5cbiMjIFdoeSB0aGlzIGhhcHBlbnNcblxuSW4gYGxpdGVsbG0vcm91dGVyX3V0aeKApiJ9
```
}

https://github.com/berriai/litellm/issues/31562 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU2MiIsImhlYWRsaW5lIjoiIzMxNTYyIFtCdWddOiBCYXNlTW9kZWxSZXNwb25zZUl0ZXJhdG9yIGZhbHNlbHkgdGVybWluYXRlcyBzdHJlYW0gd2hlbiB0b29sLWNhbGwgYXJndW1lbnRzIGNvbnRhaW4gXCJbRE9ORV1cIiIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAY2hlbmJvamlhbiIsIkxhYmVsczogbGxtIHRyYW5zbGF0aW9uIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbmBCYXNlTW9kZWxSZXNwb25zZUl0ZXJhdG9yLl9oYW5kbGVfc3RyaW5nX2NodW5rYCB1c2VzIGEgc3Vic3RyaW5nIGNoZWNrIChgaWYgXCJbRE9ORV1cIiBpbiBzdHJfbGluZWApIHRvIGRldGVjdCB0aGUgU1NFIHRlcm1pbmF0aW9uIHNpZ25hbC4gVGhpcyBjYXVzZXMgZmFsc2Ugc3RyZWFtIHRlcm1pbmF0aW9uIHdoZW4gYSBwcm92aWRlciBzZW5kcyBhIHZhbGlkIEpTT04gY2h1bmsgd2hvc2Ugc3RyaW5nIHZhbHVlcyBoYXBwZW4gdG8gY29udGFpbiB0aGUgbGl0ZXJhbCBcIltET05FXVwiLlxuXG5Gb3IgZXhhbXBsZSwgaWYgYSBtb2RlbCBnZW5lcmF0ZXMgYSB0b29sIGNhbGwgd2l0aCBhcmd1bWVudHMgbGlrZSBge1wiY29tbWFuZFwiOiBcIltET05FXSByZXNldFwifWAsIG9yIGFueSBKU09OIHBheWxvYWQgY29udGFpbmluZyBcIltET05FXVwiIGFzIGEgc3Vic3RyaW5nLCB0aGUgc3RyZWFtIGlzIHByZW1hdHVyZWx5IGN1dCBvZmYuIFRoZSB1c2VyIHNlZXMgYSB0cnVuY2F0ZWQgcmVzcG9uc2Ugd2l0aCBubyBlcnJvci5cblxuVGhpcyBhZmZlY3RzIGFsbCBwcm92aWRlcnMgdXNpbmcgYEJhc2VNb2RlbFJlc3BvbnNlSXRlcmF0b3JgOiBEYXRhYnJpY2tzLCBPcGVuUm91dGVyLCBPVkhDbG91ZCwgQ2xvdWRmbGFyZSwgVHJpdG9uLCBBMkEsIFdhdHNvbngsIEFudGhyb3BpYyBjb21wbGV0aW9uLCBPbGxhbWEsIENvbWV0QVBJLCBCZWRyb2NrIERlZXBTZWVrLCBWZXJ0ZXggQUkgYWdlbnQgZW5naW5lLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cblVzaW5nIGFueSBwcm92aWRlciB0aGF0IHJvdXRlcyB0aHJvdWdoIGBCYXNlTW9kZWxSZXNwb25zZUl0ZXJhdG9yYCwgdHJpZ2dlciBhIHN0cmVhbWluZyByZXNwb25zZSB3aGVyZSB0aGUgbW9kZWwncyBvdXRwdXQgY29udGFpbnMgdGhlIGxpdGVyYWwgc3RyaW5nIFwiW0RPTkVdXCIgaW5zaWRlIEpTT04gY29udGVudCAoZS5nLiBpbnNpZGUgdG9vbC1jYWxsIGFyZ3VtZW50cykuXG5cblRoZSBzaW1wbGVzdCBwcm9ncmFtbWF0aWMgcmVwcm9kdWN0aW9uOlxuXG5gYGBweXRob25cbmZyb20gbGl0ZWxsbS5sbG1zLmJhc2VfbGxtLmJhc2VfbW9kZWxfaXRl4oCmIn0=
```
}

https://github.com/berriai/litellm/issues/31568 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU2OCIsImhlYWRsaW5lIjoiIzMxNTY4IFtGZWF0dXJlXTogQWRkIE9wZW5Db2RlIEdvIHByb3ZpZGVyIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBjb2dlbnRQYXJhZGlnbSIsIkxhYmVsczogZW5oYW5jZW1lbnQsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgVGhlIEZlYXR1cmVcblxuSSB3b3VsZCBsaWtlIHRvIGhhdmUgT3BlbkNvZGUgR28gYXMgYSBwcm92aWRlci4gU29tZSB0aGluZ3MgdG8gbm90ZSBmcm9tIHRoZSBPcGVuQ29kZSBjbGllbnQncyBpbXBsZW1lbnRhdGlvbiBvZiB0aGUgT3BlbkNvZGUgR28gcHJvdmlkZXI6XG5cbi0gSXQgbG9hZHMgY29zdCBpbmZvcm1hdGlvbiBmcm9tIGh0dHBzOi8vbW9kZWxzLmRldi9hcGkuanNvbi5cbi0gSXQgdXNlcyBhbiBvcGVuYWkgc3R5bGUgZW5kcG9pbnQgYnkgZGVmYXVsdCwgYnV0IHNvbWUgbW9kZWxzIHVzZSBhbnRocm9waWMgc3R5bGUgZW5kcG9pbnRzLiBUaGlzIGlzIGluZGljYXRlZCBpbiB0aGUgbW9kZWxzLmRldiBlbmRwb2ludCB3aGVuIGEgbW9kZWwgaGFzIHByb3ZpZGVyLm5wbSA9IFwiQGFpLXNkay9hbnRocm9waWNcIi5cblxuIyMjIE1vdGl2YXRpb24sIHBpdGNoXG5cbkFkZGluZyBhIGN1c3RvbSBwcm92aWRlciB3b3VsZCBhbGxvdzpcblxuLSBhdmFpbGFibGUgbW9kZWxzIHRvIGJlIGxvYWRlZCBhdXRvbWF0aWNhbGx5XG4tIHRva2VuIHVzYWdlIGNvc3RzIHRvIGJlIGNhbGN1bGF0ZWRcbi0gVGhlIGNvcnJlY3QgcHJvdmlkZXIgdG8gYmUgbGlzdGVkIGluIFVzYWdlXG5cbiMjIyBXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0P1xuXG5Qcm94eVxuXG4jIyMgTGl0ZUxMTSBpcyBoaXJpbmcgYSBmb3VuZGluZyBiYWNrZW5kIGVuZ2luZWVyLCBhcmUgeW91IGludGVyZXN0ZWQgaW4gam9pbmluZyB1cyBhbmQgc2hpcHBpbmcgdG8gYWxsIG91ciB1c2Vycz9cblxuTm8ifQ==
```
}

https://github.com/berriai/litellm/issues/31569 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU2OSIsImhlYWRsaW5lIjoiIzMxNTY5IFtCdWddOiBXZWJTZWFyY2ggSW50ZXJjZXB0aW9uIGVtaXRzIHdlYl9zZWFyY2hfdG9vbF9yZXN1bHQgd2l0aCBub24tc3J2dG9vbHVfIHRvb2xfdXNlX2lkIOKGkiBtdWx0aS10dXJuIDQwMCBvbiBCZWRyb2NrIENsYXVkZSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAa2sxMzciLCJMYWJlbHM6IGxsbSB0cmFuc2xhdGlvbiwgY2xhdWRlIGNvZGUiXSwiZXhjZXJwdCI6IiMjIyBXaGF0IGhhcHBlbmVkP1xuXG5XaGVuIFdlYlNlYXJjaCBJbnRlcmNlcHRpb24gaXMgdXNlZCBmb3IgKipCZWRyb2NrKiogQW50aHJvcGljIENsYXVkZSBtb2RlbHMgKHdoaWNoIGhhdmUgbm8gbmF0aXZlIHdlYiBzZWFyY2gpLCB0aGUgKiphZ2VudGljLWxvb3AqKiBwYXRoIGVtaXRzIGB3ZWJfc2VhcmNoX3Rvb2xfcmVzdWx0YCBibG9ja3Mgd2hvc2UgYHRvb2xfdXNlX2lkYCBpcyB0aGUgbW9kZWwncyBvcmlnaW5hbCBjbGllbnQgdG9vbCBpZCAoYHRvb2x1Xy4uLmApLCBub3QgYSBgc3J2dG9vbHVfYC1wcmVmaXhlZCBzZXJ2ZXItdG9vbCBpZC4gU2luZ2xlLXR1cm4gd29ya3MsIGJ1dCBvbiAqKm11bHRpLXR1cm4qKiByZXF1ZXN0cyAocm91bmQgMispIHRoZSBjbGllbnQgcmVwbGF5cyB0aGUgcHJpb3IgYXNzaXN0YW50IHR1cm4gY29udGFpbmluZyB0aGF0IGJsb2NrLCBhbmQgdGhlIEFudGhyb3BpYyBNZXNzYWdlcyBzY2hlbWEgKHdoaWNoIEJlZHJvY2sgaW5oZXJpdHMgdmlhIHRoZSBBbnRocm9waWNCZWRyb2NrIHNoYXBlKSByZWplY3RzIGl0OlxuXG5gYGBcbm1lc3NhZ2VzLjEuY29udGVudC4wLndlYl9zZWFyY2hfdG9vbF9yZXN1bHQudG9vbF91c2VfaWQ6IFN0cmluZyBzaG91bGQgbWF0Y2ggcGF0dGVybiAnXnNydnRvb2x1X1thLXpBLVowLTlfXSsnXG5gYGBcblxuVGhpcyBtYWtlcyBtdWx0aS10dXJuIHdlYiBzZWFyY2ggKGUuZy4gQ2xhdWRlIENvZGUncyBub3JtYWwgdXNhZ2UpIGZhaWwgd2l0aCBhIDQwMCBvbiB0aGUgc2Vjb25kIHR1cm4uXG5cbiMjIyBSb290IGNhdXNlXG5cbkluIGBsaXRlbGxtL2ludGVncmF0aW9ucy93ZWJzZWFyY2hfaW50ZXJjZXB0aW9uL2hhbmRsZXIucHlgIHRoZXJlIGFyZSB0d28gcGF0aHMgdGhhdCBlbWl0IG5hdGl2ZSBgd2ViX3NlYXJjaF90b29sX3Jlc3VsdGAgYmxvY2tzLCBhbmQgdGhleSBoYW5kbGUgYHRvb2xfdXNlX2lkYCBpbmNvbnNpc3RlbnRseTpcblxuKipTaG9ydC1jaXJjdWl0IHBhdGggKGNvcnJlY3QpKiog4oCUIGdlbmVyYXRlcyBhIGBzcnZ0b29sdV9gIGlkIGFuZCBwYWlycyBpdCB3aXRoIGEgYHNlcnZlcl90b29sX3VzZWAgYmxvY2s6XG5cbmBgYHB5dGhvblxuIyBoYW5kbGVyLnB5ICh2MS45MC4wKSB+bGluZSAxOTBcbnRvb2xfdXNlX2lkID0gZlwic3J2dG9vbHVfe3V1aWQudXVpZDQoKS5oZXh9XCJcbi4uLlxuY29udGVudC5hcHBlbmQoe1widHlwZVwiOiBcInNlcnZlcl90b29sX3VzZeKApiJ9
```
}

https://github.com/berriai/litellm/issues/31586 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU4NiIsImhlYWRsaW5lIjoiIzMxNTg2IFtCdWddOiBodHRwIC0+IGh0dHBzIGlzc3VlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBtYXR0ZW8tcmFtYSIsIkxhYmVsczogYnVnIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbmkgaGF2ZSBkZXBsb3llZCBsaXRlbGxtIHZpYSBoZWxtIGNoYXJ0LlxudGhlIGluZ3Jlc3MgY29udHJvbGxlciBzcGVhayBcImh0dHBcIiB3aXRoIHRoZSBvdXRzaWRlIHBhcnQgb2YgY2x1c3Rlci5cbm91dHNpZGUgY2x1c3RlciBpIGhhdmUgYSB0bHMgdGVybWluYXRpb24sIHNvIGNsaWVudCBhcnJpdmUgdmlhIGh0dHBzXG5cbnRoZSBkcmF3aW5nIGlzXG5cbmh0dHBzIC0tPiBOR0lOWCAtLS0+IGh0dHAgLS0+IEtVQkUgLS0+IGh0dHAgLS0+IGxpdGVsbG1cblxud2hhdCBoYXBwZW4gb2Z0ZW4gYW5kIGl0J3MgaGFyZCB0byB0cmFjayBmb3IgbWUgIGlzIHRoYXQgaSBnb3QgYSBmZXcgcmVkaXJlY3QgdG8gaHR0cFxuXG5leGFtcGxlXG5cbmBcbmh0dHA6Ly9saXRlbGxtLms4cy5mYWJyaWNrLmRtei50c3QvdWkvbG9naW4vP3JlZGlyZWN0X3RvPWh0dHBzJTNBJTJGJTJGbGl0ZWxsbS5rOHMuZmFicmljay5kbXoudHN0JTJGdWklMkZtY3Atc2VydmVycyUyRlxuYFxuXG50aGUgXCJyZWRpcmVjdF90b1wiIGlzIGFjdHVhbGx5IGNvcnJlY3QgKGh0dHBzKVxud2hpbGUgdGhlICdyZWFsJyByZWRpcmVjdCB3YXMgaHR0cFxuXG5cbmkgZGlkIHNldCBpbiB0aGUgaGVsbSBjaGFydFxuXG5gYGBcbmVudlZhcnM6XG4gIFBST1hZX0JBU0VfVVJMOiBcImh0dHBzOi8vbGl0ZWxsbS5rOHMuZmFicmljay5kbXoudHN0XCJcbiAgRk9SV0FSREVEX0FMTE9XX0lQUzogXCIqXCJcbmBgYFxuXG5cblxuXG5cblxuIyMjIFN0ZXBzIHRvIFJlcHJvZHVjZVxuXG4xLiBcbjIuIFxuMy4gXG5cblxuIyMjIFJlbGV2YW50IGxvZyBvdXRwdXRcblxuYGBgc2hlbGxcblxuYGBgXG5cbiMjIyBXaGF0IHBhcnQgb2YgTGl0ZUxMTSBpcyB0aGlzIGFib3V0P1xuXG5fTm8gcmVzcG9uc2VfXG5cbiMjIyBXaGF0IExpdGVMTE0gdmVyc2lvbiBhcmUgeW91IG9uID9cblxudjEuOTAuMFxuXG4jIyMgVHdpdHRlciAvIExpbmtlZEluIGRldGFpbHNcblxuX05vIHJlc3BvbnNlXyJ9
```
}

https://github.com/berriai/litellm/issues/31587 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU4NyIsImhlYWRsaW5lIjoiIzMxNTg3IFtCdWddOiAvdjEvc2tpbGxzIHJldHVybnMgNTAwIHdoZW4gQU5USFJPUElDX0FQSV9LRVkgaXMgbm90IGNvbmZpZ3VyZWQgb3IgaW52YWxpZCIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAaWhhbm5zZW4iLCJMYWJlbHM6IHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IkNoZWNrIGZvciBleGlzdGluZyBpc3N1ZXNcbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG5XaGF0IGhhcHBlbmVkP1xuV2hlbiBjYWxsaW5nIGBHRVQgL3YxL3NraWxsc2Agb24gdGhlIExpdGVMTE0gcHJveHkgKHYxLjkwLjApIHdpdGhvdXQgYSB2YWxpZCBBTlRIUk9QSUNfQVBJX0tFWSwgdGhlIGVuZHBvaW50IHJldHVybnMgSFRUUCA1MDAgd2l0aCBhIFB5ZGFudGljIFZhbGlkYXRpb25FcnJvciBpbnN0ZWFkIG9mIGdyYWNlZnVsbHkgcmV0dXJuaW5nIGFuIGVtcHR5IHNraWxscyBsaXN0LlxuXG5UaGUgZXJyb3Igb2NjdXJzIGluIHR3byBzY2VuYXJpb3M6XG4xLiBObyBBTlRIUk9QSUNfQVBJX0tFWSBzZXQ6IGBWYWx1ZUVycm9yOiBBTlRIUk9QSUNfQVBJX0tFWSBvciBBTlRIUk9QSUNfQVVUSF9UT0tFTiBpcyByZXF1aXJlZCBmb3IgU2tpbGxzIEFQSWBcbjIuIEludmFsaWQgQU5USFJPUElDX0FQSV9LRVkgc2V0OiBgcHlkYW50aWNfY29yZS5fcHlkYW50aWNfY29yZS5WYWxpZGF0aW9uRXJyb3I6IDEgdmFsaWRhdGlvbiBlcnJvciBmb3IgTGlzdFNraWxsc1Jlc3BvbnNlIGRhdGEgRmllbGQgcmVxdWlyZWRgXG5cblRoaXMgYnJlYWtzIGNsaWVudHMgdGhhdCBhdXRvbWF0aWNhbGx5IGNhbGwgYC92MS9za2lsbHNgIG9uIHN0YXJ0dXAgKGUuZy4sIHBpLWFnZW50IHdpdGggcGktcHJvdmlkZXItbGl0ZWxsbSkuXG5cblN0ZXBzIHRvIFJlcHJvZHVjZVxuMS4gU3RhcnQgTGl0ZUxMTSBwcm94eSBXSVRIT1VUIGBBTlRIUk9QSUNfQVBJX0tFWWAgc2V0IChvciB3aXRoIGEgZmFrZSBrZXkgbGlrZSBgc2stZHVtbXlgKVxuMi4gQ2FsbCBgR0VUIC92MS9za2lsbHNgIHdpdGggdmFsaWQgTGl0ZUxMTSBhdXRoXG4zLiBSZWNlaXZlIEhUVFAgNTAwXG5cblJlbGV2YW50IGxvZyBvdXRwdXRcbmBgYFxucHlkYW50aWNfY29yZS5fcHlkYW50aWNfY29yZS5WYWxpZGF0aW9uRXJyb3I6IDEgdmFsaWRhdGlvbiBlcnJvciBmb3IgTGlzdFNraWxsc1Jlc3BvbnNlXG5kYXRhIEZpZWxkIHJlcXVpcmVkIFt0eXBlPW1pc3NpbmcsIGlucHV0X3ZhbHVlPXsndHlwZSc6ICdlcnJvcicsICdlcnJvcicuLi59XVxuICBGaWxlIFwiL2FwcC8udmVudi9saWIvcHl0aG9uMy4xMy9zaXRlLXBhY2thZ2VzL2xpdGVsbG0vc2tpbGxzL21haW4ucHlcIiwgbGluZSAzMTYs4oCmIn0=
```
}

https://github.com/berriai/litellm/issues/31594 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTU5NCIsImhlYWRsaW5lIjoiIzMxNTk0IFtCdWddOiBjb3N0X2JyZWFrZG93biBtaXNzaW5nIGNhY2hlX3JlYWRfY29zdC9jYWNoZV9jcmVhdGlvbl9jb3N0IGZvciBEZWVwU2VlayAvIE9wZW5BSS1jb21wYXRpYmxlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBlcmRqaWVsIiwiTGFiZWxzOiBidWcsIHByb3h5LCBsbG0gdHJhbnNsYXRpb24iXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuV2hlbiBwcm9tcHRpbmcgRGVlcFNlZWsgKipkaXJlY3RseSoqLCB0aGUgQVBJIHJlc3BvbnNlIGluY2x1ZGVzIGNhY2hlIHRva2VuIGluZm9ybWF0aW9uIGluIGB1c2FnZS5wcm9tcHRfdG9rZW5zX2RldGFpbHMuY2FjaGVkX3Rva2Vuc2AuIEZvciBleGFtcGxlLCBhIGNhY2hlLWhpdCByZXNwb25zZSBmcm9tIERlZXBTZWVrIGxvb2tzIGxpa2U6XG5cbmBgYGpzb25cbntcbiAgXCJ1c2FnZVwiOiB7XG4gICAgXCJwcm9tcHRfdG9rZW5zXCI6IDEzNjE1MyxcbiAgICBcImNvbXBsZXRpb25fdG9rZW5zXCI6IDQxOCxcbiAgICBcInByb21wdF90b2tlbnNfZGV0YWlsc1wiOiB7XG4gICAgICBcImNhY2hlZF90b2tlbnNcIjogMTM1OTM2XG4gICAgfVxuICB9XG59XG5gYGBcblxuV2hlbiByb3V0aW5nIHRoZSAqKnNhbWUgcmVxdWVzdCB0aHJvdWdoIExpdGVMTE0gUHJveHkqKiwgdGhlIHNwZW5kIGxvZydzIGBjb3N0X2JyZWFrZG93bmAgb25seSBzaG93cyBgaW5wdXRfY29zdGAsIGBvdXRwdXRfY29zdGAsIGFuZCBgdG90YWxfY29zdGAg4oCUICoqbm8gYGNhY2hlX3JlYWRfY29zdGAgZmllbGQgYXBwZWFycyoqLCBldmVuIHRob3VnaCB0aGUgcHJveHkgYWxyZWFkeSBhcHBsaWVkIHRoZSBjb3JyZWN0IGNhY2hlIGRpc2NvdW50IHRvIHRoZSB0b3RhbC4gVGhlIGJyZWFrZG93biBpcyBvcGFxdWU6IHRoZXJlJ3Mgbm8gd2F5IHRvIHNlZSBob3cgbXVjaCBvZiBgaW5wdXRfY29zdGAgY2FtZSBmcm9tIGNhY2hlIGhpdHMgdnMgY2FjaGUgbWlzc2VzLlxuXG5UaGUgYGNvbXBsZXRpb25fY29zdCgpYCBmdW5jdGlvbiBvbmx5IGNoZWNrcyBgdXNhZ2UuY2FjaGVfcmVhZF9pbnB1dF90b2tlbnNgIChBbnRocm9waWMgY29udmVudGlvbikuIERlZXBTZWVrIChPcGVuQUktY29tcGF0aWJsZSkgcmV0dXJucyBjYWNoZSB0b2tlbnMgYXMgYHVzYWdlLnByb21wdF90b2tlbnNfZGV0YWlscy5jYWNoZWRfdG9rZW5zYC4gVGhlIGBVc2FnZWAgUHlkYW50aWMgbW9kZWwgZG9lcyAqKm5vdCoqIGhhdmUgYSBkaXJlY3QgYGNhY2hlX3JlYWRfaW5wdXRfdG9rZW5zYCBmaWVsZCDigJQgc28gYGdldGF0dHIob2JqLCBcImNhY2hlX3JlYWRfaW5wdXRfdG/igKYifQ==
```
}