https://github.com/berriai/litellm/issues/30504 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDUwNCIsImhlYWRsaW5lIjoiIzMwNTA0IFtCdWddOiBBZGRpbmcgQ29tcGxleGl0eSByb3V0ZXIgZnJvbSBcIkFkZCBhdXRvIHJvdXRlclwiIFVJIGZhaWxzIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBBQ29kaW5nZnJlYWsiLCJMYWJlbHM6IGJ1ZywgdWktZGFzaGJvYXJkIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbkkgdHJpZWQgY29uZmlndXJpbmcgY29tcGxleGl0eSByb3V0ZXIgYXMgc2hvd24gYmVsb3cgXG5cbjxpbWcgd2lkdGg9XCIxNzQ2XCIgaGVpZ2h0PVwiMTU3M1wiIGFsdD1cIkltYWdlXCIgc3JjPVwiaHR0cHM6Ly9naXRodWIuY29tL3VzZXItYXR0YWNobWVudHMvYXNzZXRzLzdkYTM4NTlhLTBiNmMtNGMyOC05NjRmLWJiZTAwYjAxMmNiOFwiIC8+XG5cbk9uIGNsaWNraW5nIFwiVGVzdCBjb25uZWN0aW9uXCIgaXQganVzdCBmYWlscyBhcyBzaG93biBiZWxvdyBcblxuPGltZyB3aWR0aD1cIjE3MDFcIiBoZWlnaHQ9XCIxNjIzXCIgYWx0PVwiSW1hZ2VcIiBzcmM9XCJodHRwczovL2dpdGh1Yi5jb20vdXNlci1hdHRhY2htZW50cy9hc3NldHMvYTRkNWE1MmItY2M4Ni00MDg2LWJmZGUtOGJiMjc3MzJmOWQ2XCIgLz5cblxuPGltZyB3aWR0aD1cIjEwMTZcIiBoZWlnaHQ9XCI5NTVcIiBhbHQ9XCJJbWFnZVwiIHNyYz1cImh0dHBzOi8vZ2l0aHViLmNvbS91c2VyLWF0dGFjaG1lbnRzL2Fzc2V0cy9iNzI2M2JjZS04ZDUwLTRjY2QtYWI3YS0yMTMyNjU5MzM5Y2ZcIiAvPlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbkxpc3RlZCBhYm92ZVxuXG5cbiMjIyBSZWxldmFudCBsb2cgb3V0cHV0XG5cbmBgYHNoZWxsXG5cbmBgYFxuXG4jIyMgV2hhdCBwYXJ0IG9mIExpdGVMTE0gaXMgdGhpcyBhYm91dD9cblxuVUkgRGFzaGJvYXJkXG5cbiMjIyBXaGF0IExpdGVMTE0gdmVyc2lvbiBhcmUgeW91IG9uID9cblxudjEuODMuMTBcblxuIyMjIFR3aXR0ZXIgLyBMaW5rZWRJbiBkZXRhaWxzXG5cbl9ObyByZXNwb25zZV8ifQ==
```
}