https://github.com/berriai/litellm/issues/31092 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTA5MiIsImhlYWRsaW5lIjoiIzMxMDkyIFtCdWddOiBUcml0b24gbW9kZWxzIGhhdmUgbm8gbWVhbnMgdG8gY29udHJvbCBjaGF0IHRlbXBsYXRlIHBhcmFtZXRlcnMgKGUuZy4gZGlzYWJsZSB0aGlua2luZykiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQHZsYWRtaXJ0eHJ4IiwiTGFiZWxzOiBidWcsIHByb3h5Il0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFdoYXQgaGFwcGVuZWQ/XG5cbkxpdGVMTE0gdXNlcyBwcm9tcHRfZmFjdG9yeSBmdW5jdGlvbiAoaHR0cHM6Ly9naXRodWIuY29tL0JlcnJpQUkvbGl0ZWxsbS9ibG9iLzY5YjBkZDJkYTA3MmMyYWUwZGQwYzQxZWQ5NjljYmViZjhlMzY4MjgvbGl0ZWxsbS9sbG1zL3RyaXRvbi9jb21wbGV0aW9uL3RyYW5zZm9ybWF0aW9uLnB5I0wxOTkpIGluIHRyaXRvbiBtb2RlbCByZXF1ZXN0cyBoYW5kbGVyLiBcblxuTG9va3MgbGlrZSBhbGwgZXh0cmEgcGFyYW1zIGFyZSBzZW5kIHRvIFRyaXRvbiBpbnN0ZWFkLCBhbmQgdHJpdG9uIGJ5IGl0c2VsZiBkb2VzbnQgZG8gYW55IGNoYXQgdGVtcGxhdGluZy4gXG5cblByb2JsZW0gaXMsIGl0IGxvb2tzIGxpa2UgdGhlcmUgaXMgbm8gd2F5IHRvIHBhc3MgaW4gcGFyYW1ldGVycyByZWxhdGVkIHRvIGNoYXQgdGVtcGxhdGUgd2hlbiBtYWtpbmcgYSByZXF1ZXN0LiBGb3IgZXhhbXBsZTogdXNlciBtaWdodCB3YW50IHRvIGRpc2FibGUgbW9kZWwgdGhpbmtpbmcgdG8gdXNlIGxlc3MgdG9rZW5zIGluIHRoZSBvdXRwdXQuIFxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbmBgYHB5XG5pbXBvcnQgcmVxdWVzdHNcblxuQVBJX0tFWT1cInNrLS4uLlwiXG5MTE1fTU9ERUw9XCJxd2VuMy42LTI3YlwiXG5xdWVyeV90ZXh0ID0gXCJ0ZXN0P1wiXG5MTE1fUkVRVUVTVF9USU1FT1VUPTEwMDBcbnVybCA9IFwiaHR0cDovL2xvY2FsaG9zdDo0MDAwL3Byb2plY3QtYXBpL2xpdGVsbG1xd2UvbGl0ZWxsbS13ZWJ1aS9jaGF0L2NvbXBsZXRpb25zXCJcblxuciA9IHJlcXVlc3RzLnBvc3QoXG4gICAgICAgIHVybCxcbiAgICAgICAgaGVhZGVycz17XG4gICAgICAgICAgICBcIkNvbnRlbnQtVHlwZVwiOiBcImFwcGxpY2F0aW9uL2pzb25cIixcbiAgICAgICAgICAgIFwiQXV0aG9yaXphdGlvblwiOiBmXCJCZWFyZXIge0FQSV9LRVl9XCIsXG4gICAgICAgIH0sXG4gICAgICAgIGpzb249e1xuICAgICAgICAgICAgXCJtb2RlbFwiOiBMTE1fTU9ERUwsXG4gICAgICAgICAgICBcIm1lc3NhZ2VzXCI6IFt7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBxdWVyeV90ZXh0fV0sXG4gICAgICAgICAgICBcIm1heF90b2tlbnNcIjogMTAwMDAsXG4gICAgICAgICAg4oCmIn0=
```
}