https://github.com/berriai/litellm/issues/31233 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTIzMyIsImhlYWRsaW5lIjoiIzMxMjMzIFtCdWddOiAvdjEvbWNwL3NlcnZlci9oZWFsdGggcmV0dXJucyBvcGFxdWUgU0hBLTI1NiBzZXJ2ZXJfaWQgaGFzaGVzIHdpdGggbm8gc2VydmVyX25hbWUiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQG5hcmVzaGU3NiJdLCJleGNlcnB0IjoiIyMgRGVzY3JpcHRpb25cblxuYEdFVCAvdjEvbWNwL3NlcnZlci9oZWFsdGhgIHJldHVybnMgZW50cmllcyB3aXRoIG9ubHkgYW4gb3BhcXVlIFNIQS0yNTYgaGFzaCBhcyBgc2VydmVyX2lkYCBhbmQgbm8gaHVtYW4tcmVhZGFibGUgYHNlcnZlcl9uYW1lYC4gVGhlcmUgaXMgbm8gd2F5IHRvIGtub3cgd2hpY2ggaGFzaCBjb3JyZXNwb25kcyB0byB3aGljaCBzZXJ2ZXIgd2l0aG91dCByZWNvbXB1dGluZyB0aGUgaGFzaCBtYW51YWxseS5cblxuIyMgU3RlcHMgdG8gcmVwcm9kdWNlXG5cbmBgYGJhc2hcbmN1cmwgaHR0cHM6Ly88cHJveHk+L3YxL21jcC9zZXJ2ZXIvaGVhbHRoXG5cbkFjdHVhbCByZXNwb25zZTpcbltcbiAge1wic2VydmVyX2lkXCI6IFwiYTNmMWJjMjlkNzRlODAxMi4uLlwiLCBcInN0YXR1c1wiOiBcImhlYWx0aHlcIn0sXG4gIHtcInNlcnZlcl9pZFwiOiBcIjllMmQ0YzcxYTBmMzhiNTYuLi5cIiwgXCJzdGF0dXNcIjogXCJ1bmtub3duXCJ9XG5dXG5cbkV4cGVjdGVkIHJlc3BvbnNlOlxuW1xuICB7XCJzZXJ2ZXJfaWRcIjogXCJhM2YxYmMyOWQ3NGU4MDEyLi4uXCIsIFwic2VydmVyX25hbWVcIjogXCJnaXRodWJfb25wcmVtXCIsIFwic3RhdHVzXCI6IFwiaGVhbHRoeVwifSxcbiAge1wic2VydmVyX2lkXCI6IFwiOWUyZDRjNzFhMGYzOGI1Ni4uLlwiLCBcInNlcnZlcl9uYW1lXCI6IFwiY2l0XCIsICAgICAgICAgICBcInN0YXR1c1wiOiBcInVua25vd25cIn1cbl1cblxuUm9vdCBjYXVzZVxuXG5zZXJ2ZXJfaWQgaXMgZ2VuZXJhdGVkIGJ5IF9nZW5lcmF0ZV9zdGFibGVfc2VydmVyX2lkKCkgd2hpY2ggaGFzaGVzXG5uYW1lfHVybHx0cmFuc3BvcnR8YXV0aF90eXBlfGFsaWFzIHdpdGggU0hBLTI1NiAoZmlyc3QgMzIgY2hhcnMpLiBUaGUgaGVhbHRoXG5yZXNwb25zZSBvbmx5IGluY2x1ZGVzIHNlcnZlcl9pZCDigJQgdGhlIG9yaWdpbmFsIG5hbWUgaXMgbmV2ZXIgc3VyZmFjZWQuXG5cbkZpbGU6IGxpdGVsbG0vcHJveHkvX2V4cGVyaW1lbnRhbC9tY3Bfc2VydmVyL21jcF9zZXJ2ZXJfbWFuYWdlci5weVxuXG5JbXBhY3RcblxuLSBIZWFsdGggY2hlY2tzIGNhbm5vdCBiZSB1c2VkIGZvciBtb25pdG9yaW5nIG9yIGFsZXJ0aW5nIHdpdGhvdXQgcmV2ZXJzZS1lbmdpbmVlcmluZyBoYXNoZXNcbi0gT3BlcmF0b3JzIGNhbm5vdCBpZGVudGlmeSB3aGljaCBzZXJ2ZXIgaXMgdW5oZWFsdGh5IGZyb20gdGhlIEFQSSByZXNwb25zZSBhbG9uZVxuLSBGb3JjZXMgcHJveHktc2lkZSB3b3JrYXJvdW5kcyAod3JhcHBpbmcgdGhl4oCmIn0=
```
}