https://github.com/berriai/litellm/issues/31968 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTk2OCIsImhlYWRsaW5lIjoiIzMxOTY4IFtCdWddOiBTVE9SRV9NT0RFTF9JTl9EQj1UcnVlIGlnbm9yZWQgd2hlbiBMaXRlTExNX0NvbmZpZy5nZW5lcmFsX3NldHRpbmdzLnN0b3JlX21vZGVsX2luX2RiPWZhbHNlIiwic3VibGluZXMiOlsiU3RhdGU6IG9wZW4iLCJBdXRob3I6IEBzdW5pbG1iaG9pIiwiTGFiZWxzOiBidWciXSwiZXhjZXJwdCI6IiMjIyBDaGVjayBmb3IgZXhpc3RpbmcgaXNzdWVzXG5cbi0gW3hdIEkgaGF2ZSBzZWFyY2hlZCB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBjaGVja2VkIHRoYXQgbXkgaXNzdWUgaXMgbm90IGEgZHVwbGljYXRlLlxuXG4jIyMgV2hhdCBoYXBwZW5lZD9cblxuRGVwbG95bWVudDpcbi0gS3ViZXJuZXRlc1xuLSBQb3N0Z3JlU1FMXG4tIExpdGVMTE0gRGF0YWJhc2UgSW1hZ2VcblxuQ29uZmlndXJhdGlvbjpcblxuRW52aXJvbm1lbnQ6XG5TVE9SRV9NT0RFTF9JTl9EQj1UcnVlXG5cbmNvbmZpZy55YW1sOlxuXG5nZW5lcmFsX3NldHRpbmdzOlxuICBzdG9yZV9tb2RlbF9pbl9kYjogdHJ1ZVxuXG5Jc3N1ZTpcblxuUE9TVCAvbW9kZWwvbmV3IHJldHVybnNcblxuU2V0ICdTVE9SRV9NT0RFTF9JTl9EQj1UcnVlJ1xuXG5JbnZlc3RpZ2F0aW9uOlxuXG5MaXRlTExNX0NvbmZpZy5nZW5lcmFsX3NldHRpbmdzIGNvbnRhaW5lZFxuXG57XG4gIFwic3RvcmVfbW9kZWxfaW5fZGJcIjogZmFsc2Vcbn1cblxuVXBkYXRpbmcgdGhlIERCIHZhbHVlIHRvIHRydWUgaW1tZWRpYXRlbHkgcmVzb2x2ZWQgdGhlIGlzc3VlLlxuXG5FeHBlY3RlZDpcblxuRWl0aGVyOlxuLSBFbnZpcm9ubWVudC9jb25maWcgc2hvdWxkIG92ZXJyaWRlIHRoZSBwZXJzaXN0ZWQgREIgdmFsdWVcblxub3JcblxuLSBUaGUgZXJyb3IgbWVzc2FnZSBzaG91bGQgaW5kaWNhdGUgdGhhdCBMaXRlTExNX0NvbmZpZy5nZW5lcmFsX3NldHRpbmdzLnN0b3JlX21vZGVsX2luX2RiIGlzIGZhbHNlLlxuXG4jIyMgU3RlcHMgdG8gUmVwcm9kdWNlXG5cbjEuIFxuMi4gXG4zLiBcblxuXG4jIyMgUmVsZXZhbnQgbG9nIG91dHB1dFxuXG5gYGBzaGVsbFxuRmFpbGVkIHRvIGFkZCBtb2RlbDogQXBpRXJyb3I6IHsnZXJyb3InOiBcIlNldCBgJ1NUT1JFX01PREVMX0lOX0RCPSdUcnVlJ2AgaW4geW91ciBlbnYgdG8gZW5hYmxlIHRoaXMgZmVhdHVyZS5cIn1cbmBgYFxuXG4jIyMgV2hhdCBwYXJ0IG9mIExpdGVMTE0gaXMgdGhpcyBhYm91dD9cblxuX05vIHJlc3BvbnNlX1xuXG4jIyMgV2hhdCBMaXRlTExNIHZlcnNpb24gYXJlIHlvdSBvbiA/XG5cbnYxLjkwLjEgLCBnaGNyLmlvL2JlcnJpYWkvbGl0ZWxsbS1kYXRhYmFzZTp2MS45MC4wICwgdjEuOTAuMVxuXG4jIyMgVHdpdHRlciAvIExpbmtlZEluIGRldGFpbHNcblxuX05vIHJlc3BvbnNlXyJ9
```
}