https://github.com/berriai/litellm/issues/30727 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMDcyNyIsImhlYWRsaW5lIjoiIzMwNzI3IFtCdWddOiBMYWtlcmEgdjEgZ3VhcmRyYWlsIOKAlCBzZXR0aW5nIGNhdGVnb3J5X3RocmVzaG9sZHMgc2lsZW50bHkgZGlzYWJsZXMgYmxvY2tpbmcgZm9yIGZsYWdnZWQgY2F0ZWdvcmllcyBpdCBkb2Vzbid0IG5hbWUiLCJzdWJsaW5lcyI6WyJTdGF0ZTogb3BlbiIsIkF1dGhvcjogQEFVVEhFTlNPUiJdLCJleGNlcnB0IjoiIyMgU3VtbWFyeVxuXG5JbiBgbGl0ZWxsbS9wcm94eS9ndWFyZHJhaWxzL2d1YXJkcmFpbF9ob29rcy9sYWtlcmFfYWkucHk6NzktMTIwYCAoYF9jaGVja19yZXNwb25zZV9mbGFnZ2VkYCksIHRoZSBibG9jayBkZWNpc2lvbiBpcyBzdHJ1Y3R1cmVkIGFzOlxuXG5gYGBweXRob25cbmlmIHNlbGYuY2F0ZWdvcnlfdGhyZXNob2xkcyBpcyBub3QgTm9uZTpcbiAgICAjIGNvbXBhcmVzIE9OTFkgJ3Byb21wdF9pbmplY3Rpb24nIC8gJ2phaWxicmVhaycgc2NvcmUga2V5cyBhZ2FpbnN0IHRocmVzaG9sZHNcbiAgICAuLi5cbmVsaWYgZmxhZ2dlZCBpcyBUcnVlOlxuICAgIHJhaXNlIEhUVFBFeGNlcHRpb24oLi4uKSAgICMgPC0tIGF1dGhvcml0YXRpdmUgdG9wLWxldmVsIHZlcmRpY3RcbmBgYFxuXG5CZWNhdXNlIHRoZSBgZmxhZ2dlZCBpcyBUcnVlYCBibG9jayBpcyBhbiBgZWxpZmAgb2YgYGNhdGVnb3J5X3RocmVzaG9sZHMgaXMgbm90IE5vbmVgLCBpdCBiZWNvbWVzICoqdW5yZWFjaGFibGUgd2hlbmV2ZXIgYW4gb3BlcmF0b3IgY29uZmlndXJlcyBgY2F0ZWdvcnlfdGhyZXNob2xkc2AqKiDigJQgYSByZWFsLCByZWdpc3RyeS13aXJlZCwgT3BlbkFQSS1kb2N1bWVudGVkIHR1bmluZyBrbm9iIChgZ3VhcmRyYWlsX3JlZ2lzdHJ5LnB5OjQ1MGAsIGBndWFyZHJhaWxfaW5pdGlhbGl6ZXJzLnB5OjQ3YCkuIEluc2lkZSB0aGUgdGhyZXNob2xkcyBicmFuY2gsIGJsb2NraW5nIHJlcXVpcmVzIGBjYXRlZ29yeV9zY29yZXNgIHRvIGJlIHByZXNlbnQgKiphbmQqKiB0byBjb250YWluIHRoZSBzcGVjaWZpYyBjb25maWd1cmVkIGtleSBhYm92ZSBpdHMgdGhyZXNob2xkLiBgTGFrZXJhQ2F0ZWdvcnlUaHJlc2hvbGRzYCAoYHR5cGVzL2d1YXJkcmFpbHMucHk6MTY3YCkgaGFzIG9ubHkgYHByb21wdF9pbmplY3Rpb25gIGFuZCBgamFpbGJyZWFrYCBmaWVsZHMsIHNvOlxuXG4tIEEgTGFrZXJhIHJlc3BvbnNlIHdpdGggYGZsYWdnZWQ9VHJ1ZWAgZm9yICoqYG1vZGVyYXRlZF9jb250ZW50YCoqIChoYXRlIC8gdmlvbGVuY2UgLyBzZXh1YWwgY29udGVudCkgaXMgKipub3QgYmxvY2tlZCoqIOKAlCB0aGF0IGNhdGVnb3J5IGlzIHVucmVwcmVzZW50YWJsZSBpbiB0aGUgdGhyZXNob2xkcyBhbmQgdGhlIHRvcC1sZXZlbCBgZmxhZ2dlZGAgdmVyZGljdCBpcyBkZWFkIGNvZGUuXG4tIEEgZmxhZ2dlZCAqKmBqYWlsYnJlYWtgKiogaXMgbm90IGJsb2NrZWQgaeKApiJ9
```
}