https://github.com/berriai/litellm/issues/31296 {
```slug-github-card
eyJ2IjoxLCJzY2hlbWEiOiJzbHVnX2dpdGh1Yl9pbXBvcnQiLCJraW5kIjoiaXNzdWUiLCJ1cmwiOiJodHRwczovL2dpdGh1Yi5jb20vYmVycmlhaS9saXRlbGxtL2lzc3Vlcy8zMTI5NiIsImhlYWRsaW5lIjoiIzMxMjk2IFtGZWF0dXJlXTogSW5ib3VuZCBNQ1AgT0F1dGg6IGVtaXQgNDAxICsgUHJvdGVjdGVkIFJlc291cmNlIE1ldGFkYXRhIChSRkMgOTcyOCkgdG8gZW5hYmxlIGNsaWVudCBhdXRvLWRpc2NvdmVyeSIsInN1YmxpbmVzIjpbIlN0YXRlOiBvcGVuIiwiQXV0aG9yOiBAb2xhZDMyIiwiTGFiZWxzOiBlbmhhbmNlbWVudCwgcHJveHksIGNsYXVkZSBjb2RlIl0sImV4Y2VycHQiOiIjIyMgQ2hlY2sgZm9yIGV4aXN0aW5nIGlzc3Vlc1xuXG4tIFt4XSBJIGhhdmUgc2VhcmNoZWQgdGhlIGV4aXN0aW5nIGlzc3VlcyBhbmQgY2hlY2tlZCB0aGF0IG15IGlzc3VlIGlzIG5vdCBhIGR1cGxpY2F0ZS5cblxuIyMjIFRoZSBGZWF0dXJlXG5cbiMjIFByb2JsZW1cblxuV2hlbiB0aGUgTGl0ZUxMTSBNQ1AgR2F0ZXdheSBpcyBwcm90ZWN0ZWQgYnkgSldUIGF1dGggKGBlbmFibGVfand0X2F1dGhgKSwgaXQgYWN0cyBhcyBhXG4qYnJpbmcteW91ci1vd24tdG9rZW4qIHJlc291cmNlIHNlcnZlcjogYSByZXF1ZXN0IHdpdGhvdXQgYSB2YWxpZCB0b2tlbiBqdXN0IGdldHMgYSBiYXJlXG5gNDAxYC4gQSBnZW5lcmljIE1DUCBjbGllbnQgKENsYXVkZSBDb2RlLCBWUyBDb2RlLCBDdXJzb3LigKYpIGhhcyBubyB3YXkgdG8ga25vdyAqKndoaWNoXG5hdXRob3JpemF0aW9uIHNlcnZlciB0byB1c2UqKiBvciBob3cgdG8gc3RhcnQgYW4gT0F1dGggZmxvdywgc28gdGhlIGxvZ2luIHNjcmVlbiBuZXZlclxudHJpZ2dlcnMgYXV0b21hdGljYWxseS5cblxuVGhlIE1DUCBhdXRob3JpemF0aW9uIHNwZWMgKE9BdXRoIDIuMSArICoqUkZDIDk3MjggUHJvdGVjdGVkIFJlc291cmNlIE1ldGFkYXRhKiopIHNvbHZlc1xudGhpczogdGhlIHJlc291cmNlIHNlcnZlciBtdXN0IGFkdmVydGlzZSBpdHMgdHJ1c3RlZCBhdXRob3JpemF0aW9uIHNlcnZlcihzKSBzbyBjbGllbnRzXG5jYW4gYXV0by1kaXNjb3ZlciwgcmVnaXN0ZXIgKERDUiksIGFuZCBvYnRhaW4gYSB0b2tlbiB3aXRob3V0IG1hbnVhbCBjb25maWd1cmF0aW9uIChnZXQgYW4gYXBpIGtleSkuXG5cblRvZGF5IExpdGVMTE0gb25seSBpbXBsZW1lbnRzIHRoaXMgZGlzY292ZXJ5IGZvciB0aGUgKipvdXRib3VuZCoqIGRpcmVjdGlvbiAoTGl0ZUxMTSDihpJcbnVwc3RyZWFtIE1DUCBzZXJ2ZXJzKSwgbm90IGZvciAqKmluYm91bmQqKiBhdXRoIChNQ1AgY2xpZW50IOKGkiBMaXRlTExNKS5cblxuIyMgUHJvcG9zZWQgc29sdXRpb25cblxuRm9yIHRoZSBpbmJvdW5kIE1DUCBlbmRwb2ludCwgd2hlbiBhIHJlcXVlc3QgaXMgdW5hdXRoZW50aWNhdGVkOlxuXG4xLiBTZXJ2ZSBgR0VUIC8ud2VsbC1rbm93bi9vYXV0aC1wcm90ZWN0ZWQtcmVzb3VyY2VgIChSRkMgOTcyOCkgcmV0dXJuaW5nIHRoZSBjb25maWd1cmVkXG4gICBgYXV0aG9yaXphdGlvbl9zZXJ2ZXJzYCAoZS5nLiBvdXIgZXh0ZXJuYWwgSWRQKSBhbmQgYHJlc+KApiJ9
```
}