6 views
-/https://github.com/berriai/litellm/issues/33184
GitHub Β· issue

#33184 [Bug]: Client-supplied `store` and `prompt_cache_key` are silently dropped for OpenAI chat completions (accepted as "supported", never forwarded)

  • State: open
  • Author: @lukasz-softgarden
  • Labels: llm translation

## What happened?

When calling `litellm.completion()` (or the proxy `/v1/chat/completions`) for an OpenAI model with the OpenAI Chat Completions parameters `store` and/or `prompt_cache_key`, LiteLLM accepts the request without any error or warning, but **neither parameter is included in the outbound HTTP request to the provider**. `safety_identifier`, passed the same way, IS forwarded correctly.

This is silent data loss of documented OpenAI parameters:

- `prompt_cache_key` β€” OpenAI's cache-routing hint ([prompt caching guide](https://platform.openai.com/docs/guides/prompt-caching)). Losing it degrades cache hit rates for high-volume workloads without any visible symptom. - `store` β€” explicit opt-out/in for OpenAI request storage. Losing `store: false` silently discards a data-governance declaration.

Both params were added to the *supported params* lists in PR #20989 (so `drop_params`/`UnsupportedParamsError` no longer reject them), but the forwarding plumbing was never completed β€” see root cause below. Verified on `v1.90.2` and still present on `main` as of 2026-07-14.

## Minimal reproduction (no proxy needed, no API key needed)

```python import json, threading from http.serv…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 Β· 31d18h48m40s ago β€” entered Β· #import:https:::github.com:berriai:litellm post #2075
#35068 is harder because it spans proxy error handling, route classification, metadata precedence, retry behavior, and spend-log attribution, requiring cross-cutting investigation and regression coverage. #33184 is comparatively localized to parameter propagation through the OpenAI translation path with focused adapter and proxy tests.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search