18 views
-/https://github.com/berriai/litellm/issues/28044
GitHub · issue

#28044 chatgpt provider: DB-registered models skip ChatGPTResponsesAPIConfig — streaming requests fail with 'Stream must be set to true'

  • State: open
  • Author: @RomainGehrig
  • Labels: llm translation

## Bug Description

`STORE_MODEL_IN_DB=True` deployments cannot use the `chatgpt` provider (added in #19030) on the streaming path. The same model registered via YAML `model_list:` (configmap-mounted) works correctly; registered via the admin UI or `POST /model/new` (i.e. stored in `LiteLLM_ProxyModelTable`), streaming requests fail. Non-streaming requests against the same DB-registered model succeed.

Confirmed unchanged in `v1.83.14-stable.patch.3` and `v1.84.0` (latest stable as of 2026-05-14).

## Environment

- Image: `ghcr.io/berriai/litellm:main-stable` (SHA `29252f25...`) - `STORE_MODEL_IN_DB=True` - `CHATGPT_TOKEN_DIR` mounted with a valid ChatGPT subscription `auth.json` (refreshed via the upstream `Authenticator`) - ChatGPT Plus tier, model verified working via the YAML path

## Reproducer

### Working baseline (YAML / configmap)

```yaml # config.yaml model_list: - model_name: chatgpt-codex model_info: mode: responses litellm_params: model: chatgpt/gpt-5.3-codex ```

```bash curl -sN http://litellm:4000/responses \ -H "Authorization: Bearer $MK" -H "Content-Type: application/json" \ -d '{"model":"chatgpt-codex","input":[{"role":"user","content"…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h41m31s ago — entered · #import:https:::github.com:berriai:litellm post #2382
The left issue requires tracing model reconstruction across database persistence, provider-specific configuration selection, and the streaming request path, with compatibility and regression risks across multiple registration mechanisms. The right issue is comparatively localized to pricing-key resolution and associated cost-calculation tests.
#0 of 0 · 31d18h18m47s ago — current · #import:https:::github.com:berriai:litellm post #2744
The right issue requires tracing model registration and provider-specific configuration across persistence, loading, request translation, and streaming behavior, with regression coverage across multiple configuration paths. The left issue is primarily a documentation correction based on already-fixed behavior, requiring minimal engineering work.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search