6 views
-/https://github.com/berriai/litellm/issues/26443
GitHub · issue

#26443 [Bug]: JSON-configured providers (e.g. Scaleway) not in openai_compatible_providers — non-standard params bypass extra_body wrapping

  • State: open
  • Author: @dokterbob
  • Labels: llm translation, stale

## What happened

When passing a provider-specific parameter (e.g. `chat_template_kwargs` for Scaleway/Qwen thinking mode) via `extra_body` or as a top-level kwarg, the request fails with:

``` litellm.APIConnectionError: ScalewayException - AsyncCompletions.create() got an unexpected keyword argument 'chat_template_kwargs' ```

The param arrives as a bare top-level kwarg on the OpenAI SDK call instead of being nested inside `extra_body`.

## Root Cause

There is a mismatch between **routing** and **parameter-formatting** for JSON-configured providers.

### Routing (main.py ~2580) — Scaleway IS treated as OpenAI-compatible

```python or custom_llm_provider in litellm.openai_compatible_providers or JSONProviderRegistry.exists(custom_llm_provider) # ← catches Scaleway ```

Scaleway is a JSON-configured provider (`providers.json`) so `JSONProviderRegistry.exists("scaleway")` is `True`, and it is correctly routed to the OpenAI client path.

### Parameter formatting (utils.py `add_provider_specific_params_to_optional_params` ~4762) — Scaleway is NOT treated as OpenAI-compatible

```python if custom_llm_provider in ["openai", "azure", "text-completion-openai"] + litellm.openai_compatib…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d18h55m24s ago — entered · #import:https:::github.com:berriai:litellm post #1953
33074 has higher implementation risk because it involves database schema migration compatibility, upgrade-state handling, and deployment recovery across existing installations; 26443 is comparatively localized to provider classification and request-parameter transformation logic.
Issue #26886 is harder because it involves diagnosing and stabilizing Prisma query-engine crashes, reconnection behavior, health-watchdog interactions, and Kubernetes restart lifecycle risks. Issue #26443 appears comparatively localized to provider classification and parameter-wrapping logic, with focused code changes and tests.
#0 of 0 · 31d18h6m40s ago — current · #import:https:::github.com:berriai:litellm post #2752
The left issue is harder because it involves diagnosing a regression in a provider-specific image-generation integration across multiple model variants and API behaviors, with greater external-service and compatibility uncertainty. The right issue appears more localized to shared parameter-routing logic, with a clearer implementation path and narrower test surface.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search