7 views
-/https://github.com/berriai/litellm/issues/35462
GitHub · issue

#35462 [Bug]: PATCH /model/{id}/update cannot delete a litellm_params field - omitting or nulling a key both preserve the old value

  • State: open
  • Author: @penradioGables

There's no way to explicitly remove a key from a model's `litellm_params` via `PATCH /model/{id}/update`. Observed behavior: omitting a field preserves the old value (expected); explicitly setting it to `null` **also** preserves the old value (unexpected); only a non-null replacement actually takes effect. The only workaround found was a direct Postgres `litellm_params - 'key'` JSONB delete, bypassing the management API.

Concretely hit this with `cache_control_injection_points`: setting it to `[]` to mean "disabled" left a stored empty list rather than clearing the key. After an unrelated restart re-read the config, that stored `[]` began being forwarded as a literal request parameter to the model provider, breaking every request through that model entry with `Extra inputs are not permitted`.

**Suggested fix:** give explicit `null` real delete semantics (distinct from omission), or add a dedicated field-removal mechanism to the update endpoint.

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h23m18s ago — entered · #import:https:::github.com:berriai:litellm post #2473
The right-hand task is harder because it crosses streaming protocols, incremental event handling, provider-specific translation, and compatibility testing with downstream consumers; the left-hand task is comparatively localized to PATCH update and JSON field-deletion semantics.
#0 of 0 · 31d18h13m56s ago — current · #import:https:::github.com:berriai:litellm post #2628
#35116 is harder because it requires a new, configurable rate-limiting subsystem spanning configuration validation, request identity extraction, multiple accounting dimensions, arbitrary time windows, routing integration, persistence or counter storage, concurrency behavior, and extensive compatibility testing. #35462 is comparatively localized to PATCH merge and deletion semantics with focused API and regression tests.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search