8 views
-/https://github.com/berriai/litellm/issues/31008
GitHub · issue

#31008 [Bug]: Background health checks fail for OpenRouter models with extra_body.tools (openrouter:web_search); real completions succeed

  • State: open
  • Author: @plissje
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

OpenRouter models configured with gateway-wide web search via `litellm_params.extra_body.tools` (`openrouter:web_search`, optionally `openrouter:datetime`) are marked **unhealthy** by LiteLLM background health checks, while normal chat completions on the same deployment succeed.

**Expected:** Health checks pass for a deployment that can complete real chat requests, or probes should not inherit server-tool `extra_body` that changes request semantics.

**Actual:** Removing `extra_body` makes health checks pass. Adding only `openrouter:web_search` in `extra_body` makes health checks fail again. Increasing `model_info.health_check_max_tokens` did not help.

**Environment**

- LiteLLM v1.89.2 (production) and v1.89.3 (local docker) — same behavior - Provider: OpenRouter - Example models: `openrouter/anthropic/claude-haiku-4.5`, `openrouter/google/gemini-3-flash-preview` - Models stored in DB via Admin UI (`STORE_MODEL_IN_DB=True`)

**Suspected cause**

`litellm/proxy/health_check.py` function `_update_litellm_params_for_health_check()` overrides `m…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h15m26s ago — entered · #import:https:::github.com:berriai:litellm post #2583
#31008 requires tracing and safely separating health-check parameter mutation from real-request semantics across proxy, OpenRouter translation, stored model configuration, and background-check behavior, with broader regression coverage. #30314 is comparatively localized to request construction and validation for a specific Bedrock embedding path.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search