6 views
-/https://github.com/berriai/litellm/issues/32563
GitHub · issue

#32563 [Bug]: MCP gateway silently calls the model with no tools when zero MCP tools resolve (key without server access hallucinates)

  • State: open
  • Author: @thibault-linktree

### What happened?

A Responses API request that explicitly asks for MCP tools via the gateway (`server_url: litellm_proxy/...`) but resolves **zero** tools — because the API key/team has no access to the MCP server (`allow_all_keys=false` and no object-permission grant), the server name doesn't exist, or `allowed_tools` matches nothing — is silently sent to the model **with no tools at all**.

The model then answers from thin air. The request looks healthy end to end: HTTP 200, and a `list_mcp_tools` spend log with status **success** and an empty response. In our production deployment this cost several days of debugging, because the failure reads as a model-quality problem ("why is it hallucinating?") instead of a permissions problem.

Real capture (main @ 999637883c, unregistered server name):

``` HTTP/1.1 200 OK ... "output":[{"type":"message","content":[{"text":"It seems I can't access external tools or links, including Linktree. You can check the number of links on your Linktree by logging into your account ..."}]}] ```

Expected: a 400 naming the requested server URLs and the likely causes. (Confirmed with the LiteLLM team on Slack that throwing by default is the preferred s…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d19h11m7s ago — entered · #import:https:::github.com:berriai:litellm post #1691
Requires cross-layer investigation, authorization/error-contract decisions, and broader regression coverage; the other is a localized consistency fix with limited testing scope.
The left issue requires redesigning asynchronous persistence semantics across several update paths, including completion guarantees, failure propagation, retry or shutdown handling, and regression coverage. The right issue is more localized to request validation and error handling in the MCP gateway, with narrower integration impact.
#0 of 0 · 31d18h50m28s ago — current · #import:https:::github.com:berriai:litellm post #2028
MCP gateway validation spans request routing, authorization, empty-resolution handling, error semantics, and regression coverage across integrations, creating broader behavioral risk. The container migration failure is more localized to image filesystem ownership, cache configuration, or startup setup.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search