9 views
-/https://github.com/berriai/litellm/issues/35460
GitHub ยท issue

#35460 [Bug]: MCPServerManager re-probes list_prompts/list_resources on every request for servers that don't support them

  • State: open
  • Author: @penradioGables

In `litellm/proxy/_experimental/mcp_server/mcp_server_manager.py`, `get_prompts_from_server` / `get_resources_from_server` call `client.list_prompts()` / `client.list_resources()` on **every** aggregate `/mcp` request against **every** backing server โ€” including servers that don't implement those optional MCP methods at all. Confirmed against 6 different real MCP servers, all of which raise "Method not found" on every single call: 2 wasted round-trips per unsupporting server, on every gateway request.

The file already has the right pattern for this elsewhere โ€” `_upstream_initialize_instructions_probed_at`, a per-server monotonic-timestamp cooldown used for the initialize-instructions probe โ€” it's just not applied to these two methods.

**Suggested fix:** extend the existing cooldown-cache pattern to `get_prompts_from_server` / `get_resources_from_server`, e.g. a per-server cooldown once a server has responded "unsupported."

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 ยท 31d18h3m46s ago โ€” entered ยท #import:https:::github.com:berriai:litellm post #2777
35460 requires a behavioral change in shared request-path code, including per-server state, cooldown semantics, concurrency considerations, and regression coverage. 34082 is primarily documentation and dependency/example validation, with lower implementation risk and scope.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search