16 views
-/https://github.com/berriai/litellm/issues/25229
GitHub ยท issue

#25229 Integration: WhichModel MCP for real-time pricing data in model routing

  • State: open
  • Author: @simonamsharp

### Feature proposal

**Context:** LiteLLM abstracts 100+ LLM providers behind a unified interface. Users routing between models need accurate, up-to-date pricing to make cost-optimal decisions.

**Proposal:** [WhichModel](https://whichmodel.dev) is a free MCP server that tracks pricing and capabilities across 100+ models, refreshed every 4 hours. It could complement LiteLLM's routing by providing real-time pricing data.

**Potential integration points:** 1. Use WhichModel pricing data to power LiteLLM's cost-based routing 2. Add WhichModel as an MCP tool example in LiteLLM docs 3. Use `check_price_changes` to keep LiteLLM's internal pricing tables current

**MCP Config:** ```json {"mcpServers":{"whichmodel":{"url":"https://whichmodel.dev/mcp"}}} ```

**4 tools:** - `recommend_model` โ€” cost-optimized suggestions by task type, complexity, budget - `compare_models` โ€” head-to-head comparison with volume cost projections - `get_pricing` โ€” raw pricing data with filters (model, provider, capabilities, price ceiling) - `check_price_changes` โ€” pricing change tracker since a given date

No API key needed for free tier (1,000 req/mo). MIT licensed.

- GitHub: https://github.com/Which-Model/wโ€ฆ

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 ยท 31d18h7m43s ago โ€” entered ยท #import:https:::github.com:berriai:litellm post #2713
Issue #25229 is harder because it involves integrating an external, evolving pricing service into model-routing and pricing workflows, with synchronization, reliability, API-boundary, and broader design considerations. Issue #30520 is primarily a focused clarification and consistency update across implementation documentation and the public docstring.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search