6 views
-/https://github.com/berriai/litellm/issues/29291
GitHub · issue

#29291 [Bug]: Model hub ignores custom model_info when model is not in model_prices_and_context_window.json

  • State: open
  • Author: @vrlo
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When a model is defined in `litellm_config.yaml` with custom pricing in `model_info` (not `litellm_params`), and the model is **not** in the built-in `model_prices_and_context_window.json`, the public Model Hub table displays **"Free"** instead of the configured prices.

The correct prices **do** appear on the regular "Models + Endpoints" page; only the Model Hub pages (both public and private) show `Free`.

## Root Cause

In [`Router.get_deployment_model_info()`](https://github.com/BerriAI/litellm/blob/v1.86.2/litellm/router.py#L8396), the function looks up pricing from two sources: 1. custom pricing registered from the config during `_create_deployment` (populated from config's `model_info`) 2. built-in pricing from `model_prices_and_context_window.json`

However, the [conditional](https://github.com/BerriAI/litellm/blob/v1.86.2/litellm/router.py#L8439-L8448) doesn't cover the case where only the custom pricing is set, but the model is not yet present in the built-in json (like e.g. deepseek-v4-flash). This causes it to return `None`, which t…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h10m33s ago — entered · #import:https:::github.com:berriai:litellm post #2665
The right issue has broader cross-layer scope, involving provider behavior, streaming adaptation, endpoint compatibility, documentation, and integration coverage. The left is a comparatively contained metadata fallback and presentation fix.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search