7 views
-/https://github.com/berriai/litellm/issues/35461
GitHub Ā· issue

#35461 [Bug]: Usage dashboard "Ask AI" chat fails for every selectable model (calls litellm.acompletion() directly, bypassing the Router)

  • State: open
  • Author: @penradioGables

In `litellm/proxy/management_endpoints/usage_endpoints/ai_usage_chat.py`, both `stream_usage_ai_chat()` and `_stream_final_response()` call `litellm.acompletion(model=<alias>, ...)` directly. Bare `litellm.acompletion` only infers a provider from a real provider-prefixed model string — it has no concept of virtual proxy aliases registered in `model_list`. Since the Usage dashboard's "Ask AI" model dropdown is populated from exactly those virtual aliases, every real selection fails with:

``` litellm.BadRequestError: LLM Provider NOT provided. Pass in the LLM provider you are trying to call. You passed model=<alias> ```

which the endpoint's broad except-all catches and reports as a generic "An internal error occurred. Please try again." Only the hardcoded `DEFAULT_COMPETITOR_DISCOVERY_MODEL` fallback ever works, and it isn't selectable from the UI.

**Repro:** configure any virtual model alias in `model_list`, open the Usage dashboard, select it in "Ask AI", send a message → generic error; confirm via proxy logs for the `BadRequestError`.

**Suggested fix:** resolve through `llm_router.acompletion()` when the requested model is a registered alias (`llm_router.get_model_list(model_n…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 Ā· 31d17h47m55s ago — entered Ā· #import:https:::github.com:berriai:litellm post #3088
The left issue spans request dispatch, alias resolution, streaming behavior, fallback handling, and dashboard integration, creating broader regression risk. The right issue is comparatively localized to provider request construction and validation of an optional AWS parameter.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search