8 views
-/https://github.com/berriai/litellm/issues/13752
GitHub · issue

#13752 [Bug]: Wildcard entries appear as models in the /models endpoint

  • State: open
  • Author: @eliorc
  • Labels: bug, llm translation

### What happened?

# Problem

We are using wildcards, to forward all available models from providers to our consumers, in the following way

```yaml model_list: - model_name: "openai/*" litellm_params: model: "openai/*" api_key: os.environ/OPENAI_API_KEY - model_name: "anthropic/*" litellm_params: model: "anthropic/*" api_key: os.environ/ANTHROPIC_API_KEY ```

This correctly returns all the available models that Anthropic and OpenAI have, but it also returns `openai/*` and `anthropic/*` as models.

This is a problem, because this misleads consumers to believe the wildcard results are acceptable model names to use when calling the API

# Suggested Solution

The `/models` endpoint should avoid returning wildcards as models.

### Relevant log output

```shell

```

### Are you a ML Ops Team?

No

### What LiteLLM version are you on ?

v1.74.15

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h23m7s ago — entered · #import:https:::github.com:berriai:litellm post #2457
The left issue is harder because it affects model-discovery and filtering behavior across wildcard configurations and likely requires broader regression coverage; the right is a localized provider-specific request-mapping correction with narrowly scoped tests.
#0 of 0 · 31d18h18m39s ago — current · #import:https:::github.com:berriai:litellm post #2529
The left issue is harder because it requires careful terminal-state handling, persistence semantics, idempotency, and regression coverage in a background workflow, while the right issue is primarily a narrowly scoped response-filtering change.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search