8 views
-/https://github.com/berriai/litellm/issues/14257
GitHub · issue

#14257 [Bug]: Model are exposed on the proxy API not just by their name, but also by their type

  • State: open
  • Author: @Dobiasd
  • Labels: bug, mlops user request, llm translation

### What happened?

Here is a minimal example showing it:

Run the proxy with Docker:

`litellm_config.yaml`

```yaml model_list: - model_name: foo litellm_params: model: gpt-4.1 api_key: ... general_settings: master_key: sk-1234 ```

```bash docker run \ -v $(pwd)/litellm_config.yaml:/app/config.yaml \ -p 4000:4000 \ ghcr.io/berriai/litellm:litellm_stable_release_branch-v1.75.8-stable \ --config /app/config.yaml ```

Check which models are available:

```bash curl 'http://0.0.0.0:4000/v1/models' \ -H 'Content-Type: application/json' \ -H 'Authorization: Bearer sk-1234' | jq . ```

```json { "data": [ { "id": "foo", "object": "model", "created": 1677610602, "owned_by": "openai" } ], "object": "list" } ```

This request is expected to succeed:

```bash curl -X POST 'http://0.0.0.0:4000/chat/completions' \ -H 'Content-Type: application/json' \ -H 'Authorization: Bearer sk-1234' \ -d '{ "model": "foo", "messages": [{"role": "user", "content": "Hi."}] }' ```

The following request should not succeed, because there is no model with the name `gpt-4.1` exposed in the config.

```bash curl -X POST 'http://0.0…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h1m35s ago — entered · #import:https:::github.com:berriai:litellm post #2848
Issue #35191 is harder because it involves tracing lifecycle consistency, payload-to-span identity propagation, allowlist handling, vendor integration behavior, and regression testing across boundary and deferred span paths. Issue #14257 is comparatively localized to proxy model-name exposure and request validation.
#0 of 0 · 31d17h59m1s ago — current · #import:https:::github.com:berriai:litellm post #2893
Issue 14257 is substantially harder because it affects proxy model discovery, request validation, aliasing, and compatibility across API behavior and configuration paths. Issue 29799 is a localized logging-format change with limited regression surface.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search