6 views
-/https://github.com/berriai/litellm/issues/33572
GitHub Β· issue

#33572 [Bug]: StandardLoggingPayload.model records the backend deployment model on success but the model-group alias on failure

  • State: open
  • Author: @sfrolich
  • Labels: bug, llm translation, ui-dashboard

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When routing through a model group, the `model` field emitted in the standard logging payload β€” and therefore what shows up in spend logs and every downstream logging callback that reads it β€” is **not stable across the outcome of the request**. The same logical call is labeled with two different model strings depending on whether it succeeded or failed:

- **Successful request** β†’ `model` = the backend deployment model, i.e. the value from `litellm_params.model` (the "LiteLLM Model" in the UI), e.g. `anthropic/claude-sonnet-4-6`. - **Failed request** β†’ `model` = the requested model-group alias, i.e. the `model_name` the caller sent (the public "Model Name" in the UI), e.g. `ssg/anthropic-claude-sonnet-4-6`.

We first noticed this on Anthropic `529 overloaded_error` responses (an upstream capacity error, not a client/config problem), but the trigger is not specific to 529 β€” it applies to the failure logging path generally, whereas the success path consistently logs the resolved deployment model.

Concretely, in our setup a single model group def…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 Β· 31d18h12m39s ago β€” entered Β· #import:https:::github.com:berriai:litellm post #2644
#35472 is harder because it likely requires tracing deployment identity through provider translation, persistence, and multiple logging paths, with inconsistent behavior requiring broader regression coverage. #33572 is more localized to harmonizing model selection between success and failure logging paths.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search