9 views
-/https://github.com/berriai/litellm/issues/35369
GitHub · issue

#35369 [Bug]: Budget enforcement blocks all model group alias connections, independent of actual pricing information of the actual model

  • State: open
  • Author: @fabianh-rz
  • Labels: bug, proxy

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When an enduser exceeds his budget, it blocks not just all non-zero cost models but also **all** group model alias endpoints, including those pointing on zero-cost models. This is an unintended behavior, as free models should stay available, also behind an alias.

### Steps to Reproduce

1. create a model group alias and point it to a free model (model A) 2. exceed your budget 3. try calling model A -> success 4. try calling group model alias (of model A) -> Error 429!!! 5.

### Relevant log output

```shell

```

### What part of LiteLLM is this about?

Proxy

### What LiteLLM version are you on ?

v1.93.0

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h41m37s ago — entered · #import:https:::github.com:berriai:litellm post #2182
35369 is harder because it requires tracing and correcting budget-gating behavior across proxy request routing, model-group alias resolution, pricing checks, and regression coverage, with potential compatibility implications. 34248 is narrower provider-specific request-shape translation and validation work.
#0 of 0 · 31d18h32m43s ago — current · #import:https:::github.com:berriai:litellm post #2328
Budget enforcement spans proxy request routing, model-group alias resolution, cost/pricing classification, and quota state, creating broader regression risk and requiring matrixed tests. The vector-store failure appears more localized to parameter propagation in two endpoints.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search