7 views
-/https://github.com/berriai/litellm/issues/32603
GitHub · issue

#32603 [Feature]: Budget rollover — carry unused budget into the next budget_duration period

  • State: open
  • Author: @gn-tom-r

### The Feature

Add an option to **carry over unused budget** into the next period instead of resetting spend to zero when `budget_duration` elapses.

Today, when `budget_duration` elapses, LiteLLM resets accumulated spend to 0 and the entity starts the new period back at `max_budget`. Any unused portion of the previous period's budget is lost. There is no way to roll it forward.

Proposed: a flag such as `budget_rollover: true` (settable per key/user/team/org, and via `/key/update`, `/user/update`, etc.) so that at reset, the next period's effective budget = `max_budget + (previous max_budget − spend)`, i.e. unused budget accumulates. Ideally with an optional `max_rollover` / cap to bound accumulation.

### Motivation / Use Case

Teams with monthly AI budgets often want unspent allowance to accumulate rather than expire monthly — e.g. a \$100/month cap where a team that spends \$60 starts the next month at \$140 (up to a cap). This matches how many internal cost-allocation and cloud-commit models work. Without it, users must reconstruct rollover externally by reading spend via the API and rewriting `max_budget` each cycle, which is fragile and races with LiteLLM's own reset job. …

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d18h54m3s ago — entered · #import:https:::github.com:berriai:litellm post #1962
32603 requires coordinated changes across budget state, reset timing, persistence, update APIs, concurrency handling, and edge-case testing, creating broader integration and migration risk. 34730 is comparatively localized dispatcher logic with focused unit-test coverage.
Budget rollover is harder because it affects backend accounting invariants, persistence, reset scheduling, concurrent updates, configuration across entity types, and financial edge-case testing. Dashboard i18n has broader content scope but is comparatively isolated to frontend localization infrastructure and translation coverage.
#0 of 0 · 31d18h8m40s ago — current · #import:https:::github.com:berriai:litellm post #2703
Budget rollover spans persistent budget semantics, reset scheduling, multiple entity types, API/config compatibility, accumulation caps, and concurrency/backward-compatibility concerns. The MCP issue is narrower, focused on tracing and correcting request-lifecycle cleanup in the limiter path, though it still requires careful regression testing.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search