8 views
-/https://github.com/berriai/litellm/issues/31606
GitHub · issue

#31606 [Feature]: Support time-based / peak-offpeak pricing for model cost calculation

  • State: open
  • Author: @winxuan
  • Labels: enhancement, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

DeepSeek charge different rates for the same model depending on the time window:

off-peak hours: lower input/output token cost peak hours: standard or higher input/output token cost Currently, LiteLLM's model_info pricing fields appear to be static, such as:

input_cost_per_token output_cost_per_token cache_read_input_token_cost This makes it difficult to represent providers whose pricing changes by time period while keeping LiteLLM's built-in cost tracking accurate.

### Motivation, pitch

<img width="1074" height="1116" alt="Image" src="https://github.com/user-attachments/assets/8e8ab465-21d6-4c1a-8332-fa4f8f571b60" />

### What part of LiteLLM is this about?

Proxy

### LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

Yes

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (4 events)
#0 of 0 · 31d18h44m30s ago — entered · #import:https:::github.com:berriai:litellm post #2225
The right issue spans provider behavior, streaming, endpoint compatibility, and documentation across multiple integration paths, creating broader testing and regression risk. The left issue is a focused but cross-cutting pricing-model change with time-aware calculation and backward-compatibility concerns.
The right-side work spans shared pricing resolution, request-time context, configuration semantics, and broader regression coverage, while the left-side work is comparatively bounded provider/model integration.
#31606 requires cross-cutting pricing-model, scheduling, configuration, and accounting changes with substantial compatibility and testing risk; #34763 is a localized dashboard form update leveraging existing backend behavior
#0 of 0 · 31d18h7m32s ago — current · #import:https:::github.com:berriai:litellm post #2829
The right-side work is a broader cross-cutting feature: it affects pricing configuration, runtime cost resolution, provider/model behavior, time-zone and boundary handling, backward compatibility, and comprehensive testing. The left-side work is a more localized frontend debugging and compatibility fix, though reproducing the hydration failure may add some risk.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search