8 views
-/https://github.com/berriai/litellm/issues/30135
GitHub · issue

#30135 [Bug]: tiered pricing fields (`*_above_200k_tokens`) ignored in cost calculations — base rate applied flat to all tokens

  • State: open
  • Author: @Suseelraj
  • Labels: bug, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When configuring custom model pricing via `model_info` in the LiteLLM config YAML, the `*_above_200k_tokens` tiered pricing fields are silently ignored during cost calculation. The base rate is applied flat across all tokens regardless of request size, resulting in significant cost undercharging for large-context requests

### Steps to Reproduce

1. Configure a model with above-200k tiered pricing in `model_info`:

```yaml - model_name: "claude-opus-4-6" litellm_params: model: vertex_ai/claude-opus-4-6 vertex_project: "my-project" vertex_location: "global" model_info: input_cost_per_token: 0.000005 output_cost_per_token: 0.000025 cache_read_input_token_cost: 0.0000005 cache_creation_input_token_cost: 0.00000625 input_cost_per_token_above_200k_tokens: 0.00001 output_cost_per_token_above_200k_tokens: 0.0000375 cache_creation_input_token_cost_above_200k_tokens: 0.0000125 cache_read_input_token_cost_above_200k_tokens: 0.000001

Send a request with >200k prompt tokens (e.g. 585,659 cache creation token…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h44m51s ago — entered · #import:https:::github.com:berriai:litellm post #2140
The right issue spans a new Kubernetes-facing product surface, CRD design, reconciliation, lifecycle management, multi-tenancy, GitOps workflows, security, packaging, and operational testing. The left issue is comparatively contained within pricing and token-cost calculation logic, though it still requires careful tier and regression testing.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search