8 views
-/https://github.com/berriai/litellm/issues/24235
GitHub · issue

#24235 [Feature]: Exclude BYOK models from team billing data

  • State: open
  • Author: @rameyers
  • Labels: enhancement

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Add the ability to exclude billing data for models marked as BYOK when pulling usage from the API.

### Motivation, pitch

We have two separate uses for LiteLLM.

1. Manage keys and usage for models that we provide access to, where we then bill each team at the end of the month for the usage accumulated. This is working for our purposes. 2. Users bring their own keys and then use LiteLLM for enforcing member-level budgeting on them. They pay for the usage of these directly. As a result, we do not want to include these models’ usage when we bill them. Zeroing out the input and output costs doesn’t work because that defeats the purpose of using it to put budgets on member use.

We want the ability to exclude BYOK accounting records so that they aren't charged twice (once using their own API key and once by us). We currently pull monthly usage using the /global/spend/report API.

### What part of LiteLLM is this about?

Other

### LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

### T…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h38m28s ago — entered · #import:https:::github.com:berriai:litellm post #2235
Issue #24235 is harder because it requires defining and applying billing-exclusion semantics across usage aggregation, BYOK classification, reporting behavior, and regression coverage, with a higher risk of affecting financial correctness. Issue #32596 appears more localized to correcting duplicate persistence behavior in an existing managed-batch retrieval path.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search