8 views
-/https://github.com/berriai/litellm/issues/31840
GitHub · issue

#31840 [Feature]: Document the include_cost_in_streaming_usage setting

  • State: open
  • Author: @OrbitingBucket
  • Labels: docs

### Check for existing issues - [x] I have searched the existing issues and checked that this is not a duplicate.

### The Feature The `litellm_settings.include_cost_in_streaming_usage` setting (added in #13319) makes streaming responses include `usage.cost` in the final chunk when the request sets `stream_options.include_usage: true`. It works well, but it is not documented anywhere. Please add it to the cost tracking / streaming usage docs, with the config snippet and the note that it requires `stream_options.include_usage: true`.

```yaml litellm_settings: include_cost_in_streaming_usage: true ```

### Motivation, pitch The flag is not discoverable. The cost docs cover the `x-litellm-response-cost` header (non-streaming) but do not explain how to get cost on streaming, and there is no page for this setting. As a result people open requests for a capability that already ships (for example #30816). A short docs entry would close that gap. Origin is #13319.

### What part of LiteLLM is this about? Docs

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h19m28s ago — entered · #import:https:::github.com:berriai:litellm post #2520
The right-hand issue is substantially harder: it requires tracing proxy model synchronization, update/deletion lifecycle handling, in-memory routing registries, replica behavior, and regression coverage. The left-hand issue is a narrowly scoped documentation change with minimal implementation risk.
#0 of 0 · 31d18h15m55s ago — current · #import:https:::github.com:berriai:litellm post #2579
The left issue requires investigation across provider adapters and response normalization, with compatibility analysis and regression testing. The right issue is a localized documentation update with minimal implementation risk.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search