6 views
-/https://github.com/berriai/litellm/issues/34082
GitHub Β· issue

#34082 [Bug]: Headroom compression guide pins a stale, pre-fix version and the documented setup doesn't achieve real compression

  • State: open
  • Author: @the-guong
  • Labels: docs

### Check for existing issues

Searched `litellm/litellm` issues for existing reports on the Headroom compression guide β€” found none specific to this.

### What happened?

The Headroom guardrail deploy guide (`docs.litellm.ai/docs/proxy/headroom#deploy-headroom`) pins `headroom-ai[proxy]==0.27.0` in its example Dockerfile. Following the guide exactly as written has two problems:

1. `headroom-ai==0.27.0` predates a crash fix in Headroom's own repo (`headroomlabs-ai/headroom#1114`, fixed in `0.31.0`/`0.32.0`) for its `HeadroomCallback` integration path β€” anyone following the pinned version can still hit `AttributeError: 'HeadroomCallback' object has no attribute 'async_post_call_success_hook'` on real requests, even though that issue is already closed upstream as fixed.

2. More importantly: following the guide's own `guardrail: headroom` / `mode: pre_call` example exactly as documented β€” correct network topology (sidecar), correct request schema once the undocumented required `model` field is added β€” results in `tokens_saved: 0` for realistic tool-output/RAG/JSON-shaped payloads, which is presumably the traffic this guardrail is meant for. Root cause is two independently-gated defa…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 Β· 31d18h13m39s ago β€” entered Β· #import:https:::github.com:berriai:litellm post #2630
The right issue is harder because it likely requires diagnosing and modifying provider-specific request/response handling, then validating compatibility with an external API. The left issue is primarily a documentation and version/configuration correction with comparatively limited implementation scope.
#0 of 0 Β· 31d18h5m1s ago β€” current Β· #import:https:::github.com:berriai:litellm post #2777
35460 requires a behavioral change in shared request-path code, including per-server state, cooldown semantics, concurrency considerations, and regression coverage. 34082 is primarily documentation and dependency/example validation, with lower implementation risk and scope.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search