8 views
-/https://github.com/berriai/litellm/issues/30566
GitHub · issue

#30566 [Bug]: x-litellm-overhead-duration-ms header and litellm_overhead_time_ms not populated for /v1/messages and /openai/v1/responses endpoints

  • State: open
  • Author: @ankitraj2330
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

`x-litellm-overhead-duration-ms` response header and `litellm_overhead_time_ms` spend log field are not populated for requests to `/v1/messages` (Anthropic format) and `/openai/v1/responses` (OpenAI Responses API). They are correctly populated for `/v1/chat/completions`.

**`/v1/chat/completions` (Bedrock backend) — works:** ``` < x-litellm-response-duration-ms: 80.379 < x-litellm-overhead-duration-ms: 80.379 ✅ ``` `litellm_overhead_time_ms` in spend log: `80.379` ✅

**`/v1/messages` (Anthropic format, Bedrock backend) — missing:** ``` < x-litellm-response-duration-ms: ... # x-litellm-overhead-duration-ms: not present ❌ ``` `litellm_overhead_time_ms` in spend log: `null` ❌

**`/openai/v1/responses` (Azure OpenAI backend) — missing:** ``` < x-litellm-response-duration-ms: 14.966 < x-litellm-callback-duration-ms: 0.0 # x-litellm-overhead-duration-ms: not present ❌ ``` `litellm_overhead_time_ms` in spend log: `null` ❌

### Steps to Reproduce

```bash # Works — overhead header present curl -v -H "Authorization: Bearer <key>" \ -H "Content-Type…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h14m20s ago — entered · #import:https:::github.com:berriai:litellm post #2598
Issue 30566 is harder because it requires tracing and aligning cross-endpoint instrumentation across multiple request translations and accounting paths, with broader regression-testing needs. Issue 34299 is comparatively localized to exception propagation and circuit-breaker behavior in a single cache component.
#0 of 0 · 31d17h48m28s ago — current · #import:https:::github.com:berriai:litellm post #3049
#34328 requires algorithmic changes to recursive schema expansion, safe budget semantics, multi-provider caller updates, and regression testing for pathological graphs; #30566 is comparatively localized timing instrumentation across two endpoint paths.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search