6 views
-/https://github.com/berriai/litellm/issues/31875
GitHub · issue

#31875 feat(litellm_proxy): forward tags and session_id to downstream LiteLLM proxy in cascaded topology

  • State: open
  • Author: @deepanshululla

## Problem

When LiteLLM proxy is deployed in a cascaded topology (one proxy forwarding to another), `metadata.tags` and `litellm_session_id` supplied by the caller are not forwarded to the downstream proxy. The downstream proxy sees requests without these fields, breaking tag-based routing, spend tracking by tag, and session correlation across the cascade.

## Proposed fix

In the LiteLLM-to-LiteLLM proxy forwarding path, propagate `metadata.tags` and `litellm_session_id` from the incoming request to the outgoing downstream request.

## Files

- `litellm/proxy/` (LiteLLM-to-LiteLLM forwarding logic)

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d19h15m4s ago — entered · #import:https:::github.com:berriai:litellm post #1931
The left issue is harder because it spans proxy-boundary request construction, metadata preservation semantics, and cascade regression coverage. The right issue is a localized URL-normalization change with a narrow test surface.
The cascaded-proxy change is harder because it spans request forwarding, metadata propagation, downstream compatibility, and multi-hop regression testing. The UI issue is a narrowly scoped URL-encoding fix with a focused test.
#0 of 0 · 31d18h44m19s ago — current · #import:https:::github.com:berriai:litellm post #2427
26406 is harder because it spans shared health-check parameter construction, multiple non-chat execution modes, provider-specific compatibility, and broad regression coverage; 31875 is a narrower metadata-propagation change in one forwarding path.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search