8 views
-/https://github.com/berriai/litellm/issues/30033
GitHub · issue

#30033 [Feature]: Auto-tag generic pass-through requests by upstream URL for observability (Langfuse / Spend Logs)

  • State: open
  • Author: @mogilevich
  • Labels: llm translation

## What happened?

For pass-through endpoints registered via `general_settings.pass_through_endpoints[]` (i.e. custom user-defined paths, not the built-in provider-specific handlers `/anthropic/v1/messages`, `/openai/v1/*`, `/vertex_ai/*`, `/gemini/*`, Cursor), every request is logged to Langfuse and `LiteLLM_SpendLogs` indistinguishably:

- `observation.model = "unknown"` — `pass_through_endpoints.py` reads `model` from request body (`_parsed_body.get("model") or "unknown"`), but many non-OpenAI providers (fal.ai, Modal, ComfyUI-style workflows, image-gen APIs) do not carry `model` in body — the model identity lives in the URL path itself. - No tag identifies the upstream endpoint anywhere in `trace.tags` or `LiteLLM_SpendLogs.request_tags`. - The full URL is captured in `PassthroughStandardLoggingPayload.url` but is not propagated to either `standard_logging_object.metadata` or `standard_logging_object.request_tags`, so downstream Langfuse / Spend Logs see nothing.

Net effect: e.g. all of `/my-fal/fal-ai/nano-banana-2/edit`, `/my-fal/fal-ai/flux/schnell`, `/my-fal/openai/gpt-image-2/edit` produce trace records that are byte-identical except for timestamp and request body — impos…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h3m36s ago — entered · #import:https:::github.com:berriai:litellm post #2801
The right issue is harder because it spans API translation, streaming usage normalization, cache accounting, and compatibility across response formats, requiring careful regression coverage. The left issue is comparatively contained to enriching metadata and request-tag propagation through logging.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search