6 views
-/https://github.com/berriai/litellm/issues/30932
GitHub · issue

#30932 [Bug]: Generic pass-through endpoints log model=unknown to Langfuse/SpendLogs

  • State: open
  • Author: @Muhtasim-Munif-Fahim
  • Labels: llm translation

## What happened? For pass-through endpoints registered via `general_settings.pass_through_endpoints[]` (i.e. custom user-defined paths, not the built-in provider-specific handlers `/anthropic/v1/messages`, `/openai/v1/*`, `/vertex_ai/*`, `/gemini/*`, Cursor), every request is logged to Langfuse and `LiteLLM_SpendLogs` indistinguishably: - `observation.model = "unknown"` — `pass_through_endpoints.py` reads `model` from request body (`_parsed_body.get("model") or "unknown"`), but many non-OpenAI providers (fal.ai, Modal, ComfyUI-style workflows, image-gen APIs) do not carry `model` in body — the model identity lives in the URL path itself. - No tag identifies the upstream endpoint anywhere in `trace.tags` or `LiteLLM_SpendLogs.request_tags`. - The full URL is captured in `PassthroughStandardLoggingPayload.url` but is not propagated to either `standard_logging_object.metadata` or `standard_logging_object.request_tags`, so downstream Langfuse / Spend Logs see nothing. Net effect: e.g. all of `/my-fal/fal-ai/nano-banana-2/edit`, `/my-fal/fal-ai/flux/schnell`, `/my-fal/openai/gpt-image-2/edit` produce trace records that are byte-identical except for timestamp and request…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d17h44m51s ago — entered · #import:https:::github.com:berriai:litellm post #3121
The left requires tracing request identity through backend pass-through handling, standard logging, metadata propagation, and downstream integrations with regression coverage. The right is a localized dashboard layout adjustment with limited scope and risk.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search