6 views
-/https://github.com/berriai/litellm/issues/30939
GitHub · issue

#30939 [Feature]: Ability to sample spans into DataDog LLM Observability

  • State: open
  • Author: @marcus-linktree
  • Labels: enhancement, proxy

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Ability to use a knob to sample spans into DataDog LLM Observability product.

### Motivation, pitch

For high volume requests the costs of DataDog LLM Observability become large due to no ability to sample spans.

Request to provide a knob for the sample rate into DataDog LLM Observability, similarly to what exists for LangSmith etc.

### What part of LiteLLM is this about?

Proxy

### LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d17h41m9s ago — entered · #import:https:::github.com:berriai:litellm post #3177
The harder task spans proxy configuration, telemetry pipeline behavior, sampling semantics, backward compatibility, and integration tests; the other is a narrower provider-translation validation and remediation change.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search