8 views
-/https://github.com/berriai/litellm/issues/29268
GitHub · issue

#29268 [Bug]: Docker image still bundles ddtrace 2.19.0 — breaks /embeddings on Python 3.13 with APM (v1.86.2)

  • State: open
  • Author: @gnidoc327
  • Labels: llm translation

## Description

The LiteLLM Docker image (including latest v1.86.2) still ships with **ddtrace 2.19.0**, which breaks the \`/embeddings\` endpoint entirely when APM tracing is enabled on Python 3.13.

This was originally reported in #8744, but that issue was auto-closed as stale without a fix.

## Root Cause

\`ddtrace==2.19.0\` has a bug in its function bytecode rewriting that causes a \`coroutine already executing\` error when \`AsyncOpenAI\` client is reused on Python 3.13. This affects all Azure OpenAI and OpenAI embedding models going through \`/embeddings\`.

The fix was released in **ddtrace==2.19.2** (DataDog issue: https://github.com/DataDog/dd-trace-py/issues/11994).

## Affected Versions

Confirmed broken: v1.83.7-stable through **v1.86.2** (latest as of 2026-05-29)

```sh # Verify ddtrace version in current image: docker run --rm --entrypoint /bin/sh ghcr.io/berriai/litellm:v1.86.2 \ -c "/app/.venv/bin/python -c 'import ddtrace; print(ddtrace.__version__)'" # Output: 2.19.0 ```

## Steps to Reproduce

1. Run LiteLLM v1.86.2 with `USE_DDTRACE=true` and `DD_APM_ENABLED=true` 2. Send any request to `POST /v1/embeddings` with an Azure OpenAI or OpenAI embedding model 3. O…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h31m3s ago — entered · #import:https:::github.com:berriai:litellm post #2362
Per-request routing across heterogeneous transport clients requires broad plumbing, compatibility handling, and substantial integration testing, while the other issue is primarily a contained dependency and image-build update.
#0 of 0 · 31d17h54m46s ago — current · #import:https:::github.com:berriai:litellm post #2957
The left requires diagnosing and correcting distributed request/response behavior across multiple provider adapters and tool-calling paths, with compatibility and regression-testing risk. The right is comparatively contained dependency and image-build maintenance with focused validation.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search