9 views
-/https://github.com/berriai/litellm/issues/29766
GitHub ยท issue

#29766 [Bug]: /v1/audio/transcriptions collapses repeated known_speaker_references[]/known_speaker_names[] to the last value (breaks gpt-4o-transcribe-diarize multi-speaker)

  • State: open
  • Author: @Baleares86
  • Labels: llm translation

## What happened?

When calling the LiteLLM proxy's `POST /v1/audio/transcriptions` endpoint with OpenAI's `gpt-4o-transcribe-diarize` model and **multiple** speaker references, only **one** reference โ€” the **last** one in the request โ€” is actually forwarded to OpenAI. All earlier `known_speaker_names[]` / `known_speaker_references[]` entries are silently dropped.

OpenAI's diarization model accepts up to **4** known speakers, supplied as **repeated multipart form fields** (the `field[]` array convention):

``` -F 'known_speaker_names[]=alice' -F 'known_speaker_references[]=data:audio/wav;base64,...' -F 'known_speaker_names[]=bob' -F 'known_speaker_references[]=data:audio/wav;base64,...' ```

(See OpenAI Speech-to-text guide โ†’ *Speaker diarization*.)

Sending the same request **directly to OpenAI** maps all speakers correctly. Sending it **through the LiteLLM proxy** results in only the **last** reference being honored โ€” the repeated `[]` array fields appear to be collapsed to a single (last) value before being re-sent upstream.

## Definitive minimal reproduction

The cleanest proof that this is an array-collapsing bug (and **not** a model/quality issue): send **two references uโ€ฆ

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 ยท 31d18h23m53s ago โ€” entered ยท #import:https:::github.com:berriai:litellm post #2548
The first issue requires coordinated request parsing, array-preserving multipart serialization, upstream compatibility validation, and regression coverage. The second issue provides insufficient detail to indicate comparable implementation scope, so its assessed effort and risk are lower.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search