9 views
-/https://github.com/berriai/litellm/issues/31726
GitHub · issue

#31726 [Bug]: Realtime proxy injects a duplicate response.create on input_audio_transcription.completed, causing conversation_already_has_active_response (when no realtime guardrail is configured)

  • State: open
  • Author: @RonP3
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When proxying a realtime (voice) session through LiteLLM with **server-VAD turn detection** and **input audio transcription enabled**, and with **no `realtime_input_transcription` guardrail configured**, the backend (Azure OpenAI GA realtime) returns an error on every user turn:

```json { "type": "error", "error": { "type": "invalid_request_error", "code": "conversation_already_has_active_response", "message": "Conversation already has an active response in progress: resp_XXX. Wait until the response is finished before creating a new one." } } ```

The same client connecting **directly** to Azure OpenAI realtime (no LiteLLM proxy) does **not** hit this - so the duplicate response is introduced by the proxy.

## Root cause

The proxy unconditionally injects a `response.create` to the backend when it sees `conversation.item.input_audio_transcription.completed`, **without** having disabled the backend's server-VAD auto-response. The backend's VAD already auto-creates a response for the user turn (`turn_detection.create_response…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h32m28s ago — entered · #import:https:::github.com:berriai:litellm post #2345
The left issue requires debugging stateful realtime event sequencing, coordinating proxy behavior with backend VAD semantics, and validating timing-sensitive regressions across streaming scenarios. The right issue is comparatively localized to response schema propagation and focused unit or integration coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search