6 views
-/https://github.com/berriai/litellm/issues/25372
GitHub · issue

#25372 [Feature]: Support Azure AI Foundry Agents v2 (Responses API with agent_reference)

  • State: open
  • Author: @bachya
  • Labels: llm translation

## Feature Request

### What is your use case?

We are integrating with Microsoft Foundry Agent Service. We've deployed agents using the new Foundry Agents v2 experience, which uses the Responses API with `agent_reference` (referencing agents by name and version) rather than the deprecated Assistants API (thread/run pattern with `asst_*` IDs).

The current `azure_ai/agents/{agent_id}` route in LiteLLM implements the old Assistants API pattern, which: 1. Requires agent IDs beginning with `asst_` (but the new Foundry experience does not surface these IDs) 2. Uses the thread → message → run → poll flow (but the new Foundry Agents v2 uses `openai_client.responses.create()` with an `agent_reference` in `extra_body`)

Microsoft has [deprecated the Assistants API](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/assistant) with retirement set for **August 26, 2026**.

### The new API pattern

From the Azure AI Foundry getting-started code:

```python from azure.ai.projects import AIProjectClient from azure.identity import DefaultAzureCredential

project_client = AIProjectClient( endpoint="https://<resource>.services.ai.azure.com/api/projects/<project>", creden…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h23m4s ago — entered · #import:https:::github.com:berriai:litellm post #2669
The left issue requires a broader provider integration with new request semantics, authentication/configuration handling, response translation, streaming behavior, and end-to-end coverage. The right issue is primarily a focused Router fallback enhancement involving context estimation and retry-path handling, with comparatively lower architectural risk.
#0 of 0 · 31d18h13m28s ago — current · #import:https:::github.com:berriai:litellm post #2835
The right-hand task is substantially broader: it requires a new service integration, translation-layer behavior, configuration and compatibility handling, and extensive testing. The left-hand task appears localized to an interface-conformance defect with focused regression coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search