6 views
-/https://github.com/berriai/litellm/issues/28482
GitHub · issue

#28482 [Feature]: Azure OpenAI decouple deployment ID from model name via base_model

  • State: open
  • Author: @withomasmicrosoft
  • Labels: enhancement, llm translation, SDK

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Creating this issue to link to PR that will be submited shortly.

Azure OpenAI Deployment Id is not underlying model name. If we leverage base_model we can tell LiteLLM exactly which model is being used, this fixes an existing issue with Azure OpenAI model detection logic which breaks if deployment names are not standard. This feature proposes a backward compatible solution that unblocks Azure OpenAI customers.

``` import litellm

# =========================================================================== # BEFORE: Custom deployment name — LiteLLM can't detect model type # ===========================================================================

# ❌ This uses default Azure config because "my-gpt5-deployment" doesn't match # any known model pattern. max_tokens won't be mapped to max_completion_tokens, # and gpt-5-specific behavior is lost.

# --- SDK direct call (before) --- response = litellm.completion( model="azure/gpt5_series/my-gpt5-deployment", messages=[{"role": "user", "content": "Hello!"}], max_tokens=100, api_k…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d17h51m55s ago — entered · #import:https:::github.com:berriai:litellm post #3015
The left issue is harder because it requires provider-specific model-resolution changes across SDK and translation paths while preserving existing Azure behavior and compatibility. The right issue appears comparatively localized to tag-merging logic with focused regression coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search