18 views
-/https://github.com/berriai/litellm/issues/26322
GitHub · issue

#26322 [Bug]: azure_ai/mistral-large-3 does not support max_completion_tokens

  • State: open
  • Author: @Slyvred
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

This issue is closely related to the [issue #9583](https://github.com/BerriAI/litellm/issues/9583).

Description: Systematic error encountered when calling mistral-large-3 hosted on Microsoft Foundry with the parameter `max_completion_tokens`

```json { "error": { "message": "litellm.APIConnectionError: APIConnectionError: Azure_aiException - Extra data: line 2 column 1 (char 209). Received Model Group=mistral-large-3\nAvailable Model Group Fallbacks=None", "type": null, "param": null, "code": "500" } } ```

This error is only encountered with this model. When switching to any other model the following requests works flawlessly:

```bash curl --location 'http://localhost:4000/v1/chat/completions' --header 'Content-Type: application/json' --header 'Authorization: Bearer sk-1234' --data '{ "model": "mistral-large-3", "messages": [ { "role": "system", "content": [ { "type": "text", "text": "Faux contexte" } …

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d17h59m3s ago — entered · #import:https:::github.com:berriai:litellm post #2976
The right issue is harder because it involves asynchronous lifecycle management, task ownership, and compatibility with an upstream dependency, whereas the left is a narrower provider-specific parameter translation fix.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search