7 views
-/https://github.com/berriai/litellm/issues/34616
GitHub ยท issue

#34616 Voxtral models not visible in Mistral API model list โ€” only available as audio_transcription

  • State: open
  • Author: @tilllt
  • Labels: llm translation

## Description

When configuring a Mistral AI API key in the LiteLLM proxy, the Voxtral models (e.g. `mistral/voxtral-mini-latest`) do **not** appear in the `/v1/models` endpoint or in any model list query. This is confusing for users who add Mistral as a provider and expect all Mistral models to be discoverable.

## Current Behavior

- Voxtral is **not listed** in the Mistral supported models table (chat completions) - Voxtral only works via explicit `model_list` configuration with `model_info: {mode: audio_transcription}` - Voxtral does **not** show up when querying `/v1/models` through the proxy - Users must manually add it to `model_list` with the correct `mode: audio_transcription` to use it

## Expected Behavior

Voxtral should either: 1. Appear in the `/v1/models` endpoint (at minimum under a separate category like `audio_transcription`) 2. Or the Mistral provider documentation should **explicitly and prominently** state that Voxtral is only available via the audio transcription endpoint, not chat completions

## Steps to Reproduce

1. Configure LiteLLM proxy with a Mistral API key 2. Query `/v1/models` โ€” no Voxtral models appear 3. Try to use Voxtral via chat completions โ€” โ€ฆ

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 ยท 31d18h9m18s ago โ€” entered ยท #import:https:::github.com:berriai:litellm post #2797
Model omitted braces; inferred difficulty from issue scope and surface area.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search