6 views
-/https://github.com/berriai/litellm/issues/34619
GitHub · issue

#34619 FAL.ai provider only supports a fraction of available models — hardcoded list vs. 200+ models on FAL

  • State: open
  • Author: @tilllt
  • Labels: llm translation

## Description

When using the FAL.ai provider in LiteLLM, users can only access a small fraction of the models that FAL.ai actually offers. The provider uses hardcoded model-specific transformation classes rather than dynamically discovering models from FAL's API.

## Current Implementation

LiteLLM's FAL provider at `litellm/llms/fal_ai/image_generation/` currently has hardcoded support for **only these endpoints**:

| LiteLLM Model ID | FAL Endpoint | |------------------|-------------| | `fal-ai/nano-banana` | `fal-ai/nano-banana` | | `fal-ai/gemini-25-flash-image` | `fal-ai/nano-banana` | | `fal-ai/imagen4/preview` | `fal-ai/imagen4/preview` | | `fal-ai/recraft/v3/text-to-image` | `fal-ai/recraft/v3/text-to-image` | | `fal-ai/bria/text-to-image` | `bria/text-to-image/3.2` | | `fal-ai/flux-pro/v1.1` | `fal-ai/flux-pro/v1.1` | | `fal-ai/flux-pro/v1.1-ultra` | `fal-ai/flux-pro/v1.1-ultra` | | `fal-ai/flux-schnell` | `fal-ai/flux-schnell` | | `fal-ai/bytedance/seedream/v3/text-to-image` | `fal-ai/bytedance/seedream/v3/text-to-image` | | `fal-ai/bytedance/dreamina/v3.1/text-to-image` | `fal-ai/bytedance/dreamina/v3.1/text-to-image` | | `fal-ai/ideogram/v3` | `fal-ai/ideogram/v3` | |…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d18h21m10s ago — entered · #import:https:::github.com:berriai:litellm post #2501
34619 requires broader provider architecture, external API discovery, model mapping, compatibility handling, and substantial testing; 26765 is a narrowly scoped pricing-data update with limited implementation risk.
Issue #34619 is harder because it requires broader provider architecture changes, runtime discovery or extensible model routing, compatibility handling, and substantial validation across many model variants. Issue #20495 is a localized field-inheritance fix with comparatively limited testing and regression risk.
#0 of 0 · 31d18h6m8s ago — current · #import:https:::github.com:berriai:litellm post #2755
Issue 34619 is harder because it requires broad provider-integration work across model discovery, endpoint mapping, request/response transformations, compatibility handling, and comprehensive testing. Issue 33456 is more likely a localized streaming-serialization compatibility fix.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search