7 views
-/https://github.com/berriai/litellm/issues/34877
GitHub · issue

#34877 [Feature]: Add `litellm config-validate` CLI subcommand for offline config-file validation

  • State: open
  • Author: @Harsh23Kashyap
  • Labels: llm translation, potential-duplicate

## Problem

Proxy config files (`config.yaml` / `model_list` JSON) are only validated at proxy startup, and many errors surface as 500s on the first request rather than as clear preflight failures. Operators who want to confirm a config is well-formed before deploying have to either start the proxy (which needs DB credentials, provider API keys, etc.) or hand-parse the YAML and visually inspect it.

Concrete failure modes the new CLI will catch:

1. Typos in `model_name` that pass schema validation but cause "model not found" at runtime 2. Duplicate `model_name` entries that silently shadow each other in the Router 3. Unknown `router_settings.routing_strategy` values (typo of `usage-based-routing-v2` etc.) that get ignored 4. `litellm_params.api_key: os.environ/VAR_NAME` references that point to unset env vars, which currently 500 on first request 5. Malformed top-level keys (camelCase vs snake_case drift) that the proxy silently ignores 6. `litellm_params.model` set to a complex value (dict, list) instead of a string

## Motivation

`litellm doctor` (env), `litellm cost-estimate` (cost), and `litellm token-count` (size) already ship as offline CLIs. The natural fourth member is co…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h42m18s ago — entered · #import:https:::github.com:berriai:litellm post #2156
The left issue is harder because it introduces a new user-facing CLI workflow spanning configuration discovery, schema and semantic validation, environment-reference checks, duplicate detection, diagnostics, exit-code behavior, documentation, and broad regression coverage. The right issue is narrower in scope, primarily requiring diagnosis and correction of an existing database migration or runtime compatibility path.
#0 of 0 · 31d18h28m8s ago — current · #import:https:::github.com:berriai:litellm post #2389
The configuration-validation CLI spans new command plumbing, offline parsing, cross-field and semantic validation, environment-reference handling, diagnostics, and broad test coverage. The streaming bug is narrower: it likely requires tracing request translation and conditionally suppressing an incompatible option for one API/provider path, with focused regression tests.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search