9 views
-/https://github.com/berriai/litellm/issues/34914
GitHub · issue

#34914 [Bug]: service_tier parameter rejected by Vertex AI (v1 API) with 400 for all values

  • State: open
  • Author: @tobias-mayr
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

## Actual behaviour

When sending `service_tier` (e.g. `"flex"`, `"priority"`) through the LiteLLM proxy to a `vertex_ai/` model, Vertex AI rejects the request with a 400 error:

Invalid value at 'service_tier' (type.googleapis.com/google.cloud.aiplatform.v1.ServiceTier), "flex"

This happens for ALL values — lowercase (`flex`, `priority`, `standard`), uppercase (`FLEX`, `PRIORITY`, `STANDARD`), and across all Gemini models tested (`gemini-3.5-flash-lite`, `gemini-2.5-flash`, `gemini-2.5-pro`, `gemini-3.5-flash`).

## Expected behaviour

`service_tier` should be correctly translated and accepted by the Vertex AI API, or gracefully dropped if the field is not supported for the v1 API / project configuration.

## Impact

Users cannot use `service_tier` to select priority/flex capacity for Vertex AI Gemini models. This forces workarounds like defining duplicate model entries in the proxy config with `extra_headers` (e.g. `X-Vertex-AI-LLM-Shared-Request-Type: priority`), which defeats the purpose of the `service_tier` parameter added in #24898.

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h45m53s ago — entered · #import:https:::github.com:berriai:litellm post #2307
#30432 requires a broad optimization subsystem spanning SDK/proxy workflows, configurable search and evaluation loops, integrations, persistence, and operational safeguards; #34914 is a comparatively localized provider-parameter translation and compatibility fix.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search