8 views
-/https://github.com/berriai/litellm/issues/35430
GitHub · issue

#35430 [Bug][Proxy]: Vector store routes ignore request model and embedded File ID routing

  • State: open
  • Author: @ymuichiro
  • Labels: proxy

## Check for existing issues

- [x] I searched the existing issues and checked that this is not a duplicate

## What happened?

Some LiteLLM Proxy vector store routes do not carry the request model into provider routing. When no managed registry model is available, `?model=` and `x-litellm-model` can be ignored for create, list, update, and search requests, causing a wrong provider fallback or a `model=None` failure

Model-embedded File IDs can also reach the upstream provider without decoding. This affects vector store routing and provider request preparation in the Proxy

## Steps to Reproduce

1. Configure multiple provider deployments in the Proxy `model_list` 2. Call vector store create, list, update, or search with `?model=<model>` or `x-litellm-model: <model>` 3. Observe that the selected provider does not match the request model, or that routing fails with `model=None` 4. Use a File ID produced by model-based file routing and observe that the model-embedded ID is forwarded unchanged

## Relevant log output

```text Expected: the request model selects the configured deployment and the upstream receives the original File ID Actual: the request falls back to the wrong provid…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (7 events)
#0 of 0 · 31d19h20m5s ago — entered · #import:https:::github.com:berriai:litellm post #1642
Multi-path proxy routing and identifier preparation span several request flows and provider boundaries, creating broader regression risk; the other change is a localized response-schema propagation fix.
The right issue is harder because it spans several proxy endpoints, request-model propagation, provider selection, and identifier transformation, requiring coordinated routing and regression testing across integrations. The left issue is comparatively localized to configuration flow and runtime placeholder handling.
35430 is harder because it crosses proxy request propagation, deployment selection, provider preparation, and identifier handling across several vector-store operations, creating broader regression and compatibility risk. 23102 is substantial due to realtime streaming and SDK/provider translation, but is more focused on introducing one endpoint integration.
29966 spans container build pipelines, release publication, Helm defaults, multi-architecture validation, and version synchronization, creating broad CI/release risk. 35430 is primarily a localized proxy routing and request-preparation correction with targeted regression tests, so it has a smaller implementation surface.
The right issue spans multiple proxy routes, routing propagation, provider selection, and identifier preprocessing, requiring broader code tracing and regression coverage. The left issue is a comparatively localized budget-period calculation correction.
The right issue is harder because it spans multiple proxy operations and shared routing/request-preparation paths, requiring broader compatibility analysis and regression coverage. The left issue appears more localized to endpoint selection and translation behavior, with a narrower implementation surface.
#0 of 0 · 31d18h7m11s ago — current · #import:https:::github.com:berriai:litellm post #2840
Issue 35430 is harder because it requires debugging and changing cross-cutting proxy routing and request-preparation behavior across multiple endpoints, with compatibility and regression testing across providers. Issue 19769 is comparatively contained to Helm dependency and deployment configuration updates, though chart validation and image compatibility still add some risk.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search