6 views
-/https://github.com/berriai/litellm/issues/28905
GitHub · issue

#28905 [Bug]: Selected S3 vector-store embedding model is not used for ingestion

  • State: open
  • Author: @lullu57

### Check for existing issues

- [X] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When creating an S3-backed vector store from the dashboard, the selected embedding model is forwarded to `ragIngestCall` under `ingest_options.vector_store.embedding_model`. The RAG ingestion code only reads embedding settings from top-level `ingest_options.embedding`, so it never sees the selection and defaults to `text-embedding-3-small`. The endpoint persists the user-selected model for later search, so the vector store is ingested with one embedding model and queried with another.

**Observed:** `S3VectorsConfig` writes the selected model into `providerParams.embedding_model`. `ragIngestCall` places `providerParams` under `ingest_options.vector_store`, but `BaseIngestion` reads embedding configuration from `ingest_options.embedding` only. `S3VectorIngestion` therefore falls back to `{"model": "text-embedding-3-small"}` for ingestion. The RAG endpoint stores the user-selected `embedding_model` in `litellm_params`, and `S3VectorsTransformation` uses that value (the user-selected model) at query time. Ingested document vectors and query vector…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h28m29s ago — entered · #import:https:::github.com:berriai:litellm post #2388
The right issue is harder because it lacks enough diagnostic detail, so reproducing, profiling, isolating the bottleneck, and validating a safe performance fix may span multiple subsystems. The left issue appears comparatively localized to configuration propagation and consistency checks.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search