18 views
-/https://github.com/berriai/litellm/issues/24928
GitHub Ā· issue

#24928 store_prompts_in_spend_logs: false still stores full embedding response vectors in SpendLogs

  • State: open
  • Author: @zebinho20-belenus

## Bug Description

With `store_prompts_in_spend_logs: false` in `general_settings`, embedding responses (full float vectors) are still written to the `response` column in `LiteLLM_SpendLogs`. This causes significant DB bloat — each embedding request stores the complete vector array (e.g. 1024 floats for bge-m3).

## Expected Behavior

With `store_prompts_in_spend_logs: false`, the `response` column should remain `{}` for all call types, including `embedding` and `aembedding`.

## Actual Behavior

The `response` column contains the full embedding response including all float vectors, despite the flag being set to `false`.

## Steps to Reproduce

1. Set `store_prompts_in_spend_logs: false` in `general_settings` 2. Send an embedding request through the proxy 3. Query the DB: ```sql SELECT call_type, length(response::text) FROM "LiteLLM_SpendLogs" WHERE call_type IN ('embedding', 'aembedding') ORDER BY "startTime" DESC LIMIT 5; ``` 4. Observe that `response` contains the full vector data instead of `{}`

## Environment

- **LiteLLM version:** 1.82.3 - **Deployment:** Docker (LiteLLM Proxy) - **DB:** PostgreSQL - **Embedding model:** BAAI/bge-m3 (1024 dimensions) v…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 Ā· 31d18h22m46s ago — entered Ā· #import:https:::github.com:berriai:litellm post #2567
The security issue is harder because it requires careful changes across response-ID encryption, fallback handling, authorization semantics, backward compatibility, and security-focused testing. The logging issue is comparatively localized to embedding response persistence and regression coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search