6 views
-/https://github.com/berriai/litellm/issues/31610
GitHub · issue

#31610 [Bug]: Redis Semantic cache not working as expected

  • State: open
  • Author: @akshata2388
  • Labels: bug

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

A bug happened! I would like to reopen this ticket with same issue.. https://github.com/BerriAI/litellm/issues/6954

### Steps to Reproduce

1. any prompt with exact match hash value will work , doesnt call the llm 2nd time. 2. Semantic cache worked only 1 time rest failed. Prompt with slight mismatch will call llm backend everytime.. Cache miss happened most of the time

### Relevant log output

```shell

```

### What part of LiteLLM is this about?

_No response_

### What LiteLLM version are you on ?

LiteLLM: Current Version = 1.90.0

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h11m36s ago — entered · #import:https:::github.com:berriai:litellm post #2760
The left issue is harder because it requires diagnosing stateful distributed-cache behavior, similarity logic, provider interactions, and regression coverage across multiple execution paths. The right issue is more localized to configuration serialization and validating a narrow UI/API fix.
#0 of 0 · 31d17h49m41s ago — current · #import:https:::github.com:berriai:litellm post #3146
The right-side task is harder because it requires diagnosing stateful cache behavior across matching logic, Redis integration, and regression coverage, while the left-side task is a contained data/catalog update with comparatively straightforward validation.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search