8 views
-/https://github.com/berriai/litellm/issues/26886
GitHub · issue

#26886 [Bug]: Prisma reconnection failed

  • State: open
  • Author: @xiaocongji
  • Labels: bug, proxy

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

We've been experiencing periodic instability in our LiteLLM proxy pod. The issue manifests as the Prisma query engine process crashing:

``` 13:50:30 - LiteLLM Proxy:WARNING: utils.py:4178 - Attempting Prisma DB reconnect. reason=db_health_watchdog_connection_error 13:50:30 - LiteLLM Proxy:ERROR: utils.py:3918 - prisma-query-engine PID 71 exited (waitpid thread); triggering reconnect. ```

Once the query engine crashes, all subsequent database calls fail immediately:

``` prisma.errors.ClientNotConnectedError: Client is not connected to the query engine, you must call `connect()` before attempting to query data. ```

LiteLLM detects the persistent failures and performs a clean shutdown, triggering a Kubernetes pod restart. This restart cycle repeated 4 times before the reconnect finally succeeded and the pod reached a stable state on the 5th attempt.

We have two questions: 1. Is this a known bug in LiteLLM or Prisma, or is this expected behavior under certain conditions? 2. Are there any configuration changes (e.g., connection pool tuning, re…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d18h41m18s ago — entered · #import:https:::github.com:berriai:litellm post #2197
Issue #26886 is harder because it involves diagnosing and stabilizing Prisma query-engine crashes, reconnection behavior, health-watchdog interactions, and Kubernetes restart lifecycle risks. Issue #26443 appears comparatively localized to provider classification and parameter-wrapping logic, with focused code changes and tests.
The Prisma reconnection problem is harder because it involves database-client lifecycle management, subprocess failure recovery, proxy shutdown behavior, Kubernetes restart interactions, and reliable reproduction/testing. The command-line launch problem is comparatively narrow and likely limited to installation, PATH, or invocation diagnostics.
#0 of 0 · 31d17h49m44s ago — current · #import:https:::github.com:berriai:litellm post #3055
The database reliability issue is harder because it requires diagnosing and safely redesigning failure recovery across Prisma, process lifecycle, connection pooling, and proxy availability, whereas the feature is a more localized request-header propagation and configuration change.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search