7 views
-/https://github.com/berriai/litellm/issues/33021
GitHub · issue

#33021 [Bug]: Componentized gateway/backend ignore database pool limits and IAM refresh drops URL parameters

  • State: open
  • Author: @emerzon
  • Labels: proxy

## Check for existing issues

- [x] I searched the existing issues and confirmed this is not a duplicate

Related reports such as [#26619](https://github.com/BerriAI/litellm/issues/26619), [#17281](https://github.com/BerriAI/litellm/issues/17281), and [#15536](https://github.com/BerriAI/litellm/issues/15536) describe connection growth or exhaustion, but none identify the componentized startup path or IAM URL reconstruction defects below

## What happened?

In componentized deployments using `gateway.main:app` and `backend.main:app`, the Prisma connection pool settings from `general_settings` are not applied to the database URLs

There is a second defect when `IAM_TOKEN_DB_AUTH=true`: every IAM token refresh reconstructs the writer or reader URL with only the `schema` query parameter, discarding `connection_limit`, `pool_timeout`, `connect_timeout`, `socket_timeout`, `sslmode`, `pgbouncer`, and any custom query parameters

Together these defects can make active PostgreSQL connections greatly exceed the configured value over a long-running deployment. Each gateway/backend worker or replica owns an independent Prisma pool, so the effective ceiling is already per process. If `connectio…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h57m5s ago — entered · #import:https:::github.com:berriai:litellm post #2020
Model omitted braces; inferred difficulty from issue scope and surface area.
#0 of 0 · 31d17h54m38s ago — current · #import:https:::github.com:berriai:litellm post #3062
The right issue spans multiple startup paths, connection-management behavior, credential-refresh logic, URL preservation, and deployment-level testing, creating higher integration risk. The left issue is comparatively localized to configuration resolution and model-specific behavior.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search