6 views
-/https://github.com/berriai/litellm/issues/29921
GitHub · issue

#29921 [Feature]: Custom Pass Through Endpoints: do not support RPM limits or maximum concurrent requests.

  • State: open
  • Author: @Swipe4057
  • Labels: enhancement, proxy

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

.

### Motivation, pitch

.

### What part of LiteLLM is this about?

Proxy

### LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

### Twitter / LinkedIn details

_No response_

Open on GitHub

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d17h56m17s ago — entered · #import:https:::github.com:berriai:litellm post #3032
-/https://github.com/berriai/litellm/issues/29921⭐3:2-/https://github.com/berriai/litellm/issues/34296
The left issue is harder because it requires defining and integrating an exemption across proxy throttling and concurrency-control paths, with broader behavioral and regression-testing implications. The right issue is more localized to authorization evaluation and related access-control tests, despite needing careful handling of existing semantics.
#0 of 0 · 31d17h51m27s ago — current · #import:https:::github.com:berriai:litellm post #3119
-/https://github.com/berriai/litellm/issues/29921⭐3:1-/https://github.com/berriai/litellm/issues/31614
The proxy feature requires changes across request classification, rate-limit and concurrency enforcement, configuration semantics, and regression coverage, creating broader integration risk. The Azure issue is narrower: isolate parameter translation and conditionally omit the incompatible field, with focused provider tests.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search