6 views
-/https://github.com/berriai/litellm/issues/25563
GitHub · issue

#25563 Feature Request: support per-model SOCKS5 / outbound proxy settings in LiteLLM Proxy

  • State: open
  • Author: @Proita
  • Labels: llm translation

## What problem is this solving?

Today LiteLLM Proxy appears to support outbound proxying mainly via **process-level / environment-level** proxy settings such as:

- `HTTP_PROXY` - `HTTPS_PROXY` - `ALL_PROXY` - `AIOHTTP_TRUST_ENV`

That works for a **single global egress path**, but it does not solve a common deployment need:

> Different upstream models/providers need to use different outbound proxies.

Examples: - some model deployments must go through a SOCKS5 proxy - some should use direct outbound traffic - some should use a different HTTP/SOCKS proxy depending on provider, region, compliance, or network topology

Right now the practical workaround seems to be running **multiple LiteLLM Proxy instances** and splitting traffic externally, which adds operational complexity.

---

## Requested feature

Please support **per-model outbound proxy configuration** in `config.yaml` for LiteLLM Proxy.

For example, something like this:

```yaml model_list: - model_name: openai-via-socks5 litellm_params: model: openai/gpt-4o api_key: os.environ/OPENAI_API_KEY outbound_proxy: socks5://127.0.0.1:1080

- model_name: anthropic-direct litellm_params: model…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h37m34s ago — entered · #import:https:::github.com:berriai:litellm post #2247
The left issue requires cross-cutting proxy plumbing, provider/client integration, configuration validation, transport compatibility, and substantial testing. The right issue is primarily a localized pricing-data update with targeted verification.
#0 of 0 · 31d18h30m45s ago — current · #import:https:::github.com:berriai:litellm post #2362
Per-request routing across heterogeneous transport clients requires broad plumbing, compatibility handling, and substantial integration testing, while the other issue is primarily a contained dependency and image-build update.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search