8 views
-/https://github.com/berriai/litellm/issues/27883
GitHub · issue

#27883 [Feature]: server-side managed settings for codex/claude

  • State: open
  • Author: @miloaissatu
  • Labels: enhancement, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Can LiteLLM have something similar to this functionality for codex+chatgpt, i.e. provide requirements.toml server-side for admins to mandate settings/requirements for the tool. https://developers.openai.com/codex/enterprise/managed-configuration#configure-cloud-managed-requirements

Similarly there's server-side managed settings for claude-code https://code.claude.com/docs/en/server-managed-settings

### Motivation, pitch

This would help org admins centrally administer important configs for AI tools when using LiteLLM. The endpoint level admin is more difficult to distribute and keep up to date, making it prone to drift.

### What part of LiteLLM is this about?

Proxy

### LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (23 events)
#0 of 0 · 31d18h29m58s ago — entered · #import:https:::github.com:berriai:litellm post #2368
The left item is a broad proxy feature spanning centralized configuration, multiple tool integrations, validation, persistence, access control, and rollout behavior. The right item is likely a localized observability/accounting defect involving metric calculation or initialization, with narrower testing and regression scope.
The managed-settings feature is broader and riskier, requiring new proxy configuration flows, provider-specific translation, policy precedence, validation, persistence, and extensive compatibility testing. The compliance defect appears comparatively localized to handling multi-valued lifecycle hooks in existing reporting logic.
The managed-settings feature is harder because it requires new server-side configuration flows, policy enforcement, compatibility across multiple client ecosystems, secure administration, and broad integration testing. The compatibility-matrix item is primarily validation and release-gate work over an already implemented multi-commit stack, making it less implementation-intensive despite its testing breadth.
The left requires repository-wide architectural refactoring, dependency auditing, compatibility preservation, and legal-risk validation; the right is a contained proxy configuration feature with narrower implementation and testing scope.
The left task requires diagnosing and correcting distributed state consistency under failure conditions, with concurrency, retries, persistence, and backward-compatibility risks. The right task is primarily a bounded configuration and policy-integration feature with a clearer implementation surface.
27883 is harder because it spans proxy-level administration, policy enforcement, configuration storage and distribution, and multiple tool-specific integrations, creating broader compatibility and security risks. 30501 is comparatively localized to multimodal request normalization and Gemini provider translation, with focused validation and test coverage.
#21347 is harder because it requires broad, ongoing compatibility infrastructure across schemas, providers, response paths, tests, and likely generated or evolving specifications. #27883 is comparatively narrower: implementing centralized configuration handling and enforcement for a limited set of tools.
27883 is harder because it spans new proxy-facing configuration semantics and integrations for multiple external tool ecosystems, while 34733 is a focused concurrency and persistence fix within an existing budgeting path.
The left item spans multiple external tool ecosystems and requires designing secure server-side configuration delivery and compatibility behavior, creating substantial integration and policy risk. The right item is broader than a simple counter because it touches persistence, concurrency, time windows, APIs, and UI, but it remains a more bounded gateway quota feature. Thus the left is moderately harder.
The left issue is substantially harder: it spans multiple integrations, requires a new centrally administered configuration model, and raises API, validation, persistence, security, and compatibility concerns. The right issue is a comparatively localized reliability fix in an existing asynchronous logging workflow, with focused tests around task completion and failure handling.
Issue 30421 is harder because it spans a new CLI workflow, interactive model discovery and selection, authentication, subprocess/environment configuration, and compatibility with several independently evolving agent tools. Issue 27883 is narrower, primarily requiring server-side configuration storage, validation, and delivery for two integrations.
#27883 requires broader proxy architecture, configuration lifecycle, provider/tool integration, admin controls, and security validation; #32280 is a localized logging/response-shape fix with targeted regression coverage.
The managed-settings feature spans new proxy configuration architecture, tool-specific semantics, persistence, authorization, rollout behavior, and broad integration testing. The budget issue is comparatively contained to diagnosing the reset path and correcting validation or update logic, with narrower regression testing.
27883 is harder because it requires cross-cutting proxy configuration, administrative policy distribution, persistence, validation, and compatibility across multiple tool ecosystems. 32456 is comparatively localized to provider-specific request translation and multipart handling, with narrower testing and integration scope.
The left item spans new proxy capabilities across multiple tool ecosystems, requiring configuration modeling, precedence/enforcement rules, persistence or distribution mechanisms, compatibility testing, and security-sensitive administration behavior. The right item is more likely a contained defect in an existing MCP transformation path, with focused reproduction, schema correction, and regression tests.
The left issue is harder because it spans authenticated authorization boundaries, privacy-safe aggregation, usage-data consistency, API design, and dashboard integration while preserving existing administrative behavior. The right issue is narrower, primarily involving provider-specific configuration modeling, validation, propagation, and enforcement.
The managed-settings feature spans multiple provider-specific integrations, configuration schemas, persistence, enforcement, authorization, and compatibility testing. The reliability bug is narrower in scope, primarily involving startup readiness, state-loading retries, and failure handling.
The left task has substantially greater architectural risk: it affects model resolution, routing semantics, recursive dependency handling, validation, compatibility, and broad regression coverage. The right task is comparatively contained to administrative configuration delivery and provider-specific integration surfaces.
The left is harder because it requires designing and integrating a new centrally managed configuration capability across proxy administration, persistence, policy enforcement, client-specific behavior, and security boundaries. The right is comparatively bounded adapter work with focused transformation fixes and regression coverage.
27883 has broader cross-tool integration scope, requiring new proxy configuration surfaces, policy translation, persistence/distribution semantics, and compatibility with two independently evolving client ecosystems. 28235 is a more contained extension of existing budget, counter, reset, and authentication paths, with clearer reuse patterns and validation boundaries.
Cross-provider credential resolution requires auditing and safely changing shared SDK paths, handling custom endpoints, preserving legitimate authentication flows, and adding security-focused regression coverage. The other item is a larger product feature but can be scoped primarily to proxy configuration, policy storage, and client-specific integrations.
27883 is harder because it spans multiple tool ecosystems, requires centralized policy distribution and enforcement, and introduces compatibility and security risks across proxy configuration paths; 29452 is broader conceptually but can be implemented incrementally around credential abstractions and integrations.
#0 of 0 · 31d17h18m23s ago — current · #import:https:::github.com:berriai:litellm post #3550
33371 is harder because it requires a cross-provider, backward-compatible contract spanning error normalization, router state, fallback behavior, and public API design. 27883 is broader in product scope but can be implemented more independently as proxy configuration and endpoint support.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search