6 views
-/https://github.com/berriai/litellm/issues/31925
GitHub · issue

#31925 [Feature]: Attach the "OpenAI-Project: proj_xxx" header to Bedrock Mantle on a per-model basis.

  • State: open
  • Author: @githubeto
  • Labels: enhancement, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Bedrock Mantle provides application-level isolation mechanisms as described in the following documentation. In our organization, we create projects for cost isolation (CUR), and we require the ability to associate inference requests with a project at request time.

[https://docs.aws.amazon.com/bedrock/latest/userguide/projects.html](vscode-file://vscode-app/Applications/Visual%20Studio%20Code.app/Contents/Resources/app/out/vs/code/electron-browser/workbench/workbench.html)

``` curl -X POST $OPENAI_BASE_URL/responses \ -H "Authorization: Bearer $OPENAI_API_KEY" \ -H "Content-Type: application/json" \ -H "OpenAI-Project: proj_5d5ykleja6cwpirysbb7" \ -d '{ "model": "openai.gpt-oss-120b", "input": "Explain the benefits of using projects in Amazon Bedrock" }' ```

This is the value that is currently set: (Model Row json) ``` { "model_name": "gemma-4-31b-digital-worker-sandbox", "litellm_params": { "aws_region_name": "us-east-1", "custom_llm_provider": "bedrock_mantle", "use_in_pass_through": false, "use_litellm_pr…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h1m1s ago — entered · #import:https:::github.com:berriai:litellm post #3055
The database reliability issue is harder because it requires diagnosing and safely redesigning failure recovery across Prisma, process lifecycle, connection pooling, and proxy availability, whereas the feature is a more localized request-header propagation and configuration change.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search