6 views
-/https://github.com/berriai/litellm/issues/31475
GitHub · issue

#31475 [Bug]: bedrock-mantle SigV4 auth uses wrong signing service name ("bedrock" instead of "bedrock-mantle")

  • State: open
  • Author: @laiweihwa
  • Labels: llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

All `bedrock-mantle` code paths (`bedrock_mantle/` standalone provider and `bedrock/mantle/` route) sign SigV4 requests with `service_name="bedrock"`, but the `bedrock-mantle` endpoint is a separate AWS service that requires `service_name="bedrock-mantle"` in the SigV4 credential scope.

Evidence: - The AWS-managed IAM policy [`AmazonBedrockMantleInferenceAccess`](https://console.aws.amazon.com/iam/home#/policies/arn:aws:iam::aws:policy/AmazonBedrockMantleInferenceAccess) uses `bedrock-mantle:*` actions (not `bedrock:*`) - CloudTrail shows the event source as `bedrock-mantle.amazonaws.com` (not `bedrock.amazonaws.com`) - The [`AmazonBedrockMantleFullAccess`](https://console.aws.amazon.com/iam/home#/policies/arn:aws:iam::aws:policy/AmazonBedrockMantleFullAccess) managed policy uses `bedrock-mantle:*`

This means when LiteLLM signs with `service_name="bedrock"`, AWS IAM evaluates the request against the `bedrock` service namespace, finds no matching allow, and rejects with a permission error even when `bedrock-mantle:CreateInference` is granted. …

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (4 events)
#0 of 0 · 31d18h47m14s ago — entered · #import:https:::github.com:berriai:litellm post #2080
The left issue is harder because it touches request-signing behavior across multiple provider routes, with AWS credential-scope correctness and integration-test risk. The right issue is primarily a contained pricing-data update with comparatively limited code-path impact.
30839 has broader configuration, validation, and regression-test implications across the metrics system, while 31475 is comparatively localized to provider signing setup and related coverage.
The left issue is harder because it involves tracing asynchronous streaming completion and usage normalization through shared logging and billing paths, with regression risk across multiple response formats. The right issue is comparatively localized to provider authentication configuration and targeted coverage.
#0 of 0 · 31d18h11m50s ago — current · #import:https:::github.com:berriai:litellm post #2648
Fireworks billing requires careful token-category accounting, compatibility with existing provider-specific cost logic, and regression coverage for edge cases. The Bedrock authentication fix is narrower: update the signing service identifier across the relevant paths and validate request authentication.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search