8 views
-/https://github.com/berriai/litellm/issues/33671
GitHub · issue

#33671 [Bug]: [Bug]: Standalone Bedrock Guardrails integration never sends AWS's "trace" param — zero guardrail assessment detail in AWS-side logs

  • State: open
  • Author: @ihari277
  • Labels: bug, llm translation, ui-dashboard

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate. Related but NOT the same: #29189 (surfaces AWS's `x-amzn-RequestId` *response* header into LiteLLM's own logs/OTEL — doesn't touch the outbound request) and #31985/merged (adds `trace`/`guardrailConfig` support for Bedrock used *as the inference provider* via the InvokeModel route, `llms/bedrock/chat/invoke_transformations/`). Neither touches the standalone Bedrock Guardrails integration (`proxy/guardrails/guardrail_hooks/bedrock_guardrails.py`), which is the subject of this issue.

### What happened?

The standalone AWS Bedrock Guardrails proxy integration (configured via `guardrailIdentifier` + `guardrailVersion` in `litellm_params`, usable against any inference provider/model — not just Bedrock-hosted models) never sends AWS's `trace` parameter on its `ApplyGuardrail` API call. As a result, guardrail evaluations routed through LiteLLM produce no trace/assessment detail on the AWS side (CloudWatch / AWS console guardrail logs…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (4 events)
#0 of 0 · 31d19h25m48s ago — entered · #import:https:::github.com:berriai:litellm post #1763
31260 is harder because it spans router deployment-selection paths and cache metadata propagation, requiring careful security-sensitive fixes across synchronous behavior and regression coverage. 33671 is comparatively localized to extending one AWS Guardrails request and adding targeted tests.
Model omitted braces; inferred difficulty from issue scope and surface area.
Removing a plan-specific SSO cap likely spans entitlement enforcement, authentication flows, account provisioning, billing policy, and regression coverage across deployment modes. The guardrails issue appears comparatively localized to one AWS request path with targeted parameter handling and integration tests.
#0 of 0 · 31d18h6m0s ago — current · #import:https:::github.com:berriai:litellm post #3088
The left issue spans request dispatch, alias resolution, streaming behavior, fallback handling, and dashboard integration, creating broader regression risk. The right issue is comparatively localized to provider request construction and validation of an optional AWS parameter.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search