8 views
-/https://github.com/berriai/litellm/issues/28105
GitHub Β· issue

#28105 Bedrock pass-through S3 logging fails for Application Inference Profile ARNs

  • State: open
  • Author: @lamalamalamabot
  • Labels: llm translation

## Bug Description

When using Bedrock pass-through mode with **Application Inference Profile ARNs**, the `success_callback` (e.g., `s3_v2`) is never triggered because `get_bedrock_invoke_provider` fails to parse the provider from the ARN.

## Error

``` ValueError: Invalid invoke provider: None, for model: arn:aws:bedrock:ap-northeast-2:123456789012:application-inference-profile/czu0ezc2tq2l ```

The error occurs in `litellm/llms/bedrock/passthrough/transformation.py` around line 203-206, during the post-response logging phase.

## Root Cause

`get_bedrock_invoke_provider()` in `litellm/llms/bedrock/chat/invoke_transformations/base_invoke_transformation.py` extracts the provider by:

1. Splitting on `.` β†’ no dots in Application Inference Profile ARN 2. Splitting on `/` β†’ `parts[0]` is the full ARN prefix, not a provider 3. Substring match for known providers (`anthropic`, `meta`, etc.) β†’ Application Inference Profile ARNs contain only an opaque ID (e.g., `czu0ezc2tq2l`), no provider name

**Foundation model ARNs work fine** because they contain the provider name: ``` arn:aws:bedrock:us-east-1::foundation-model/anthropic.claude-3-5-sonnet ← "anthropic" found arn:aws:bedrock:ap-nor…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 Β· 31d17h49m45s ago β€” entered Β· #import:https:::github.com:berriai:litellm post #3144
The right issue is harder because it spans asynchronous accounting, reservation lifecycle, concurrency, and consistency across multiple enforcement paths. The left issue is comparatively localized to provider identification and targeted Bedrock coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search