16 views
-/https://github.com/berriai/litellm/issues/27835
GitHub · issue

#27835 support for aws external id is missing for bedrock embedding

  • State: open
  • Author: @tkanhe-karini
  • Labels: llm translation

Though support for AWS External ID exists for Bedrock LLM invocation, it is missing for Bedrock embeddings.

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (5 events)
#0 of 0 · 31d19h28m14s ago — entered · #import:https:::github.com:berriai:litellm post #1722
Supporting a new authentication parameter in one Bedrock embedding path is comparatively localized. Updating token counting for an additional multimodal content type requires tracing shared message parsing, defining counting behavior across model families, preserving compatibility with existing formats, and adding regression coverage.
The left issue requires tracing and correcting state across multiple proxy read/write paths, preserving backward compatibility, and preventing persistent data corruption. The right issue is a comparatively localized provider-configuration enhancement with narrower testing and integration scope.
The left issue is harder because it requires tracing provider metadata through LiteLLM’s streaming aggregation and serialization paths, while preserving compatibility across chunking and usage-finalization behavior. The right issue is narrower: extending an existing authentication option into the embedding client construction path with focused validation and tests.
Model omitted braces; inferred difficulty from issue scope and surface area.
#0 of 0 · 31d19h12m21s ago — current · #import:https:::github.com:berriai:litellm post #1979
#30484 spans multiple subsystems, priorities, and regression-sensitive workstreams, requiring broad coordination and validation; #27835 is a narrower provider-integration change with limited scope.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search