6 views
-/https://github.com/berriai/litellm/issues/30725
GitHub · issue

#30725 [Bug]: Bedrock pass-through endpoint - sometimes do no send the cost and `cost_breakdown` is all zero's

  • State: open
  • Author: @aashishrbhandari
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

Greetings LiteLLM Team,

## [Quick Summary]

When i use Bedrock Passthrough Endpoint (Link: https://docs.litellm.ai/docs/pass_through/bedrock#1-using-configyaml-recommended-for-model-endpoints) I have configured `s3` and `Custom Callback API`

When i make a curl request sometimes i see that the

a) response header do not give cost (i.e cost is shown as Zero) b) same on the UI c) same as well in the S3 Bucket.

```bash

### Request (CURL)

API_ENDPOINT="http://localhost:14201" API_KEY="sk-xxxxxxxxxxxxxxxxx" MODEL_ID="bedrock-passthrough.global.anthropic.claude-sonnet-4-6" SYSTEM=$(jq '.system' data/prompt-with-cache-1h-ttl.json)

curl -s -X POST "$API_ENDPOINT/bedrock/model/$MODEL_ID/converse" \ -H "Authorization: Bearer $API_KEY" \ -H 'Content-Type: application/json' \ -d "{ \"messages\": [ { \"role\": \"user\", \"content\": [{\"text\": \"Give me 5 Kubernetes image security best practices.\"}] } ], \"inferenceConfig\": { \"maxTokens\": 4096, \"temperature\": 1 …

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d19h14m19s ago — entered · #import:https:::github.com:berriai:litellm post #1742
The left issue spans provider-specific request translation, asynchronous or conditional cost calculation, and propagation through response metadata, callbacks, storage, and UI, making diagnosis and end-to-end validation broader. The right issue is comparatively localized to callback metadata modeling and credential isolation, with focused code changes and tests.
#0 of 0 · 31d17h48m16s ago — current · #import:https:::github.com:berriai:litellm post #3173
Model omitted braces; inferred difficulty from issue scope and surface area.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search