8 views
-/https://github.com/berriai/litellm/issues/35303
GitHub Β· issue

#35303 [Bug]: A single malformed tool_calls[].function.arguments DoSes a proxy replica β€” pre-network transformation error is mapped to retryable APIConnectionError, and the cyclic fallback graph is walked without cycle detection (79,858 attempts against num_retries=2, ~2.3 GB of logs in ~7 min, event loop starved, pod killed with exit 137)

  • State: open
  • Author: @Tbag12
  • Labels: bug, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

> **Title (paste into the GitHub issue title field):** > > `[Bug]: A single malformed tool_calls[].function.arguments DoSes a proxy replica β€” pre-network transformation error is mapped to retryable APIConnectionError, and the cyclic fallback graph is walked without cycle detection (79,858 attempts against num_retries=2, ~2.3 GB of logs in ~7 min, event loop starved, pod killed with exit 137)` > > Suggested labels: `bug`, `bedrock`, `router`, `availability`

---

## What happened?

A client replayed a conversation history in which one assistant message contained a **truncated** `tool_calls[].function.arguments` JSON string. LiteLLM's Bedrock Converse transformation tried to `json.loads()` that string, failed, and raised a **bare `Exception`**. `exception_mapping_utils.exception_type()` classified it as **`litellm.APIConnectionError`** β€” a *retryable* class.

Because the failure occurs inside `_async_transform_request()`, i.e. **before any network I/O**, each retry costs ~0.56 ms of pure CPU. The router's retry + fallback machinery therefore dege…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 Β· 31d18h2m38s ago β€” entered Β· #import:https:::github.com:berriai:litellm post #2827
Issue 35303 is harder because it spans exception taxonomy, request transformation boundaries, retry semantics, fallback-graph cycle detection, async control flow, and high-volume regression testing. Issue 35533 is narrower, primarily involving distributed limiter failure semantics and targeted coordination tests.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search