6 views
-/https://github.com/berriai/litellm/issues/31872
GitHub · issue

#31872 fix(cerebras): add max_retries and extra_headers to get_supported_openai_params

  • State: open
  • Author: @deepanshululla
  • Labels: llm translation

## Problem

`CerebrasConfig.get_supported_openai_params()` returns a hand-crafted list that omits `max_retries` and `extra_headers`. Because `map_openai_params` only passes through parameters in this list, any `max_retries` value is silently discarded. The OpenAI HTTP handler at `openai.py:653` then always uses its hardcoded default of 2 retries, ignoring the caller's intent — including `max_retries=0` to disable retries entirely.

## Proposed fix

Add `"max_retries"` and `"extra_headers"` to the list in `CerebrasConfig.get_supported_openai_params()`. Both are LiteLLM-internal params consumed by the shared OpenAI HTTP handler before the request body is assembled; neither is sent to the Cerebras API as an unexpected field.

## Files

- `litellm/llms/cerebras/chat.py`

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h56m29s ago — entered · #import:https:::github.com:berriai:litellm post #2134
#33678 requires debugging and correcting stateful streaming/tool-call assembly semantics, with cross-component behavior and regression coverage; #31872 is a localized parameter-allowlist update with low integration risk.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search