8 views
-/https://github.com/berriai/litellm/issues/29755
GitHub · issue

#29755 RateLimitError handling with Groq provider

  • State: open
  • Author: @SujithVarma-ai
  • Labels: llm translation

Code Sample from litellm import completion

response = completion( model="groq/openai/gpt-oss-20b", messages=[ {"role": "user", "content": "Hello"} ] ) Error Paste the full RateLimitError traceback here Expected Behavior

LiteLLM should either:

Automatically retry when rate limits are encountered, or Surface the provider's rate limit information clearly. Additional Context

The same request works intermittently, but fails when processing multiple requests. I would like clarification on whether this is expected behavior, a provider-specific limitation, or an issue in LiteLLM's rate limit handling.

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h26m45s ago — entered · #import:https:::github.com:berriai:litellm post #2502
29755 requires provider-specific error classification, retry policy decisions, and validation across request flows, creating broader behavioral and testing scope; 31682 currently lacks actionable detail and is primarily an investigation/triage task.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search