7 views
-/https://github.com/berriai/litellm/issues/24065
GitHub · issue

#24065 [Bug]: Cloudflare Workers AI API Error

  • State: open
  • Author: @AaronFaby
  • Labels: bug

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

I am trying to configure the Nemotron 3 Super 120B model to work with LiteLLM through Cloudflare.

https://developers.cloudflare.com/workers-ai/models/nemotron-3-120b-a12b/

I have my credentials set and when adding the model the Test Connection fails.

This is a Docker deployment through docker compose.

### Steps to Reproduce

1. Configure Workers AI credentials. 2. Add Model. 3. Select Cloudflare as the Provider. 4. Enter a custom model: @cf/nvidia/nemotron-3-120b-a12b 5. Select existing credentials. 6. Click Test Connection. 7. Watch it crash and burn.

### Relevant log output

```shell This appears as an Error: in the dialog:

'response' Traceback (most recent call last): File "/usr/lib/python3.13/site-packages/litellm/main.py", line 620, in acompletion response = await init_response ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/site-packages/litellm/llms/custom_httpx/llm_http_handler.py", line 319, in async_completion initial_response = provider_config.transform_response( model=model, ...<9 lines>... json_mode=json_mode, ) File "/usr/li…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (4 events)
#0 of 0 · 31d18h46m43s ago — entered · #import:https:::github.com:berriai:litellm post #2096
Issue 26882 is harder because it spans request translation, provider-specific tool mapping, conflict resolution, and compatibility testing across multiple tool types. Issue 24065 appears more localized to Cloudflare provider response handling and model-specific API compatibility.
28906 is harder because it spans frontend form-state handling, secret masking semantics, backend merge/encryption behavior, cache consistency, and regression testing across credential-edit workflows. 24065 is narrower provider-specific request/response compatibility debugging with a more localized implementation surface.
Cloudflare integration likely spans provider-specific request/response transformation, compatibility validation, and regression coverage, while the model-info problem appears more localized to persistence and serialization behavior.
#0 of 0 · 31d18h13m19s ago — current · #import:https:::github.com:berriai:litellm post #2630
The right issue is harder because it likely requires diagnosing and modifying provider-specific request/response handling, then validating compatibility with an external API. The left issue is primarily a documentation and version/configuration correction with comparatively limited implementation scope.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search