8 views
-/https://github.com/berriai/litellm/issues/33779
GitHub · issue

#33779 [Bug]: Exception when Using Codex CLI connect to Nvidia NIM Model nemotron-3-ultra-550b-a55b

  • State: open
  • Author: @wy6688
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When I use latest codex cli connect to LiteLLM to NIM nemotron-3-ultra-550b-a55b, I got the following exception, I have set on Codex config "disable_tools=true", also set "drop_params=true" on LiteLLM config.

drop_params strips unrecognized top-level parameters, if the structural error is deeply nested inside the tools array itself, it still caused this error. the fix maybe need strip all "namespace" to "function" or remove it

### Steps to Reproduce

1. in LLM Config.toml setup the nvidia nim model nemotron-3-ultra-550b-a55b 2. Open Codex 3. Exception Occur in Codex CLI terminal A bug happened! {"error":{"message":"litellm.BadRequestError: Nvidia_nimException - unknown variant `namespace`, expected `function`. Received Model Group=nemotron-3-ultra-550b-a55b-nvidia\nAvailable Model Group Fallbacks=['nemotron-3-super-120b-a12b-nvidia']\nError doing the fallback: litellm.BadRequestError: Nvidia_nimException - unknown variant `namespace`, expected `function`. Received Model Group=nemotron-3-super-120b-a12b-nvidia\nAvailable Model Group Fallba…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h34m8s ago — entered · #import:https:::github.com:berriai:litellm post #2401
The enterprise feature is substantially harder because it requires coordinated schema, API, persistence, authorization, reporting, UI, callback, routing, migration, and compatibility work. The bug is comparatively localized to request normalization and provider-specific validation, with focused regression coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search