6 views
-/https://github.com/berriai/litellm/issues/33824
GitHub · issue

#33824 [Bug]: In versions v1.92.0 and later, the /v1/message anthropic proxy is incompatible.

  • State: open
  • Author: @dota20505
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

I wanted to integrate Claude CLI using the LiteLLM proxy, so that requests in the Anthropic format could be forwarded to the Zhipu large model for processing. However, this integration wasn’t possible. Upon further investigation, it turned out that LiteLLM tried to access OpenAI’s /responses endpoint. Unfortunately, Zhipu’s OpenAI-compatible interface didn’t support this endpoint, resulting in a 404 error. Even enabling the “Compatible with Anthropic” settings didn’t resolve the issue.

### Steps to Reproduce

1. Build the Litellm UI panel and create a glm-5.2 model compatible with OpenAI. Configure the corresponding API_baseurl and API key. 2. Tests in the UI panel’s Playground, as well as curl simulations for /v1/message and /v4/reponses, all report the same error. 3. The curl request is as follows: curl -X POST http://0.0.0.0:4000/v1/messages -H "Authorization: Bearer $LITELLM_MASTER_KEY" \ -H "Content-Type: application/json" -d ‘{ "model": "GLM-5.2" "max_tokens": 1000, "messages": [{"role": "user", "content": "Testing response: OK"}] }'

##…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h7m43s ago — entered · #import:https:::github.com:berriai:litellm post #2730
The right issue is harder because it spans multiple proxy operations and shared routing/request-preparation paths, requiring broader compatibility analysis and regression coverage. The left issue appears more localized to endpoint selection and translation behavior, with a narrower implementation surface.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search