9 views
-/https://github.com/berriai/litellm/issues/35214
GitHub · issue

#35214 Bedrock Converse silently ignores response_format={"type": "json_object"}

  • State: open
  • Author: @rohanwinsor
  • Labels: llm translation

# Bedrock Converse silently ignores `response_format={"type": "json_object"}`

## What happened

On Bedrock Converse, `response_format={"type": "json_object"}` is accepted, produces no error, and has no effect on the request. The model answers in prose

The same request against an OpenAI model returns JSON, so callers writing provider-agnostic code get a silent behaviour difference with no signal

## Reproduction

```python import litellm

resp = litellm.completion( model="bedrock/converse/us.anthropic.claude-sonnet-4-5-20250929-v1:0", messages=[{"role": "user", "content": "Who are you?"}], response_format={"type": "json_object"}, ) print(resp.choices[0].message.content) ```

**Expected:** a JSON object

**Actual:** prose, for example

``` I'm Claude, an AI assistant made by Anthropic. I'm here to help answer questions, have conversations, and assist with various tasks. ```

The same call with a `json_schema` response_format does work

## Cause

`AmazonConverseConfig._translate_response_format_param` (`litellm/llms/bedrock/chat/converse_transformation.py`) extracts a schema from either `response_schema` or `json_schema`, then routes on it. A schema on a model with nativ…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d17h58m31s ago — entered · #import:https:::github.com:berriai:litellm post #2880
#29066 is harder because it crosses persistence, Pydantic modeling, and the request authorization path, with broader regression risk; #35214 is a relatively localized provider-translation fix with narrower testing scope.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search