6 views
-/https://github.com/berriai/litellm/issues/30941
GitHub ยท issue

#30941 [Feature] Support Bedrock GPT 5.5 (Mantle platform) - auto-convert Chat Completions to Response API

  • State: open
  • Author: @lancyli
  • Labels: llm translation

## Summary

GPT 5.5 on Amazon Bedrock runs on a new platform (Bedrock Mantle) that **only supports the Response API** (`/v1/responses`). It does NOT support the Chat Completions API (`/v1/chat/completions`).

Our enterprise customers use LiteLLM as a unified proxy and call all models via `/chat/completions`. Currently GPT 5.5 on Bedrock cannot be used through LiteLLM's standard chat interface.

## Request

LiteLLM should automatically convert Chat Completions requests to Response API format when the target model only supports Response API (e.g., GPT 5.5 on Bedrock Mantle).

## Current Behavior

- `litellm.completion(model="bedrock/gpt-5.5", messages=[...])` โ†’ fails or unsupported - GPT 5.5 on Bedrock only accepts Response API format via bedrock-mantle endpoint - Endpoint: `https://bedrock-mantle.{region}.api.aws/v1/responses` - Auth: API Key (not SigV4)

## Expected Behavior

- `litellm.completion(model="bedrock/gpt-5.5", messages=[...])` โ†’ works - LiteLLM detects GPT 5.5 uses Mantle/Response API - Auto-converts: messages[] โ†’ Response API input format - Auto-converts: Response API output โ†’ ChatCompletion response object - Transparent to caller โ€” no code changes needed

## Key โ€ฆ

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 ยท 31d17h51m42s ago โ€” entered ยท #import:https:::github.com:berriai:litellm post #3004
The left issue is harder because it spans provider routing, authentication, bidirectional protocol translation, response normalization, and broad compatibility testing. The right issue is comparatively narrower: tightening authorization checks across a small set of existing endpoint paths, with focused regression and security tests.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search