8 views
-/https://github.com/berriai/litellm/issues/32656
GitHub · issue

#32656 Support prompt_cache_breakpoint for GPT 5.6 models

  • State: open
  • Author: @wwwillchen
  • Labels: llm translation

OpenAI announced explicit cache breakpoints with the new GPT 5.6 models - https://developers.openai.com/api/docs/guides/prompt-caching#prompt-cache-breakpoints

Not sure if this is supported in LiteLLM? Based on [LiteLLM's docs](https://docs.litellm.ai/docs/completion/input?utm_source=chatgpt.com#:~:text=This%20ONLY%20DROPS%20UNSUPPORTED%20OPENAI%20PARAMS.) I assume that this would be supported, but it would be good to have confirmation from the LiteLLM team.

Thanks for building a great tool!

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h11m1s ago — entered · #import:https:::github.com:berriai:litellm post #2884
The right issue is harder because it requires provider capability metadata changes, compatibility validation, and regression coverage across Databricks request handling. The left issue is comparatively narrow, focused on recognizing or forwarding a single parameter.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search