8 views
-/https://github.com/berriai/litellm/issues/27719
GitHub · issue

#27719 [Feature]: Feature request: Native integration with BlockRun models

  • State: open
  • Author: @2023lizy
  • Labels: enhancement, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

We use LiteLLM together with BlockRun (https://blockrun.ai). It'd be great if LiteLLM could integrate with BlockRun models natively, the same way it supports OpenAI / Anthropic / Bedrock. Today we route through the third-party adapter blockrun-litellm (https://github.com/BlockRunAI/blockrun-litellm), which works fine — but having BlockRun in litellm directly would mean one less dependency and we could put BlockRun straight in config.yaml (no sidecar). BlockRun's chat API is already OpenAI-compatible (including streaming), so the integration should be small. Reference implementation: https://github.com/BlockRunAI/blockrun-litellm Thanks for considering!

### Motivation, pitch

We use LiteLLM together with BlockRun (https://blockrun.ai). It'd be great if LiteLLM could integrate with BlockRun models natively, the same way it supports OpenAI / Anthropic / Bedrock. Today we route through the third-party adapter blockrun-litellm (https://github.com/BlockRunAI/blockrun-litellm), which works fine — but having BlockRun in litellm direct…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h13m7s ago — entered · #import:https:::github.com:berriai:litellm post #2844
The harder task requires tracing and correcting shared proxy metadata-merging behavior across hierarchical authorization levels, then validating precedence and regression coverage. The easier task is a relatively contained provider adapter using an existing compatibility pattern and reference implementation.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search