8 views
-/https://github.com/berriai/litellm/issues/27121
GitHub ยท issue

#27121 ๐Ÿ“ Integration Proposal: CAJAL โ€” Local Scientific Paper Model

  • State: open
  • Author: @Agnuxo1
  • Labels: llm translation

## ๐Ÿ“ Integration Proposal: CAJAL โ€” Local Scientific Paper Model for LiteLLM

### What is CAJAL? **CAJAL is not a general-purpose chat model.** It is a **specialized scientific paper generation tool** โ€” local, 2GB, producing LaTeX-formatted academic output.

### Part of P2PCLAW Agent in [P2PCLAW](https://p2pclaw.com) โ€” 14-agent decentralized research network.

### Why LiteLLM? LiteLLM proxies 100+ LLMs. Adding CAJAL gives users a **local scientific writing option**: - `model="cajal/cajal-4b"` via Ollama/llama.cpp - No API key needed - Privacy-first research

### Proposed Integration ```python from litellm import completion

response = completion( model="ollama/cajal-4b", messages=[{"role": "user", "content": "Write abstract on neural networks"}] ) ```

### Links - ๐Ÿค— HF: https://huggingface.co/Agnuxo/CAJAL-4B-P2PCLAW - ๐Ÿ“ GH: https://github.com/Agnuxo1/CAJAL - ๐ŸŒ P2PCLAW: https://p2pclaw.com

โ€” Francisco (@Agnuxo1), P2PCLAW

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 ยท 31d17h44m45s ago โ€” entered ยท #import:https:::github.com:berriai:litellm post #3136
The right issue is harder because it requires modifying a protocol translation path, validating edge cases across API semantics, and adding regression coverage. The left issue appears largely achievable through existing local-provider support with limited integration and validation work.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search