6 views
-/https://github.com/berriai/litellm/issues/29258
GitHub · issue

#29258 [Feature]: Add native /v1beta/cachedContents CRUD routes to google_endpoints (parity with /v1beta/interactions)

  • State: open
  • Author: @netbrah
  • Labels: proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Add native Gemini-API `cachedContents` CRUD routes to `litellm/proxy/google_endpoints/endpoints.py`, mirroring the pattern already shipped for `interactions` in the same file:

- `POST /v1beta/cachedContents` + `POST /cachedContents` - `GET /v1beta/cachedContents` + `GET /cachedContents` (list) - `GET /v1beta/cachedContents/{name:path}` + `GET /cachedContents/{name:path}` - `PATCH /v1beta/cachedContents/{name:path}` + `PATCH /cachedContents/{name:path}` (TTL extension) - `DELETE /v1beta/cachedContents/{name:path}` + `DELETE /cachedContents/{name:path}`

These should sign into the configured Vertex/Google credentials the same way `google_generate_content` already does, translate between Gemini-API resource names (`cachedContents/{id}`) and Vertex resource paths (`projects/{P}/locations/{L}/cachedContents/{id}`) as needed, and apply `user_api_key_auth` + `pre_call_hook` the same as the surrounding routes.

### Motivation, pitch

Today `google_endpoints/endpoints.py` registers `generateContent`, `streamGenerateContent`, `countTokens…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h24m37s ago — entered · #import:https:::github.com:berriai:litellm post #2643
The left task spans multiple API endpoints, authentication and credential plumbing, resource-name translation, consistency with existing proxy behavior, and broader integration testing. The right task is a localized aggregation fix with focused regression coverage, so it has substantially lower implementation risk and scope.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search