8 views
-/https://github.com/berriai/litellm/issues/28444
GitHub · issue

#28444 [Bug]: Post API hook is not enabled for passthrough endpoints

  • State: open
  • Author: @hasan4791
  • Labels: bug, proxy, llm translation

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

Passthrough endpoint works relatively transparent and allows users to do the customization on their part but it is only availabe for Pre-api hook. If a user have to expose an non openai endpoint lets say "/tokenize" and have a specific format for request & response, inorder to make the translation of request & reponse, hooks would be used. The pre-api hook is really helpful to dynamically make the translation of the request based on the llm provider but due to the absence of post-api hook, the response aren't translated to specific fixed format.

The proposal is to add the post-api hook for the passthrough endpoint.

**Any challenges:** 1. Post api hook doesn't have any call_type argument, which means we are at our own in filtering the responses and this hook would get triggered for all the passthrough endpoint configuration. 2. What kind of dict do we need to provide in data argument? It has to be either request_data or generated kwargs. kwargs has more information which allows users to do better customization on the custom callbacks. 3. If t…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d18h1m44s ago — entered · #import:https:::github.com:berriai:litellm post #2828
The left requires cross-cutting callback lifecycle design, API contract decisions, passthrough integration, and broad regression coverage; the right is comparatively localized streaming translation debugging.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search