8 views
-/https://github.com/berriai/litellm/issues/33384
GitHub · issue

#33384 [Bug]: hosted_vllm ssl_verify ignore (Audio Transcription)

  • State: open
  • Author: @freinold
  • Labels: bug, proxy

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When using a model configured with `model_info: { mode: audio_transcription }` using the `hosted_vllm/` provider, the `ssl_verify` parameter specified in the `litellm_params` is ignored by the transport layer.

While standard chat completion and embedding requests respect `ssl_verify`, requests routed through the `audio_transcription` mode fail with SSL verification errors when the backend uses custom CA certificates or self-signed certificates.

**Expected Behavior:** The `ssl_verify` path should be used to configure the underlying HTTP client (e.g., `aiohttp` or `httpx`) to trust the provided CA certificate.

**Actual Behavior:** The `ssl_verify` parameter is ignored by the network client and is instead incorrectly treated as a request payload parameter, leaking into the `extra_body` of the API request.

### Steps to Reproduce

1. Set up a `config.yaml` for LiteLLM Proxy with a model using the transcription mode and a custom SSL certificate: ```yaml model_list: - model_name: audio-model-placeholder model_info: mode: audio_transcr…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d18h46m25s ago — entered · #import:https:::github.com:berriai:litellm post #2193
The Bedrock change is harder because it spans multimodal content normalization, AWS guardrail payload compatibility, image encoding and retrieval, and broader regression coverage, whereas the SSL issue is narrower transport-configuration plumbing in one request path.
Project-level accounting requires tracing identifiers through request, callback, persistence, aggregation, and budget-enforcement paths, with regression coverage and consistency concerns. The transport configuration defect is comparatively localized to provider-specific client setup and parameter filtering.
#0 of 0 · 31d18h18m37s ago — current · #import:https:::github.com:berriai:litellm post #2635
Issue 33384 is harder because it spans provider-specific request routing, transport-client configuration, parameter propagation, and integration testing across SSL behaviors. Issue 33688 appears comparatively localized to response usage normalization and serialization, with narrower regression coverage.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search