7 views
-/https://github.com/berriai/litellm/issues/31336
GitHub · issue

#31336 [Feature]: Add option to set priorityClassName to deployments from helm chart

  • State: open
  • Author: @mehulp-syntax
  • Labels: enhancement

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### The Feature

Currently the litellm helm chart (`/deploy/charts/litellm-helm`) does not provide a way to set `priorityClassName` to deployment manifests.

The implementation for this would be as simple as adding to the deployment template:

``` spec: template: spec: {{- with .Values.priorityClassName }} priorityClassName: {{ . }} {{- end }} ```

and in the values.yaml: ``` priorityClassName: "" ```

The equivalent can also be done in the other helm chart (`/helm/litellm`)

### Motivation, pitch

This is useful in protecting litellm from resource pressure evictions which can be common in Kubernetes environments. While these values can be added after the initial deployment, it runs the risk of being reconciled when using CD tools that sync against the chart (like via ArgoCD)

### What part of LiteLLM is this about?

Other

### LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

### Twitter / LinkedIn details

_No response_

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h33m28s ago — entered · #import:https:::github.com:berriai:litellm post #2321
The right-hand issue requires tracing and modifying a cross-provider request translation path, preserving compatibility across payload variants, and adding focused regression coverage. The left-hand issue is a localized configuration and template change across Helm chart files with comparatively low integration risk.
#0 of 0 · 31d18h11m7s ago — current · #import:https:::github.com:berriai:litellm post #2674
#34384 has no actionable technical specification, so its implementation scope and risk are unbounded; #31336 is a narrowly scoped Helm-chart values/template addition.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search