8 views
-/https://github.com/berriai/litellm/issues/34662
GitHub · issue

#34662 [Feature]: Add recurring availability schedules for provider credentials

  • State: open
  • Author: @freQuensy23-coder
  • Labels: proxy, potential-duplicate

### Check for existing issues

- [x] I searched existing issues and PRs and found no recurring availability schedule for provider credentials or deployments

### The Feature

Allow named provider credentials to define recurring availability through `credential_info.availability_schedule`. Every deployment using `litellm_credential_name` inherits that schedule. Deployments with inline credentials can set the same field in `model_info`

```yaml credential_list: - credential_name: discounted-provider credential_values: api_key: os.environ/PROVIDER_API_KEY credential_info: availability_schedule: timezone: America/Los_Angeles windows: - days: [mon, tue, wed, thu, fri, sat, sun] start: "00:00" end: "06:00" ```

`start` is inclusive and `end` is exclusive. Overnight windows are supported. Missing schedules preserve current behavior

### Motivation, pitch

Some providers offer lower prices or reserved capacity only during defined off-peak windows. LiteLLM should route to those credentials during the window and automatically use other deployments outside it without external cron jobs or proxy restarts

### Proposed impl…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (3 events)
#0 of 0 · 31d19h4m36s ago — entered · #import:https:::github.com:berriai:litellm post #1890
Recurring availability schedules require new configuration schemas, timezone-aware window evaluation, overnight and boundary handling, credential inheritance across deployments, routing integration, backward compatibility, and broad testing. The logging issue is comparatively localized to sanitizing and validating a metadata field in two builders, with focused regression and security tests.
The right-hand change spans configuration modeling, schedule evaluation, timezone and boundary handling, credential inheritance, routing behavior, backward compatibility, and broad testing. The left-hand change is comparatively localized to preserving an existing parameter through one request path.
#0 of 0 · 31d18h14m19s ago — current · #import:https:::github.com:berriai:litellm post #2715
The right item requires broader cross-cutting changes involving configuration, inheritance, time-zone handling, routing behavior, edge cases, and extensive integration testing. The left is comparatively localized to response traversal and restoration logic.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search