8 views
-/https://github.com/berriai/litellm/issues/29247
GitHub · issue

#29247 Cast settings do not take effect

  • State: open
  • Author: @larryhq

Description After modifying the model billing rules via the UI, the billing value for subsequent session requests is always 0. The updated configuration fails to apply. Steps to Reproduce Edit and save the model cast billing settings on the UI page. Initiate a session request. Check the billing result. Actual Result The billing amount is constantly 0, ignoring the latest configured rules. Expected Result Session requests should calculate billing based on the updated cast settings.

my litellm version is v1.86.2

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h14m30s ago — entered · #import:https:::github.com:berriai:litellm post #2707
Redis cluster authentication involves client-library internals, connection bootstrapping, compatibility across deployment modes, and integration testing; the cast-settings defect is narrower configuration propagation and billing-state debugging.
#0 of 0 · 31d17h45m25s ago — current · #import:https:::github.com:berriai:litellm post #3215
The left requires a new adaptive routing subsystem with state management, metric ingestion, tuning safeguards, persistence, observability, and compatibility testing across providers. The right is comparatively localized debugging of configuration propagation and billing calculation.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search