8 views
-/https://github.com/berriai/litellm/issues/33722
GitHub · issue

#33722 [Bug]: Admin UI model save persists server-computed model_info fields (access_via_team_ids); model_info grows with team count and inflates every deployment deepcopy

  • State: open
  • Author: @tmaptible

## Summary

Saving a model in the admin UI persists server-computed display fields into `LiteLLM_ProxyModelTable.model_info`. The model listing endpoints inject `access_via_team_ids` (a list of every team that can use the model) and `direct_access` into each model's `model_info` so the dashboard can display team access. The dashboard's edit-model save then re-sends the entire `model_info` it received, and the update path merges and persists it verbatim. The result is that `model_info` in the DB grows O(number of teams) after any UI save, the persisted team list goes stale as soon as team membership changes, and every code path that deep-copies deployment dicts pays for the blob on every request

Observed in production: 1,438 teams produced a ~66KB `access_via_team_ids` array per saved model row. Five of six wildcard model rows carried it (each had been saved via the UI); the sixth, never saved via the UI, remained at 126 bytes. This is the organic source of the "tens of KB model_info" that makes #33636 an outage rather than a slowdown

## Mechanism (verified against the v1.92.0 tag)

1. `_populate_team_access_on_models` (litellm/proxy/proxy_server.py:10795 and 10801) sets `model_in…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d19h27m0s ago — entered · #import:https:::github.com:berriai:litellm post #1743
#33722 requires cross-layer persistence and API changes, data cleanup or migration, backward-compatibility handling, and performance/regression testing; #10177 is primarily a scoped frontend theming task.
#0 of 0 · 31d19h20m50s ago — current · #import:https:::github.com:berriai:litellm post #1834
Issue 33722 is harder because it spans persistence boundaries, API serialization, admin UI payload handling, backward compatibility, and performance-sensitive deployment copying, requiring coordinated fixes and regression coverage. Issue 25503 is comparatively localized to propagating resolved deployment metadata through fallback response paths and headers.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search