6 views
-/https://github.com/berriai/litellm/issues/23345
GitHub · issue

#23345 [Bug]: Manually added field in `Model Info` is not persisted

  • State: open
  • Author: @LLukas22
  • Labels: bug, proxy

### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

When i want to add fields to the `Model Info` json of a model they are discarded.

E.g. i want to add a "max_input_tokens" to an existing model:

<img width="796" height="275" alt="Image" src="https://github.com/user-attachments/assets/ae25d5ca-4484-4578-96f1-7850fadcecab" />

But even after saving the setting successfully the model reports this raw json:

```json { "model_name": "[CONTRACTED] Nebius: Kimi-K2.5", "litellm_params": { "input_cost_per_token": "5e-07", "output_cost_per_token": "2.5e-06", "custom_llm_provider": "nebius", "litellm_credential_name": "Nebius", "use_in_pass_through": false, "use_litellm_proxy": false, "merge_reasoning_content_in_choices": false, "model": "moonshotai/Kimi-K2.5", "tags": [], "guardrails": [] }, "model_info": { "id": "2da0f0bf-7a18-4b32-b0ea-da0fbb1bb53e", "db_model": true, "mode": "chat", "access_groups": [], "direct_access": true, "access_via_team_ids": [ "ai-self-service" ], "input_cost_per_token": 5e-7, "output_…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (2 events)
#0 of 0 · 31d18h33m54s ago — entered · #import:https:::github.com:berriai:litellm post #2317
Cloudflare integration likely spans provider-specific request/response transformation, compatibility validation, and regression coverage, while the model-info problem appears more localized to persistence and serialization behavior.
#0 of 0 · 31d18h33m43s ago — current · #import:https:::github.com:berriai:litellm post #2320
The left requires coordinated changes across multiple provider-specific request paths, shared configuration behavior, and broad compatibility testing. The right is more likely a localized proxy persistence or serialization fix.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search