7 views
-/https://github.com/berriai/litellm/issues/13823
GitHub · issue

#13823 [Bug]: gpt-oss on ollama with tool available raises exception

  • State: open
  • Author: @benlangfeld
  • Labels: bug, mlops user request

### What happened?

With the following request, the presence of the tools causes the exception seen in the log. Removing the tools allows inference to succeed:

``` curl --location 'https://inference.example.ai/v1/chat/completions' \ --header 'Content-Type: application/json' \ --header 'Accept: application/json' \ --header 'Authorization: Bearer xxx' \ --data '{ "model": "gpt-oss:20b", "tools": [ { "type": "function", "function": { "name": "confirm_appointment", "parameters": { "type": "object", "required": [ "appointment_id" ], "properties": { "appointment_id": { "type": "number" } }, "additionalProperties": false }, "description": "Confirm that an appointment can go ahead. Dispatch a sales rep." } } ], "stream": false, "messages": [ { "role": "system", "content": "You are a customer support agent. The customer has an appointment scheduled. The appointment ID is 12345 and it is scheduled for 2025-08-06T20:00:00-05:00.\n\nYour goal is to confirm that the customer will be available at the sch…

GitHub resolver

Import GitHub neighbors on demand. Results are saved as system ingests.

Refresh page
vote history (1 events)
#0 of 0 · 31d17h43m13s ago — entered · #import:https:::github.com:berriai:litellm post #3141
The right-hand task is harder because it involves cross-protocol proxy translation, endpoint routing, request/response schema conversion, and compatibility coverage across multiple model backends. The left-hand task is more localized to provider-specific tool-call handling and exception diagnosis.
discussed in #import:https:::github.com:berriai:litellm

ranked child groups

no voted pairs yet in this scope

cli
src
spread
search