### Check for existing issues

- [x] I have searched the existing issues and checked that my issue is not a duplicate.

### What happened?

Occassionally get `Retrying <unknown> in 8 seconds as it raised InternalServerError: litellm.InternalServerError: InternalServerError: OpenAIException - Connection error..` randomly, for no reason. Debugging does not help. It just happens at random times at random intervals for no reason. Sometimes, LiteLLM just does not work.

### Steps to Reproduce

1. Use `mini-swe-agent`. 2. Uses LiteLLM backend. 3. Occassionally get `Retrying <unknown> in 8 seconds as it raised InternalServerError: litellm.InternalServerError: InternalServerError: OpenAIException - Connection error..` randomly, for no reason. Debugging does not help. It just happens at random times at random intervals for no reason. Sometimes, LiteLLM just does not work.

### Relevant log output

```shell

```

### What part of LiteLLM is this about?

Proxy

### What LiteLLM version are you on ?

v1.190.0

### Twitter / LinkedIn details

_No response_