[Bug]: custom model timeout does not work

[jeromeroussin]

What happened?

We have these settings set:

litellm_settings:
  callbacks: callback.handler
  drop_params: true
  request_timeout: 120

We are observing timeouts for one of our deployments, so I have added a timeout just for it:

- model_name: "o1-mini"
    litellm_params:
      model: "azure/o1-mini"
      // ... Removed configs here...
      timeout: 180

But we are still observing timeout at 120s and not 180s, which is unexpected and unwelcome, we are trying to avoid raising timeouts for all deployments.

Relevant log output

No response

Twitter / LinkedIn details

https://www.linkedin.com/in/jeromeroussin/