OpenAI API doesn't support tools in requests

[edanuff]

Describe the bug

tools passed in via the OpenAI API are discarded. Cause of the bug appears to be that the ChatCompletionRequestParams class in extensions/openai/typing.py file does not define the tools array.

Is there an existing issue for this?

• I have searched the existing issues

Reproduction

Make an API request that includes a tools array and the tools specified in the request will be discarded

Screenshot

No response

Logs

n/a

System Info

n/a

[ZipingL]

In addition to response formats, it would be beneficial to consider them closely related for evaluation.

It would be ideal if these features were added as options to the /v1/chat/completions endpoint, as well as tool calling, since there are now many more models that support them.

I'm not particularly interested in using Ollama, but if necessary, I will. However, this would mean gradually moving away from text-generation-webui, which is not desirable at the moment.

[oobabooga]

Apparently this library is quite good for this: https://github.com/Dan-wanna-M/formatron

I personally don't have an use for function calling, but if you can find a simple way to add it, with minimal additions, a PR would be welcome.