Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support both tool call and message text handling in response #675

Open
Finndersen opened this issue Jan 13, 2025 · 0 comments
Open

Support both tool call and message text handling in response #675

Finndersen opened this issue Jan 13, 2025 · 0 comments

Comments

@Finndersen
Copy link

Finndersen commented Jan 13, 2025

At the moment it appears that only only Tool calls OR message text processing is supported, not both at the same time.

I'm not sure if all LLMs support providing both, but it appears some do:
OpenAI example
Anthropic documentation appears to indicate it is possible

There are cases where a LLM may perform a tool call as a final response (doesn't need to see the results), along with an associated relevant message. Enabling handling of both would avoid an additional request/response cycle to the LLM.

I think this is somewhat related to this issue: #127, and this PR: #142, however slightly different since I believe those two are about whether a tool call can end a "conversation", which would also be a necessary capability to resolve this issue, but would also involve additional capability to handle both the tool call and then return the message text as the "final message" content.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant