Implement constrained function calling #121
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Function calling configuration allows specifying that the model must, or must not, call a function on the current response. By default the model is allowed to choose whether to call a function or reply in natural language. Add a `FunctionCallingConfig` class and a `functionCallingConfig` argument to the `GeneratieModel` constructor and the methods for generating content. The classes are fields match the API model directly. Add support for overriding the `tools` for a specific generate content call.
devoncarew
approved these changes
Apr 15, 2024
We have an example with basic function calling. Brian's guessing game is also a nice example to implement on top of constrained function calling so I think that's probably the best sample to run with. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Function calling configuration allows specifying that the model must, or
must not, call a function on the current response. By default the model
is allowed to choose whether to call a function or reply in natural
language.
Add a
ToolConfigclass and atoolConfigargument to theGenerativeModelconstructor and the methods for generating content.The classes and fields match the API model directly.
Add support for overriding the
toolsfor a specific generate contentcall from what was set during instantiation.