[8.12] [Obs AI Assistant] ES|QL improvements (#173303) #173486
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Use a combination of system prompt + recall for ES|QL to allow for: - faster responses - wider support of functions (e.g. any documented function is now supported, in theory) Performance for the current ES|QL scenarios is similar. Some things I've noticed: - ~for whatever reason it is much harder to get the LLM to not make certain mistakes. I've tried mentioning some mistakes close to the end of the conversation, but will explore other options.~ I am again opting for repeating common mistakes at the start of the message, but this time I'm allowing the LLM to pick them. - if we can prevent it from making "known" mistakes, we can figure out a way to have the LLM store known mistakes. This is also useful for other functions - another thing I want to figure out is if more examples improves for commands and custom documentation improves performance. but later. --------- Co-authored-by: kibanamachine <[email protected]> (cherry picked from commit d54109d)
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
💚 Build Succeeded
Metrics [docs]Async chunks
To update your PR or re-run it, just comment with: cc @dgieselaar |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Backport
This will backport the following commits from
mainto8.12:Questions ?
Please refer to the Backport tool documentation