Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(participant): filter message history when it goes over maxInputTokens VSCODE-653 #894

Merged
merged 9 commits into from
Dec 9, 2024

Conversation

gagik
Copy link
Contributor

@gagik gagik commented Dec 3, 2024

Drops messages in history if their total would lead to too many tokens being used.

@gagik gagik force-pushed the gagik/filter-message-history branch from 895e306 to cd06aa0 Compare December 4, 2024 14:33
@gagik gagik changed the title WIP: filter messages when they go over maxInputTokens feat(participant): filter message history when it goes over maxInputTokens Dec 5, 2024
@gagik gagik changed the title feat(participant): filter message history when it goes over maxInputTokens feat(participant): filter message history when it goes over maxInputTokens VSCODE-653 Dec 5, 2024
src/participant/prompts/promptBase.ts Show resolved Hide resolved
src/participant/sampleDocuments.ts Show resolved Hide resolved
src/test/suite/participant/participant.test.ts Outdated Show resolved Hide resolved
@gagik gagik marked this pull request as ready for review December 5, 2024 12:37
@alenakhineika
Copy link
Contributor

Have you tried to run accuracy tests to ensure we haven't broken the experience while manipulating the history?

@gagik
Copy link
Contributor Author

gagik commented Dec 6, 2024

Have you tried to run accuracy tests to ensure we haven't broken the experience while manipulating the history?

Just ran them, results are consistent with what I have had before so seems alright 🤞

@gagik gagik merged commit 07ebbd0 into main Dec 9, 2024
6 checks passed
@gagik gagik deleted the gagik/filter-message-history branch December 9, 2024 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants