Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the ability to extend corpus after training #77

Open
ChrisCummins opened this issue Dec 21, 2016 · 1 comment
Open

Add the ability to extend corpus after training #77

ChrisCummins opened this issue Dec 21, 2016 · 1 comment
Assignees
Milestone

Comments

@ChrisCummins
Copy link
Owner

e.g. Train on set of kernels X. Train. Add additional set of kernels X'. Train on X'.

@ChrisCummins ChrisCummins added this to the future milestone Dec 21, 2016
@ChrisCummins ChrisCummins self-assigned this Dec 21, 2016
@ChrisCummins
Copy link
Owner Author

Two possible approaches for this:

  1. Just create a new corpus of X + X', and train on that. This is wasteful, because we'll be training a new model every time.
  2. Implement a linked list of corpuses. So model points to a corpus, and the corpus contains a reference to the prior corpus. The child corpus derives it's vocabulary from the parent. And the model (already trained on the parent) can be trained on just the child.

ChrisCummins added a commit that referenced this issue May 6, 2020
ChrisCummins added a commit that referenced this issue Jun 3, 2020
ChrisCummins added a commit that referenced this issue Jun 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant