v1.0.32
Full Changelog: v1.0.31...v1.0.32
- added hyperparameter
min_frequency
to adjust the merge pairs to avoid extra vocab. - default is set to 2.
- made some changes in the tests.
Full Changelog: v1.0.31...v1.0.32
min_frequency
to adjust the merge pairs to avoid extra vocab.