Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix handling of len and lenof as names
For compatibility with programs written for older Snowball versions len and lenof stop being tokens if declared as names. However this code didn't work correctly if the tokeniser's name buffer didn't have enough space for the name (i.e. 3 or 5 elements respectively).
- Loading branch information