Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix
random_mask_tokenize
when the text is long
Without this patch, the function crashes for long texts. See https://colab.research.google.com/drive/1SHBAUEnI1dNJmXQPUqZekFqXm7xrwH65?usp=sharing
- Loading branch information