-
-
Notifications
You must be signed in to change notification settings - Fork 4.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
KeyError when adding special tokens #624
Comments
Sorry about this — the docs got a bit ahead of the code here. The docs describe how the feature should work, and will work shortly (I'll probably fix it over the weekend). At the moment you can use the key |
Nice! I got it to work by passing 'F' and working backwards, after I traced the Thanks for the lightning reply and superb work. |
After changing it to:
I get:
|
This should now be fixed on master. Thanks for your patience. |
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
I am trying to run the example of adding special tokens to the tokenizer and getting the following keyerror:
The code used is the following:
Am I missing something here?
System info:
The text was updated successfully, but these errors were encountered: