Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add TokenizeVocabulary to api docs #17208

Merged
merged 2 commits into from
Oct 31, 2024
Merged

Add TokenizeVocabulary to api docs #17208

merged 2 commits into from
Oct 31, 2024

Conversation

davidwendt
Copy link
Contributor

Description

Adds the TokenizeVocabulary class to the cuDF API guide.
Also removes the SubwordTokenizer which is to be deprecated in the future.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@davidwendt davidwendt added 2 - In Progress Currently a work in progress doc Documentation non-breaking Non-breaking change labels Oct 30, 2024
@davidwendt davidwendt self-assigned this Oct 30, 2024
@davidwendt davidwendt added 3 - Ready for Review Ready for review by team and removed 2 - In Progress Currently a work in progress labels Oct 30, 2024
@davidwendt davidwendt marked this pull request as ready for review October 30, 2024 21:23
@davidwendt davidwendt requested a review from vyasr October 30, 2024 21:24
@vyasr vyasr mentioned this pull request Oct 31, 2024
Open
@davidwendt
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit 3db6a0e into rapidsai:branch-24.12 Oct 31, 2024
86 checks passed
@davidwendt davidwendt deleted the doc-vocab-tokenizer branch October 31, 2024 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@vyasr vyasr vyasr approved these changes

Assignees

@davidwendt davidwendt

Labels
3 - Ready for Review Ready for review by team doc Documentation non-breaking Non-breaking change
Projects
cuDF/Dask/Numba/UCX
Status: Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@davidwendt @vyasr