Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a POS tagger #6

Open
watzon opened this issue Jun 11, 2019 · 0 comments
Open

Add a POS tagger #6

watzon opened this issue Jun 11, 2019 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed
Milestone

Comments

@watzon
Copy link
Member

watzon commented Jun 11, 2019

POS tagging is the categorizing of words in a sentence based on part of speech relative to the other words in the sentence. This can be done very simply with wordnet, but to accomplish full POS tagging each word must be tagged based in its relationship to the previous word and the next word. Some "words" are also made up of multiple grams, such as "New York".

The tagger should be able to see a word like "New" and know that if "York", "Jersey", "Amsterdam", or any number of other words appear next to it that there is a very good possibility that they should be counted as one word, and a proper noun at that.

@watzon watzon added this to the v1 milestone Jun 11, 2019
@watzon watzon added enhancement New feature or request help wanted Extra attention is needed labels Aug 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant