Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOCS] Added supported stopword languages. Closes elastic#16561 #48011

Closed
wants to merge 11 commits into from
Closed

[DOCS] Added supported stopword languages. Closes elastic#16561 #48011

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
e3376f1
[DOCS] Added supported stopword languages. Closes elastic#16561
ScottieL Oct 14, 2019
2a0c1fe
Update docs/reference/analysis/analyzers/stop-analyzer-language-suppo…
ScottieL Oct 14, 2019
eab9576
Update docs/reference/analysis/analyzers/stop-analyzer-language-suppo…
ScottieL Oct 14, 2019
60539cc
Update docs/reference/analysis/analyzers/stop-analyzer-language-suppo…
ScottieL Oct 14, 2019
5195262
Update docs/reference/analysis/analyzers/stop-analyzer-language-suppo…
ScottieL Oct 14, 2019
ea87a46
Update docs/reference/analysis/analyzers/stop-analyzer.asciidoc
ScottieL Oct 14, 2019
0fe315f
Update docs/reference/analysis/analyzers/stop-analyzer.asciidoc
ScottieL Oct 14, 2019
003ce00
Update docs/reference/analysis/analyzers/stop-analyzer-language-suppo…
ScottieL Oct 14, 2019
18dcce1
Update stop-analyzer-language-support.asciidoc
ScottieL Oct 15, 2019
3382bf3
Update stop-analyzer-language-support.asciidoc
ScottieL Dec 13, 2019
1b46393
Update stop-analyzer-language-support.asciidoc
ScottieL Dec 13, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
113 changes: 113 additions & 0 deletions docs/reference/analysis/analyzers/stop-analyzer-language-support.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,113 @@

The following table contains a list of supported languages
with links to default stop words.

[options="header"]
|=======
|Language |Source
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Language |Source
|Language |Stop words source


|Arabic
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
| link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/java/org/apache/lucene/analysis/ar/ArabicAnalyzer.java#L57[Lucene]
ScottieL marked this conversation as resolved.
Show resolved Hide resolved

|Armenian
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_hy.txt[Lucene]
ScottieL marked this conversation as resolved.
Show resolved Hide resolved

|Basque
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Basque
|`_basque_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_eu.txt[Lucene]
ScottieL marked this conversation as resolved.
Show resolved Hide resolved

|Bengali
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/java/org/apache/lucene/analysis/bn/BengaliAnalyzer.java#L45[Lucene]
ScottieL marked this conversation as resolved.
Show resolved Hide resolved

|Brazilian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Brazilian
|`_brazilian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_pt.txt[Lucene]

|Bulgarian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Bulgarian
|`_bulgarian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_bg.txt[Lucene]

|Catalan
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Catalan
|`_catalan_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_ca.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_ca.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/ca/stopwords.txt[Lucene]


|CJK
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|CJK
|`_cjk_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/CJKAnalyzer.java[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/CJKAnalyzer.java[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/cjk/stopwords.txt[Lucene]


|Czech
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Czech
|`_czech_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/example-DIH/solr/db/conf/lang/stopwords_cz.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/example-DIH/solr/db/conf/lang/stopwords_cz.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/cz/stopwords.txt[Lucene]


|Danish
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Danish
|`_danish_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/danish_stop.txt[Lucene]

|Dutch
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Dutch
|`_dutch_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/dutch_stop.txt[Lucene]

|English
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|English
|`_english_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/java/org/apache/lucene/analysis/en/EnglishAnalyzer.java#L46[Lucene]

|Finnish
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Finnish
|`_finnish_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/finnish_stop.txt[Lucene]

|French
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|French
|`_french_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/french_stop.txt[Lucene]

|Galician
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Galician
|`_galician_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_gl.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_gl.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/gl/stopwords.txt[Lucene]


|German
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|German
|`_german_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/german_stop.txt[Lucene]

|Greek
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Greek
|`_greek_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_el.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_el.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/el/stopwords.txt[Lucene]


|Hindi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Hindi
|`_hindi_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_hi.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_hi.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/hi/stopwords.txt[Lucene]


|Hungarian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Hungarian
|`_hungarian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/hungarian_stop.txt[Lucene]

|Indonesian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Indonesian
|`_indonesian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_id.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_id.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/id/stopwords.txt[Lucene]


|Irish
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Irish
|`_irish_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_ga.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_ga.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/ga/stopwords.txt[Lucene]


|Italian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Italian
|`_italian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/italian_stop.txt[Lucene]

|Latvian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Latvian
|`_latvian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_lv.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_lv.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/lv/stopwords.txt[Lucene]


|Lithuanian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Lithuanian
|`_lithuanian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/example-DIH/solr/db/conf/lang/stopwords_lv.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/example-DIH/solr/db/conf/lang/stopwords_lv.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/lt/stopwords.txt[Lucene]


|Norwegian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Norwegian
|`_norwegian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/norwegian_stop.txt[Lucene]

|Persian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Persian
|`_persian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_fa.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_fa.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/fa/stopwords.txt[Lucene]


|Portuguese
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Portuguese
|`_portuguese_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/portuguese_stop.txt[Lucene]

|Romanian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Romanian
|`_romanian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_ro.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_ro.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/ro/stopwords.txt[Lucene]


|Russian
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Russian
|`_russian_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/russian_stop.txt[Lucene]

|Sorani
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Sorani
|`_sorani_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/example-DIH/solr/db/conf/lang/stopwords_ckb.txt[Lucene]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/example-DIH/solr/db/conf/lang/stopwords_ckb.txt[Lucene]
|link:https://github.com/apache/lucene-solr/blob/master/lucene/analysis/common/src/resources/org/apache/lucene/analysis/ckb/stopwords.txt[Lucene]


|Spanish
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Spanish
|`_spanish_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/spanish_stop.txt[Lucene]

|Swedish
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
|Swedish
|`_swedish_`

|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/swedish_stop.txt[Lucene]

|Thai
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_th.txt[Lucene]
ScottieL marked this conversation as resolved.
Show resolved Hide resolved

|Turkish
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
|link:https://github.com/apache/lucene-solr/blob/2e1a470c90e9293a42160280c5c39afb33bb5db0/solr/example/files/conf/lang/stopwords_tr.txt[Lucene]
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
|=======


See the link:https://github.com/elastic/elasticsearch/blob/master/docs/reference/analysis/analyzers/stop-analyzer.asciidoc#analysis-stop-tokenfilter[Stop Analyzer Documentaton] for more information about the stop word configuration.
ScottieL marked this conversation as resolved.
Show resolved Hide resolved
Loading