transliterate (and query) non-latin text with the elasticsearch ICU plugin

[harrisonpim]

Until now, we've been able to search for analysed forms of non-latin text (eg stemming in arabic), but haven't been able to search for transliterations of that text, unless provided by a human cataloguer. The ICU transform token filter looks like it could make that possible.

For example, from this post

curl -XGET 'localhost:9200/icu_transform_analyzer/_analyze?analyzer=latin&pretty' -d '{
  "text": "キャンパス" 
}'
Returns kyanpasu


curl -XGET 'localhost:9200/icu_transform_analyzer/_analyze?analyzer=latin&pretty' -d '{
  "text": "Αλφαβητικός Κατάλογος" 
}'
Returns Alphabetikos Katalogo


curl -XGET 'localhost:9200/icu_transform_analyzer/_analyze?analyzer=latin&pretty' -d '{
  "text": "биологическом" 
}'
Returns biologiceskom

See also

• https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu-transform.html
• https://unicode-org.github.io/icu/userguide/transforms/general/