Add keyword fields above ignore_above to the _ignored field
#74228
Assignees
Labels
>enhancement
:Search/Search
Search-related issues that do not fall into other categories
Team:Search
Meta label for search team
v7.14.0
v8.0.0-alpha1
Comments
cbuescher
added
>enhancement
:Search/Search
|
Pinging @elastic/es-search (Team:Search) |
cbuescher
pushed a commit
to cbuescher/elasticsearch
that referenced
this issue
Jun 22, 2021
Currently the `_ignore` field indexes and stores the names of every field in a document that has been ignored because eg. it was malformed. The `ignore_above` option for keyword-type fields serves a somewhat similar purpose, so this change add logix that adds these fields to the "_ignored" field as well for `keyword`, `wildcard` and `icu_collation_keyword` fields. Closes elastic#74228
cbuescher
pushed a commit
that referenced
this issue
Jun 22, 2021
Currently the `_ignore` field indexes and stores the names of every field in a document that has been ignored because eg. it was malformed. The `ignore_above` option for keyword-type fields serves a somewhat similar purpose, so this change add logix that adds these fields to the "_ignored" field as well for `keyword`, `wildcard` and `icu_collation_keyword` fields. Closes #74228
cbuescher
pushed a commit
to cbuescher/elasticsearch
that referenced
this issue
Jun 22, 2021
Currently the `_ignore` field indexes and stores the names of every field in a document that has been ignored because eg. it was malformed. The `ignore_above` option for keyword-type fields serves a somewhat similar purpose, so this change add logix that adds these fields to the "_ignored" field as well for `keyword`, `wildcard` and `icu_collation_keyword` fields. Closes elastic#74228
cbuescher
pushed a commit
that referenced
this issue
Jun 23, 2021
Currently the `_ignore` field indexes and stores the names of every field in a document that has been ignored because eg. it was malformed. The `ignore_above` option for keyword-type fields serves a somewhat similar purpose, so this change add logix that adds these fields to the "_ignored" field as well for `keyword`, `wildcard` and `icu_collation_keyword` fields. Closes #74228
14 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Currently the
_ignorefield indexes and stores the names of every field in a document that has been ignoredbecause it was malformed and ignore_malformed was turned on. The goal is to give the user a means to identify documents
where values have been dropped and warn that these values are not searchable or aggregatable, althought they might be
present in the "_source".
Since the
ignore_aboveoption for keyword fields serves a somewhat similar purpose (drop values if they exceed a certain length, mostly as a safeguard for the system), we should also add these fields to the "_ignored" field.Relates to #74121
The text was updated successfully, but these errors were encountered: