Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disallow disabling _field_names #27239

Closed
jpountz opened this issue Nov 2, 2017 · 6 comments · Fixed by #42854
Closed

Disallow disabling _field_names #27239

jpountz opened this issue Nov 2, 2017 · 6 comments · Fixed by #42854
Assignees
Labels
>enhancement help wanted adoptme :Search Foundations/Mapping Index mappings, including merging and defining field types Team:Search Foundations Meta label for the Search Foundations team in Elasticsearch

Comments

@jpountz
Copy link
Contributor

jpountz commented Nov 2, 2017

Now that _field_names has basically no overhead anymore (#26930), we should ignore the enabled setting in 6.x (and log deprecation) and reject it in 7.x, or maybe 8,x if we want to maintain compatibility for templates.

cc @colings86

@jpountz jpountz added :Search Foundations/Mapping Index mappings, including merging and defining field types >enhancement v6.1.0 v7.0.0 labels Nov 2, 2017
@colings86
Copy link
Contributor

colings86 commented Nov 3, 2017

Caveat to this: _fieldNames has basically no overhead in the case where doc_values and norms are enabled. If doc_values are disabled then _field_names will have the same overhead as before.
I wonder if for a high index through put use case you would still want the option to disable _field_names because you are disabling doc_values on fields that you don't want to aggregate to increase indexing throughput and don't want to counter this by adding the overhead of writing to _field_names?

@lcawl lcawl added v6.2.0 and removed v6.1.0 labels Dec 12, 2017
@colings86 colings86 added v6.3.0 and removed v6.2.0 labels Jan 22, 2018
@javanna
Copy link
Member

javanna commented Mar 16, 2018

@elastic/es-search-aggs

@ppf2
Copy link
Member

ppf2 commented Mar 22, 2018

As part of this ticket, can we also clarify the documentation to mention that there is much less overhead now for most use cases except for the caveats mentioned above? Thx!

@jimczi
Copy link
Contributor

jimczi commented Apr 16, 2019

We discussed this issue internally and agreed that this is something that we still want to do.
Since it's not high priority we also said that we should at least clarify the documentation to mention the new cost of the _field_names field so I am adding the >docs and adoptme label.

@jimczi jimczi added >docs General docs changes help wanted adoptme and removed team-discuss labels Apr 16, 2019
@cbuescher cbuescher self-assigned this May 29, 2019
@cbuescher
Copy link
Member

I just checked the docs that @ppf2 linked to above and the section about disabling _field_names has been removed from the "Tune for indexing speed" page as of #37717.
I will check if there are other locations in the docs where it would make sense to mention the cost of _field_names. That should cover the docs side of things for now, we would still need to deprecate the enabled setting separately.

@cbuescher
Copy link
Member

I think what @colings86 rewrote in #31029 covers the documentation needs here, so I'm going to remove that lable, leaving the deprecation issue open.

@cbuescher cbuescher removed the >docs General docs changes label Jun 4, 2019
cbuescher pushed a commit to cbuescher/elasticsearch that referenced this issue Jun 4, 2019
Currently we allow `_field_names` fields to be disabled explicitely, but since
the overhead is negligible now we decided to keep it turned on by default and
deprecate and ignore the `enable` option on the field type.

Closes elastic#27239
cbuescher pushed a commit that referenced this issue Sep 11, 2019
Currently we allow `_field_names` fields to be disabled explicitely, but since
the overhead is negligible now we decided to keep it turned on by default and
deprecate the `enable` option on the field type. This change adds a deprecation
warning whenever this setting is used, going forward we want to ignore and finally
remove it.

Closes #27239
cbuescher pushed a commit that referenced this issue Sep 11, 2019
Currently we allow `_field_names` fields to be disabled explicitely, but since
the overhead is negligible now we decided to keep it turned on by default and
deprecate the `enable` option on the field type. This change adds a deprecation
warning whenever this setting is used, going forward we want to ignore and finally
remove it.

Closes #27239
@javanna javanna added the Team:Search Foundations Meta label for the Search Foundations team in Elasticsearch label Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement help wanted adoptme :Search Foundations/Mapping Index mappings, including merging and defining field types Team:Search Foundations Meta label for the Search Foundations team in Elasticsearch
Projects
None yet
Development

Successfully merging a pull request may close this issue.

9 participants