Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Node level can match action #78765

Merged
merged 38 commits into from
Oct 18, 2021
Merged

Conversation

ywelsch
Copy link
Contributor

@ywelsch ywelsch commented Oct 6, 2021

Changes can-match from a shard-level to a node-level action, which helps avoid an explosion of shard-level can-match subrequests in clusters with many shards, that can cause stability issues. Also introduces a new search_coordination thread pool to handle the sending and handling of node-level can-match requests.

@dnhatn dnhatn self-requested a review October 13, 2021 04:05
Copy link
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Yannick! I think the production code is ready :). We just need to add some tests then 🚢!

@ywelsch ywelsch requested review from jimczi and dnhatn October 15, 2021 10:22
Copy link
Contributor

@jimczi jimczi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The change looks great!
I left one comment regarding the wait for checkpoint option.
I wonder, as a follow up, if we should use the new thread pool for the coordination of the other phases too ?

@jimczi jimczi added :Search/Search Search-related issues that do not fall into other categories >enhancement release highlight labels Oct 15, 2021
@elasticmachine elasticmachine added the Team:Search Meta label for search team label Oct 15, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

Copy link
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @ywelsch.

@dnhatn
Copy link
Member

dnhatn commented Oct 15, 2021

@elasticmachine update branch

@ywelsch ywelsch merged commit 13487b1 into elastic:master Oct 18, 2021
ywelsch added a commit to ywelsch/elasticsearch that referenced this pull request Oct 18, 2021
Changes can-match from a shard-level to a node-level action, which helps avoid an explosion of shard-level can-match
subrequests in clusters with many shards, that can cause stability issues. Also introduces a new search_coordination
thread pool to handle the sending and handling of node-level can-match requests.
ywelsch added a commit that referenced this pull request Oct 18, 2021
Changes can-match from a shard-level to a node-level action, which helps avoid an explosion of shard-level can-match
subrequests in clusters with many shards, that can cause stability issues. Also introduces a new search_coordination
thread pool to handle the sending and handling of node-level can-match requests.
ywelsch added a commit to ywelsch/elasticsearch that referenced this pull request Oct 18, 2021
ywelsch added a commit that referenced this pull request Oct 18, 2021
weizijun added a commit to weizijun/elasticsearch that referenced this pull request Oct 18, 2021
* upstream/master:
  Changing test keytab to use aes256-cts-hmac-sha1-96 instead of des3-cbc-sha1-kd (elastic#78703)
  Add support for configuring HNSW parameters (elastic#79193)
  Deprecate resolution loss on date field (elastic#78921)
  Add Optional to Configure bind user (elastic#78303)
  Adapt BWC after backporting elastic#78765 (elastic#79350)
  [DOCS] Add deprecation notice for reset password tool (elastic#78793)
  added test for flattened type in top_metrics.yml (elastic#78960)
  [DOCS] Fixes indentation issue in GET trained models API docs. (elastic#79347)
  Fix parsing of PBES2 encrypted PKCS#8 keys (elastic#78904)
  Mute testReindex (elastic#79343)
  Node level can match action (elastic#78765)
  Fix duplicate license header in source files (elastic#79236)
  AllowAll for indicesAccessControl (elastic#78498)
  Better logging and internal user handling for operator privileges (elastic#79331)

# Conflicts:
#	server/src/main/java/org/elasticsearch/index/mapper/MappingParser.java
@dnhatn dnhatn added v7.16.0 and removed v7.16.0 labels Nov 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement release highlight resiliency :Search/Search Search-related issues that do not fall into other categories Team:Search Meta label for search team v7.16.0 v8.0.0-beta1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants