Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minimize search source of shard level search requests #80634

Merged
merged 5 commits into from
Nov 16, 2021

Conversation

dnhatn
Copy link
Member

@dnhatn dnhatn commented Nov 10, 2021

This change reduces the memory usage and serialization cost of shard-level search requests by discarding the point in time and collapse from search sources of these shard-level requests.

I will work on another PR to remove SearchContextId from search responses.

Relates #80187

@dnhatn dnhatn marked this pull request as ready for review November 11, 2021 02:02
@dnhatn dnhatn added v8.0.0 v7.16.1 >bug :Search/Search Search-related issues that do not fall into other categories labels Nov 11, 2021
@elasticmachine elasticmachine added the Team:Search Meta label for search team label Nov 11, 2021
@dnhatn dnhatn requested a review from jimczi November 11, 2021 02:02
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

Copy link
Contributor

@jimczi jimczi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left some comments.

@dnhatn dnhatn requested a review from jimczi November 15, 2021 14:25
@dnhatn
Copy link
Member Author

dnhatn commented Nov 15, 2021

@jimczi I've addressed your comments. Can you take another look? Thank you!

@dnhatn
Copy link
Member Author

dnhatn commented Nov 15, 2021

@elasticmachine update branch

Copy link
Contributor

@jimczi jimczi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dnhatn
Copy link
Member Author

dnhatn commented Nov 16, 2021

Thanks Jim!

@dnhatn dnhatn merged commit 98f9902 into elastic:master Nov 16, 2021
@dnhatn dnhatn deleted the search-context-id branch November 16, 2021 13:58
@dnhatn dnhatn added the auto-backport Automatically create backport pull requests when merged label Nov 16, 2021
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Nov 16, 2021
This change reduces the memory usage and serialization cost of shard-level 
search requests by discarding the point in time and collapse from search
sources of these shard-level requests.

Relates elastic#80187
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.0
7.16 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 80634

dnhatn added a commit that referenced this pull request Nov 16, 2021
This change reduces the memory usage and serialization cost of shard-level 
search requests by discarding the point in time and collapse from search
sources of these shard-level requests.

Relates #80187
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Nov 16, 2021
This change reduces the memory usage and serialization cost of shard-level
search requests by discarding the point in time and collapse from search
sources of these shard-level requests.

Relates elastic#80187
elasticsearchmachine pushed a commit that referenced this pull request Nov 16, 2021
This change reduces the memory usage and serialization cost of shard-level
search requests by discarding the point in time and collapse from search
sources of these shard-level requests.

Relates #80187
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Automatically create backport pull requests when merged >bug :Search/Search Search-related issues that do not fall into other categories Team:Search Meta label for search team v7.16.0 v8.0.0-rc1 v8.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants