Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix term stats when talking to ES 6 #75735

Merged
merged 4 commits into from
Jul 28, 2021
Merged

Conversation

ywelsch
Copy link
Contributor

@ywelsch ywelsch commented Jul 27, 2021

In a mixed 6.x and 7.x cluster, a search that uses dfs_query_then_fetch can cause a transport serialization errors.

This is related to https://issues.apache.org/jira/browse/LUCENE-8007, which was introduced in Lucene 8 and adds stricter checks to TermStatistics and CollectionStatistics, and https://issues.apache.org/jira/browse/LUCENE-8020, which was introduced in Lucene 8 and avoids bogus term stats (e.g. docfreq=0).

Co-authored-by: Julie Tibshirani [email protected]

Closes #75349

@ywelsch ywelsch added :Search/Search Search-related issues that do not fall into other categories >bug v7.14.1 labels Jul 27, 2021
@ywelsch ywelsch marked this pull request as ready for review July 27, 2021 14:09
@elasticmachine elasticmachine added the Team:Search Meta label for search team label Jul 27, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

@ywelsch ywelsch requested review from jtibshirani and jpountz July 27, 2021 14:09
Copy link
Contributor

@jtibshirani jtibshirani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for picking this up!

@ywelsch ywelsch requested review from jpountz and jtibshirani July 27, 2021 16:29
@ywelsch ywelsch merged commit 3cc15e1 into elastic:7.x Jul 28, 2021
ywelsch added a commit that referenced this pull request Jul 28, 2021
In a mixed 6.x and 7.x cluster, a search that uses dfs_query_then_fetch can cause a transport serialization errors.

This is related to https://issues.apache.org/jira/browse/LUCENE-8007, which was introduced in Lucene 8 and adds stricter checks to TermStatistics and CollectionStatistics, and https://issues.apache.org/jira/browse/LUCENE-8020, which was introduced in Lucene 8 and avoids bogus term stats (e.g. docfreq=0).

Co-authored-by: Julie Tibshirani [email protected]

Closes #75349
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>bug :Search/Search Search-related issues that do not fall into other categories Team:Search Meta label for search team v7.14.0 v7.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants