Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky test #109978 #110245

Merged

Conversation

benwtrent
Copy link
Member

CCS tests could split the vectors over any number of shards. Through empirical testing, I determined this commits values work to provide the expected order, even if they are not all part of the same shard.

quantization can have weird behaviors when there are uniform values, just like this test does.

closes #109978

@benwtrent benwtrent added >test Issues or PRs that are addressing/adding tests :Search Relevance/Vectors Vector search v8.15.0 labels Jun 27, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

@elasticsearchmachine elasticsearchmachine added Team:Search Meta label for search team v8.16.0 and removed v8.15.0 labels Jun 27, 2024
Copy link
Contributor

@john-wagster john-wagster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@benwtrent benwtrent added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Jul 8, 2024
@benwtrent
Copy link
Member Author

@elasticmachine update branch

muted-tests.yml Outdated
@@ -97,9 +97,6 @@ tests:
- class: "org.elasticsearch.xpack.searchablesnapshots.FrozenSearchableSnapshotsIntegTests"
issue: "https://github.com/elastic/elasticsearch/issues/110408"
method: "testCreateAndRestorePartialSearchableSnapshot"
- class: org.elasticsearch.test.rest.yaml.CcsCommonYamlTestSuiteIT
method: test {p0=search.vectors/41_knn_search_half_byte_quantized/Test create, merge, and search cosine}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the test we use an index with number_of_shards: 1; do CCS tests override that / create different settings?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pmpailis CCS means more than one cluster. So by definition, even if an index has only one shard, the docs could be split across different indices on different clusters.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah fair enough! Not having to do with the test specifically, but I thought that we could have some instances with more than one shards, so I was wondering if there was any weird override for the yaml tests.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, the number of shards is still 1 for all the indices over all the clusters, its just now spread over more than one cluster :)

@elasticsearchmachine elasticsearchmachine merged commit 9dbe97b into elastic:main Jul 8, 2024
15 checks passed
@benwtrent benwtrent deleted the test/fix-flaky-test-109978 branch July 8, 2024 21:28
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

The backport operation could not be completed due to the following error:

An unexpected error occurred when attempting to backport this PR.

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 110245

@benwtrent
Copy link
Member Author

💚 All backports created successfully

Status Branch Result
8.15

Questions ?

Please refer to the Backport tool documentation

benwtrent added a commit to benwtrent/elasticsearch that referenced this pull request Jul 9, 2024
CCS tests could split the vectors over any number of shards. Through
empirical testing, I determined this commits values work to provide the
expected order, even if they are not all part of the same shard.

quantization can have weird behaviors when there are uniform values,
just like this test does.

closes elastic#109978

(cherry picked from commit 9dbe97b)
elasticsearchmachine pushed a commit that referenced this pull request Jul 9, 2024
CCS tests could split the vectors over any number of shards. Through
empirical testing, I determined this commits values work to provide the
expected order, even if they are not all part of the same shard.

quantization can have weird behaviors when there are uniform values,
just like this test does.

closes #109978

(cherry picked from commit 9dbe97b)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport pending :Search Relevance/Vectors Vector search Team:Search Meta label for search team >test Issues or PRs that are addressing/adding tests v8.15.1 v8.16.0
Projects
None yet
5 participants