-
Notifications
You must be signed in to change notification settings - Fork 25k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove usage of max_local_storage_nodes in test infrastructure #41652
Remove usage of max_local_storage_nodes in test infrastructure #41652
Conversation
Pinging @elastic/es-core-infra |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I left a couple of minor comments, but this looks good. CI failed without giving any useful feedback:
org.elasticsearch.gradle.testclusters.TestClustersPluginIT > testMultiProject FAILED
org.gradle.testkit.runner.UnexpectedBuildFailure at TestClustersPluginIT.java:88
|
||
ensureGreen(); | ||
|
||
// index is gone. | ||
assertFalse(indexExists(indexName)); | ||
} | ||
|
||
private void executeRepurposeCommandForOrdinal(Settings settings, String indexUUID, int ordinal, | ||
private void executeRepurposeCommandForOrdinal(Settings settings, String indexUUID, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This method name mensions ordinal
but ordinal
is no longer an argument.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fixed in c10b9a4
updatedSettings.put(Environment.PATH_DATA_SETTING.getKey(), baseDir.resolve(name)); | ||
} | ||
|
||
updatedSettings.put(Environment.PATH_SHARED_DATA_SETTING.getKey(), baseDir.resolve(name + "-shared")); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we still need this? It seems strange that it's set in every integration test when it's so rarely used in production.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, it's used by ESIntegTestCase
which 30% of the time uses custom data path (see ESIntegTestCase#indexSettings()
)
The above test failures are not reproducible after merging in latest master. |
@elasticmachine run elasticsearch-ci/1 |
@elasticmachine run elasticsearch-ci/1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
(I'm not excluding the possibility that some other tests need adjustment too, but CI didn't find them here)
…torage-nodes-usage
…torage-nodes-usage
@elasticmachine run elasticsearch-ci/1 |
Moves the test infrastructure away from using node.max_local_storage_nodes, allowing us in a follow-up PR to deprecate this setting in 7.x and to remove it in 8.0. This also changes the behavior of InternalTestCluster so that starting up nodes will not automatically reuse data folders of previously stopped nodes. If this behavior is desired, it needs to be explicitly done by passing the data path from the stopped node to the new node that is started.
…ic#41652) Moves the test infrastructure away from using node.max_local_storage_nodes, allowing us in a follow-up PR to deprecate this setting in 7.x and to remove it in 8.0. This also changes the behavior of InternalTestCluster so that starting up nodes will not automatically reuse data folders of previously stopped nodes. If this behavior is desired, it needs to be explicitly done by passing the data path from the stopped node to the new node that is started.
With node ordinals gone, there's no longer a need for such a complicated full cluster restart procedure (as we can now uniquely associate nodes to data folders). Follow-up to #41652
With node ordinals gone, there's no longer a need for such a complicated full cluster restart procedure (as we can now uniquely associate nodes to data folders). Follow-up to #41652
With node ordinals gone, there's no longer a need for such a complicated full cluster restart procedure (as we can now uniquely associate nodes to data folders). Follow-up to elastic#41652
Moves the test infrastructure away from using
node.max_local_storage_nodes
, allowing us in a follow-up PR to deprecate this setting in 7.x and to remove it in 8.0.This also changes the behavior of InternalTestCluster so that starting up nodes will not automatically reuse data folders of previously stopped nodes. If this behavior is desired, it needs to be explicitly done by passing the data path from the stopped node to the new node that is started.