Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow rollup job creation only if cluster is x-pack ready #30963

Merged
merged 2 commits into from
Jun 1, 2018

Conversation

ywelsch
Copy link
Contributor

@ywelsch ywelsch commented May 30, 2018

Otherwise we could end up with persistent tasks metadata in the cluster that some of the nodes might not understand in case where the cluster is during rolling upgrade from the default 6.2 to the default 6.3 distribution.

Follow-up to #30743

@nik9000 any ideas on how we can test this using XPackIT? One idea I have is to create a rollup job when CLUSTER_TYPE = MIXED on the nodes that are upgraded, and then do a follow-up action to check if the cluster is still acknowledging cluster state updates.

@ywelsch ywelsch added >enhancement blocker v7.0.0 v6.3.0 :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data v6.4.0 labels May 30, 2018
@ywelsch ywelsch requested a review from bleskes May 30, 2018 12:47
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search-aggs

@ywelsch
Copy link
Contributor Author

ywelsch commented May 30, 2018

@elasticmachine retest this please

@ywelsch ywelsch requested a review from jasontedor May 30, 2018 15:28
@nik9000
Copy link
Member

nik9000 commented May 30, 2018

@nik9000 any ideas on how we can test this using XPackIT? One idea I have is to create a rollup job when CLUSTER_TYPE = MIXED on the nodes that are upgraded, and then do a follow-up action to check if the cluster is still acknowledging cluster state updates.

@nik9000 any ideas on how we can test this using XPackIT? One idea I have is to create a rollup job when CLUSTER_TYPE = MIXED on the nodes that are upgraded, and then do a follow-up action to check if the cluster is still acknowledging cluster state updates.

That'd do it, yeah. You want to assert that it fails to create the roll up job if the cluster is mixed and that it successfully created it if the cluster isn't mixed.

Copy link
Contributor

@bleskes bleskes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@ywelsch ywelsch merged commit e1649b8 into elastic:master Jun 1, 2018
ywelsch added a commit that referenced this pull request Jun 1, 2018
Otherwise we could end up with persistent tasks metadata in the cluster that some of the nodes
might not understand in case where the cluster is during rolling upgrade from the default 6.2 to the
default 6.3 distribution.

Follow-up to #30743
ywelsch added a commit that referenced this pull request Jun 1, 2018
Otherwise we could end up with persistent tasks metadata in the cluster that some of the nodes
might not understand in case where the cluster is during rolling upgrade from the default 6.2 to the
default 6.3 distribution.

Follow-up to #30743
nik9000 added a commit to nik9000/elasticsearch that referenced this pull request Jun 1, 2018
Prior to elastic#30963 you could create a rollup job that would poison the
cluster state for nodes that don't have xpack installed. This adds a
test that would have caught that.
dnhatn added a commit that referenced this pull request Jun 2, 2018
* 6.x:
  Adjust BWC version on client features
  Introduce client feature tracking (#31020)
  [DOCS] Make geoshape docs less memory hungry (#31014)
  Fix handling of percent-encoded spaces in Windows batch files (#31034)
  [Docs] Fix a typo in Create Index naming limitation (#30891)
  REST high-level client: add delete ingest pipeline API (#30865)
  Ensure that index_prefixes settings cannot be changed (#30967)
  REST high-level client: add get ingest pipeline API (#30847)
  Cross Cluster Search: preserve remote status code (#30976)
  High-level client: list tasks failure to not lose nodeId (#31001)
  Refactor Sniffer and make it testable (#29638)
  [ML][TEST] Fix bucket count assertion in all tests in ModelPlotsIT (#31026)
  Add an option to split keyword field on whitespace at query time (#30691)
  Allow rollup job creation only if cluster is x-pack ready (#30963)
  Fix interoperability with < 6.3 transport clients (#30971)
  [Tests] Fix alias names in PutIndexTemplateRequestTests (#30960)
  [DOCS] Fixes links (#31011)
  Watcher: Give test a little more time
dnhatn added a commit that referenced this pull request Jun 2, 2018
* master:
  Avoid randomization bug in FeatureAwareTests
  Adjust BWC version on client features
  Add TRACE, CONNECT, and PATCH http methods (#31035)
  Adjust BWC version on client features
  [DOCS] Make geoshape docs less memory hungry (#31014)
  Fix handling of percent-encoded spaces in Windows batch files (#31034)
  [Docs] Fix a typo in Create Index naming limitation (#30891)
  Introduce client feature tracking (#31020)
  Ensure that index_prefixes settings cannot be changed (#30967)
  REST high-level client: add delete ingest pipeline API (#30865)
  [ML][TEST] Fix bucket count assertion in all tests in ModelPlotsIT (#31026)
  Allow rollup job creation only if cluster is x-pack ready (#30963)
  Fix interoperability with < 6.3 transport clients (#30971)
  Add an option to split keyword field on whitespace at query time (#30691)
  [Tests] Fix alias names in PutIndexTemplateRequestTests (#30960)
  REST high-level client: add get ingest pipeline API (#30847)
  Cross Cluster Search: preserve remote status code (#30976)
  High-level client: list tasks failure to not lose nodeId (#31001)
  [DOCS] Fixes links (#31011)
  Watcher: Give test a little more time
  Reuse expiration date of trial licenses (#30950)
  Remove unused query methods from MappedFieldType. (#30987)
  Transport client: Don't validate node in handshake (#30737)
  [DOCS] Clarify not all PKCS12 usable as truststores (#30750)
  HLRest: Allow caller to set per request options (#30490)
  Remove version read/write logic in Verify Response (#30879)
  [DOCS] Update readme for testing x-pack code snippets (#30696)
  Ensure intended key is selected in SamlAuthenticatorTests (#30993)
  Core: Remove RequestBuilder from Action (#30966)
nik9000 added a commit that referenced this pull request Jun 4, 2018
Prior to #30963 you could create a rollup job that would poison the
cluster state for nodes that don't have xpack installed. This adds a
test that would have caught that.
nik9000 added a commit that referenced this pull request Jun 4, 2018
Prior to #30963 you could create a rollup job that would poison the
cluster state for nodes that don't have xpack installed. This adds a
test that would have caught that.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocker >enhancement :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data v6.3.0 v6.4.0 v7.0.0-beta1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants