Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reinstate test cluster throttling behavior #88664

Merged
merged 2 commits into from
Jul 21, 2022

Conversation

mark-vieira
Copy link
Contributor

As a result of #85141 upgrading to Gradle 7.5 we lost some previous behavior related to test cluster parallelism. Previously, when we registered a resource lock we also provided how many leases we were requesting. The reason for this is that some tests spin up a single node cluster and others multi-node clusters. To differentiate between these tasks we count each node as a lease towards to total allowed concurrent leases.

Since there's no longer an explicit API for this in Gradle 7.5, the hack workaround is simply to register multiple locks from the same shared resource. I've tested this locally in a simple standalone project to better demonstrate that the approach does indeed work as intended.

https://gradle-enterprise.elastic.co/s/2xgmqx2ika5si/timeline

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-delivery (Team:Delivery)

@elasticsearchmachine elasticsearchmachine added v8.4.0 Team:Delivery Meta label for Delivery team labels Jul 20, 2022
@mark-vieira
Copy link
Contributor Author

@elasticmachine update branch

Copy link
Contributor

@breskeby breskeby left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

neat!

@breskeby breskeby merged commit 898b373 into elastic:master Jul 21, 2022
mark-vieira added a commit to mark-vieira/elasticsearch that referenced this pull request Jul 21, 2022
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
7.17

elasticsearchmachine pushed a commit that referenced this pull request Jul 21, 2022
Co-authored-by: Elastic Machine <[email protected]>

Co-authored-by: Elastic Machine <[email protected]>
@mark-vieira mark-vieira deleted the testclusters_parallel_throttle branch July 21, 2022 13:58
weizijun added a commit to weizijun/elasticsearch that referenced this pull request Jul 22, 2022
* upstream/master: (40 commits)
  Fix CI job naming
  [ML] disallow autoscaling downscaling in two trained model assignment scenarios (elastic#88623)
  Add "Vector Search" area to changelog schema
  [DOCS] Update API key API (elastic#88499)
  Enable the pipeline on the feature branch (elastic#88672)
  Adding the ability to register a PeerFinderListener to Coordinator (elastic#88626)
  [DOCS] Fix transform painless example syntax (elastic#88364)
  [ML] Muting InternalCategorizationAggregationTests testReduceRandom (elastic#88685)
  Fix double rounding errors for disk usage (elastic#88683)
  Replace health request with a state observer. (elastic#88641)
  [ML] Fail model deployment if all allocations cannot be provided (elastic#88656)
  Upgrade to OpenJDK 18.0.2+9 (elastic#88675)
  [ML] make bucket_correlation aggregation generally available (elastic#88655)
  Adding cardinality support for random_sampler agg (elastic#86838)
  Use custom task instead of generic AckedClusterStateUpdateTask (elastic#88643)
  Reinstate test cluster throttling behavior (elastic#88664)
  Mute testReadBlobWithPrematureConnectionClose
  Simplify plugin descriptor tests (elastic#88659)
  Add CI job for testing more job parallelism
  [ML] make deployment infer requests fully cancellable (elastic#88649)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Delivery/Build Build or test infrastructure >non-issue Team:Delivery Meta label for Delivery team v7.17.6 v8.4.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants