elasticsearch-ci Darwin compatibility jobs constantly suffer suite timeouts

[alpar-t]

See:

https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+multijob-darwin-compatibility/

We used to run with 4 workers.
These were reduced to 2 and we still see failures in this test : https://gradle-enterprise.elastic.co/s/mxtkxz4mrrgbe/

[elasticmachine]

Pinging @elastic/ml-core (:ml)

[droberts195]

This build still constantly fails due to suite timeouts, but recently it's always been in the docs suite, not ML:

• 12th November AM: https://gradle-enterprise.elastic.co/s/a5numqgusxnou/tests/jbm2x6tnwtxku-a3n2w4h4zba6q
• 11th November PM: https://gradle-enterprise.elastic.co/s/mjwzy6yold6au/tests/jbm2x6tnwtxku-a3n2w4h4zba6q
• 11th November AM: https://gradle-enterprise.elastic.co/s/h637y6zv7trb2/tests/jbm2x6tnwtxku-a3n2w4h4zba6q

Looking through the test timings in the docs suite one test is particularly slow (reference/analysis/charfilters/htmlstrip-charfilter/line_74) but it's not like any single test is using up all the time. It just seems that the Mac workers take ages to run each test.

test {yaml=reference/analysis/charfilters/htmlstrip-charfilter/line_74}
2m 32.339s
test {yaml=reference/mapping/types/percolator/line_40}
19.121s
test {yaml=reference/docs/reindex/line_634}
15.566s
test {yaml=reference/ccr/apis/follow/post-unfollow/line_34}
14.262s
test {yaml=reference/query-dsl/shape-query/line_92}
13.714s
test {yaml=reference/indices/get-field-mapping/line_208}
12.962s
test {yaml=reference/mapping/types/geo-shape/line_320}
11.848s
test {yaml=reference/ccr/apis/follow/post-forget-follower/line_36}
11.663s
test {yaml=reference/mapping/removal_of_types/line_523}
11.528s
test {yaml=reference/indices/rollover-index/line_382}
11.168s
test {yaml=reference/aggregations/bucket/range-aggregation/line_386}
10.781s
test {yaml=reference/search/search-shards/line_142}
10.763s
test {yaml=reference/cat/indices/line_92}
10.694s
test {yaml=reference/mapping/fields/routing-field/line_78}
10.434s
test {yaml=reference/aggregations/metrics/sum-aggregation/line_75}
10.379s
test {yaml=reference/ingest/processors/date-index-name/line_20}
10.229s
test {yaml=reference/sql/endpoints/rest/line_21}
10.038s
test {yaml=reference/aggregations/matrix/stats-aggregation/line_122}
9.866s
test {yaml=reference/search/request/highlighting/line_719}
9.544s
test {yaml=reference/mapping/types/sparse-vector/line_28}
9.456s
test {yaml=painless/painless-guide/painless-walkthrough/line_167}
9.424s
test {yaml=reference/indices/forcemerge/line_10}
9.397s
test {yaml=reference/analysis/tokenfilters/apostrophe-tokenfilter/line_77}
9.349s
test {yaml=reference/mapping/types/geo-shape/line_507}
9.292s
test {yaml=reference/indices/clearcache/line_10}
9.274s
test {yaml=reference/indices/segments/line_124}
9.172s
test {yaml=reference/docs/update-by-query/line_12}
9.136s
test {yaml=reference/indices/synced-flush/line_193}
9.122s
test {yaml=reference/aggregations/metrics/sum-aggregation/line_107}
9.086s
test {yaml=reference/ingest/processors/script/line_50}
9.082s
test {yaml=reference/search/request/highlighting/line_648}
9.060s
test {yaml=reference/indices/shard-stores/line_109}
9.039s
test {yaml=reference/docs/delete-by-query/line_10}
8.951s
test {yaml=reference/indices/segments/line_11}
8.732s
test {yaml=reference/query-dsl/query-string-syntax/line_282}
8.695s
test {yaml=reference/indices/recovery/line_171}
8.639s
test {yaml=reference/cat/recovery/line_96}
8.573s
test {yaml=reference/indices/split-index/line_181}
8.549s
test {yaml=reference/indices/put-mapping/line_415}
8.501s
test {yaml=reference/search/request/inner-hits/line_86}
8.431s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_1690}
8.361s
test {yaml=reference/mapping/params/properties/line_17}
8.300s
test {yaml=reference/aggregations/metrics/max-aggregation/line_51}
8.294s
test {yaml=reference/indices/shard-stores/line_11}
8.061s
test {yaml=reference/aggregations/bucket/composite-aggregation/line_134}
8.005s
test {yaml=reference/ilm/start-stop-ilm/line_56}
7.745s
test {yaml=reference/mapping/types/ip/line_113}
7.730s
test {yaml=reference/search/request/inner-hits/line_207}
7.723s
test {yaml=reference/search/search-template/line_292}
7.650s
test {yaml=reference/search/request/search-after/line_57}
7.478s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_1594}
7.425s
test {yaml=reference/mapping/types/token-count/line_14}
7.410s
test {yaml=reference/aggregations/bucket/daterange-aggregation/line_269}
7.346s
test {yaml=reference/mapping/types/shape/line_420}
7.338s
test {yaml=reference/rollup/rollup-getting-started/line_188}
7.337s
test {yaml=reference/mapping/dynamic-mapping/line_11}
7.321s
test {yaml=reference/api-conventions/line_74}
7.288s
test {yaml=reference/aggregations/pipeline/cumulative-cardinality-aggregation/line_42}
7.218s
test {yaml=reference/mapping/types/object/line_46}
7.209s
test {yaml=reference/search/request/highlighting/line_377}
7.190s
test {yaml=reference/analysis/analyzers/standard-analyzer/line_281}
7.187s
test {yaml=reference/aggregations/bucket/terms-aggregation/line_654}
7.060s
test {yaml=reference/search/request/post-filter/line_63}
7.056s
test {yaml=reference/mapping/types/shape/line_405}
7.024s
test {yaml=reference/mapping/fields/id-field/line_12}
7.020s
test {yaml=reference/docs/index_/line_365}
6.988s
test {yaml=reference/indices/close/line_10}
6.954s
test {yaml=reference/ingest/processors/user-agent/line_27}
6.909s
test {yaml=plugins/mapper-annotated-text/line_265}
6.901s
test {yaml=reference/aggregations/bucket/composite-aggregation/line_405}
6.883s
test {yaml=reference/indices/stats/line_107}
6.848s
test {yaml=reference/mapping/params/coerce/line_60}
6.698s
test {yaml=painless/painless-guide/painless-walkthrough/line_132}
6.628s
test {yaml=reference/index-modules/similarity/line_520}
6.539s
test {yaml=reference/query-dsl/terms-set-query/line_107}
6.508s
test {yaml=reference/analysis/tokenfilters/multiplexer-tokenfilter/line_33}
6.507s
test {yaml=reference/mapping/params/similarity/line_33}
6.501s
test {yaml=reference/aggregations/metrics/median-absolute-deviation-aggregation/line_87}
6.486s
test {yaml=reference/analysis/tokenfilters/classic-tokenfilter/line_132}
6.451s
test {yaml=reference/search/search/line_7}
6.448s
test {yaml=reference/search/request/highlighting/line_869}
6.436s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_1086}
6.382s
test {yaml=reference/scripting/using/line_147}
6.351s
test {yaml=reference/search/search/line_386}
6.322s
test {yaml=reference/ml/anomaly-detection/transforms/line_458}
6.283s
test {yaml=reference/aggregations/pipeline/cumulative-cardinality-aggregation/line_141}
6.271s
test {yaml=reference/search/request/scroll/line_90}
6.261s
test {yaml=reference/query-dsl/function-score-query/line_41}
6.250s
test {yaml=reference/cluster/reroute/line_180}
6.119s
test {yaml=plugins/analysis-icu/line_298}
6.110s
test {yaml=painless/painless-guide/painless-walkthrough/line_330}
6.085s
test {yaml=reference/query-dsl/geo-distance-query/line_77}
6.077s
test {yaml=reference/aggregations/metrics/median-absolute-deviation-aggregation/line_28}
6.064s
test {yaml=reference/aggregations/pipeline/movfn-aggregation/line_42}
6.041s
test {yaml=reference/indices/aliases/line_239}
6.031s
test {yaml=reference/aggregations/bucket/sampler-aggregation/line_19}
5.951s
test {yaml=reference/index-modules/slowlog/line_33}
5.880s
test {yaml=reference/aggregations/metrics/valuecount-aggregation/line_62}
5.877s
test {yaml=reference/aggregations/bucket/rare-terms-aggregation/line_89}
5.861s
test {yaml=reference/search/search-template/line_183}
5.856s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_731}
5.854s
test {yaml=reference/search/request/highlighting/line_790}
5.783s
test {yaml=reference/aggregations/bucket/datehistogram-aggregation/line_201}
5.734s
test {yaml=plugins/analysis-kuromoji/line_219}
5.731s
test {yaml=reference/analysis/tokenizers/uaxurlemail-tokenizer/line_92}
5.713s
test {yaml=plugins/analysis-nori/line_92}
5.649s
test {yaml=reference/how-to/recipes/scoring/line_148}
5.626s
test {yaml=reference/ml/anomaly-detection/apis/delete-filter/line_42}
5.612s
test {yaml=reference/aggregations/pipeline/movfn-aggregation/line_297}
5.604s
test {yaml=reference/search/request/docvalue-fields/line_8}
5.566s
test {yaml=reference/aggregations/metrics/max-aggregation/line_98}
5.552s
test {yaml=reference/analysis/tokenizers/pathhierarchy-tokenizer-examples/line_112}
5.519s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_1743}
5.510s
test {yaml=reference/docs/concurrency-control/line_24}
5.484s
test {yaml=reference/analysis/tokenfilters/synonym-graph-tokenfilter/line_118}
5.459s
test {yaml=reference/analysis/tokenizers/simplepattern-tokenizer/line_38}
5.458s
test {yaml=reference/indices/update-settings/line_95}
5.451s
test {yaml=plugins/analysis-icu/line_350}
5.386s
test {yaml=reference/aggregations/matrix/stats-aggregation/line_39}
5.364s
test {yaml=reference/aggregations/bucket/histogram-aggregation/line_161}
5.353s
test {yaml=reference/mapping/types/search-as-you-type/line_18}
5.350s
test {yaml=plugins/mapper-annotated-text/line_113}
5.303s
test {yaml=reference/aggregations/bucket/datehistogram-aggregation/line_107}
5.303s
test {yaml=reference/ilm/policy-definitions/line_271}
5.236s
test {yaml=reference/aggregations/pipeline/derivative-aggregation/line_230}
5.232s
test {yaml=reference/aggregations/bucket/datehistogram-aggregation/line_290}
5.191s
test {yaml=reference/aggregations/bucket/autodatehistogram-aggregation/line_273}
5.120s
test {yaml=reference/indices/stats/line_135}
5.096s
test {yaml=reference/docs/termvectors/line_171}
5.085s
test {yaml=reference/how-to/search-speed/line_86}
5.050s
test {yaml=reference/indices/get-field-mapping/line_12}
5.017s
test {yaml=painless/painless-contexts/painless-bucket-script-agg-context/line_42}
5.003s
test {yaml=reference/mapping/types/flattened/line_88}
4.997s
test {yaml=reference/search/line_72}
4.960s
test {yaml=reference/query-dsl/span-term-query/line_11}
4.891s
test {yaml=reference/analysis/analyzers/standard-analyzer/line_151}
4.885s
test {yaml=reference/indices/segments/line_106}
4.867s
test {yaml=reference/aggregations/bucket/significanttext-aggregation/line_458}
4.850s
test {yaml=reference/mapping/types/nested/line_80}
4.841s
test {yaml=reference/mapping/types/geo-shape/line_591}
4.798s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_277}
4.797s
test {yaml=reference/aggregations/bucket/missing-aggregation/line_9}
4.782s
test {yaml=reference/aggregations/metrics/percentile-rank-aggregation/line_217}
4.781s
test {yaml=reference/indices/shard-stores/line_99}
4.777s
test {yaml=reference/how-to/recipes/stemming/line_11}
4.766s
test {yaml=painless/painless-guide/painless-debugging/line_20}
4.763s
test {yaml=reference/cat/fielddata/cat-fielddata-example}
4.750s
test {yaml=reference/cluster/stats/line_46}
4.747s
test {yaml=reference/indices/add-alias/line_12}
4.742s
test {yaml=reference/modules/cluster/allocation_filtering/line_60}
4.739s
test {yaml=reference/upgrade/rolling_upgrade/line_93}
4.709s
test {yaml=reference/mapping/types/geo-shape/line_412}
4.703s
test {yaml=reference/how-to/disk-usage/line_54}
4.694s
test {yaml=reference/query-dsl/multi-match-query/line_259}
4.694s
test {yaml=reference/mapping/types/shape/line_161}
4.687s
test {yaml=reference/mapping/fields/routing-field/line_33}
4.648s
test {yaml=reference/analysis/tokenfilters/synonym-graph-tokenfilter/line_23}
4.642s
test {yaml=reference/ilm/apis/slm-api/line_185}
4.635s
test {yaml=reference/aggregations/bucket/terms-aggregation/line_264}
4.617s
test {yaml=reference/aggregations/metrics/extendedstats-aggregation/line_166}
4.612s
test {yaml=reference/search/request/search-after/line_14}
4.576s
test {yaml=reference/query-dsl/intervals-query/line_406}
4.550s
test {yaml=reference/cluster/nodes-stats/line_511}
4.541s
test {yaml=reference/aggregations/bucket/composite-aggregation/line_168}
4.516s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_476}
4.476s
test {yaml=reference/mapping/types/parent-join/line_312}
4.473s
test {yaml=reference/indices/analyze/line_180}
4.466s
test {yaml=reference/analysis/tokenfilters/cjk-width-tokenfilter/line_69}
4.463s
test {yaml=reference/upgrade/close-ml/line_28}
4.444s
test {yaml=reference/transform/ecommerce-tutorial/line_87}
4.423s
test {yaml=reference/mapping/types/geo-shape/line_524}
4.420s
test {yaml=reference/aggregations/metrics/extendedstats-aggregation/line_137}
4.412s
test {yaml=reference/docs/delete-by-query/line_658}
4.411s
test {yaml=reference/search/validate/line_73}
4.400s
test {yaml=reference/mapping/params/dynamic/line_60}
4.386s
test {yaml=plugins/mapper-annotated-text/line_166}
4.382s
test {yaml=reference/mapping/fields/source-field/line_85}
4.376s
test {yaml=plugins/analysis-icu/line_113}
4.375s
test {yaml=reference/mapping/types/binary/line_12}
4.348s
test {yaml=reference/aggregations/metrics/extendedstats-aggregation/line_11}
4.347s
test {yaml=reference/modules/remote-clusters/line_107}
4.317s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_989}
4.314s
test {yaml=reference/ml/df-analytics/apis/evaluate-dfanalytics/line_84}
4.310s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_1353}
4.300s
test {yaml=reference/indices/alias-exists/line_64}
4.298s
test {yaml=reference/query-dsl/bool-query/line_36}
4.283s
test {yaml=reference/monitoring/indices/line_12}
4.280s
test {yaml=reference/mapping/dynamic/templates/line_71}
4.268s
test {yaml=reference/query-dsl/geo-bounding-box-query/line_97}
4.246s
test {yaml=reference/mapping/types/keyword/line_20}
4.239s
test {yaml=reference/query-dsl/geo-polygon-query/line_90}
4.238s
test {yaml=reference/mapping/types/shape/line_292}
4.235s
test {yaml=reference/mapping/types/shape/line_234}
4.228s
test {yaml=reference/docs/multi-get/line_128}
4.210s
test {yaml=reference/search/suggesters/line_51}
4.188s
test {yaml=reference/ml/anomaly-detection/apis/update-filter/line_48}
4.187s
test {yaml=reference/mapping/types/geo-shape/line_337}
4.186s
test {yaml=reference/analysis/tokenizers/edgengram-tokenizer/line_104}
4.160s
test {yaml=reference/docs/termvectors/line_30}
4.151s
test {yaml=painless/painless-contexts/painless-bucket-selector-agg-context/line_47}
4.146s
test {yaml=reference/how-to/disk-usage/line_14}
4.134s
test {yaml=reference/cluster/tasks/line_118}
4.126s
test {yaml=reference/ml/df-analytics/apis/dfanalyticsresources/line_150}
4.076s
test {yaml=reference/query-dsl/geo-bounding-box-query/line_43}
4.065s
test {yaml=reference/analysis/tokenfilters/synonym-tokenfilter/line_109}
4.057s
test {yaml=reference/cluster/nodes-info/line_263}
3.998s
test {yaml=reference/aggregations/metrics/percentile-rank-aggregation/line_121}
3.986s
test {yaml=reference/indices/aliases/line_350}
3.985s
test {yaml=reference/aggregations/bucket/terms-aggregation/line_857}
3.982s
test {yaml=reference/mapping/types/parent-join/line_347}
3.961s
test {yaml=reference/analysis/tokenizers/whitespace-tokenizer/line_11}
3.956s
test {yaml=reference/mapping/types/geo-shape/line_555}
3.917s
test {yaml=reference/query-dsl/rank-feature-query/line_253}
3.917s
test {yaml=reference/mapping/params/norms/line_21}
3.899s
test {yaml=reference/docs/reindex/line_403}
3.891s
test {yaml=reference/analysis/tokenizers/classic-tokenizer/line_145}
3.890s
test {yaml=reference/aggregations/bucket/composite-aggregation/line_186}
3.885s
test {yaml=reference/analysis/tokenfilters/cjk-bigram-tokenfilter/line_176}
3.884s
test {yaml=reference/aggregations/bucket/terms-aggregation/line_600}
3.864s
test {yaml=reference/indices/templates/line_218}
3.858s
test {yaml=reference/analysis/analyzers/whitespace-analyzer/line_128}
3.848s
test {yaml=reference/indices/clearcache/line_141}
3.835s
test {yaml=reference/ml/anomaly-detection/apis/get-category/line_70}
3.831s
test {yaml=reference/ml/anomaly-detection/apis/delete-datafeed/line_46}
3.831s
test {yaml=reference/analysis/analyzers/lang-analyzer/line_325}
3.825s
test {yaml=plugins/analysis-nori/line_330}
3.802s
test {yaml=plugins/analysis-icu/line_220}
3.721s
test {yaml=reference/query-dsl/query-string-query/line_255}
3.686s
test {yaml=reference/ml/anomaly-detection/stopping-ml/line_66}
3.678s
test {yaml=reference/analysis/analyzers/standard-analyzer/line_14}
3.661s
test {yaml=reference/indices/templates/line_166}
3.658s
test {yaml=reference/search/request/stored-fields/line_60}
3.648s
test {yaml=reference/indices/get-field-mapping/line_65}
3.643s
test {yaml=reference/redirects/line_408}
3.632s
test {yaml=reference/query-dsl/mlt-query/line_67}
3.542s
test {yaml=reference/cat/pending_tasks/line_39}
3.464s
test {yaml=reference/ilm/getting-started-slm/line_43}
3.448s
test {yaml=reference/ml/df-analytics/apis/get-dfanalytics/line_93}
3.385s
test {yaml=plugins/repository-gcs/line_136}
3.353s
test {yaml=reference/modules/snapshots/line_152}
3.289s
test {yaml=reference/indices/refresh/line_101}
3.274s
test {yaml=reference/ingest/processors/date-index-name/line_75}
3.258s
test {yaml=reference/ml/anomaly-detection/detector-custom-rules/line_94}
3.234s
test {yaml=reference/ingest/apis/delete-pipeline/line_28}
3.211s
test {yaml=reference/ml/anomaly-detection/transforms/line_385}
3.196s
test {yaml=reference/licensing/start-trial/line_47}
3.167s
test {yaml=reference/ilm/set-up-lifecycle-policy/line_54}
3.109s
test {yaml=reference/mapping/fields/ignored-field/line_33}
3.039s
test {yaml=reference/query-dsl/fuzzy-query/line_29}
3.008s
test {yaml=reference/ilm/apis/get-lifecycle/line_42}
2.969s
test {yaml=plugins/repository-hdfs/line_164}
2.889s
test {yaml=reference/ml/anomaly-detection/apis/get-influencer/line_77}
2.840s
test {yaml=reference/analysis/charfilters/htmlstrip-charfilter/line_12}
2.810s
test {yaml=reference/licensing/delete-license/line_35}
2.808s
test {yaml=reference/indices/analyze/line_195}
2.802s
test {yaml=reference/ingest/ingest-node/line_171}
2.751s
test {yaml=reference/monitoring/collecting-monitoring-data/line_53}
2.692s
test {yaml=reference/ml/anomaly-detection/transforms/line_28}
2.666s
test {yaml=reference/cluster/update-settings/line_65}
2.642s
test {yaml=reference/search/request/sort/line_569}
2.638s
test {yaml=reference/ilm/policy-definitions/line_331}
2.626s
test {yaml=reference/aggregations/bucket/range-aggregation/line_178}
2.605s
test {yaml=reference/ml/anomaly-detection/apis/get-filter/line_70}
2.602s
test {yaml=reference/ml/anomaly-detection/stopping-ml/line_27}
2.600s
test {yaml=reference/ml/anomaly-detection/apis/delete-job/line_79}
2.568s
test {yaml=reference/query-dsl/range-query/line_214}
2.560s
test {yaml=reference/query-dsl/regexp-query/line_23}
2.558s
test {yaml=reference/query-dsl/match-phrase-prefix-query/line_22}
2.556s
test {yaml=reference/query-dsl/query-string-query/line_306}
2.550s
test {yaml=reference/ml/anomaly-detection/apis/get-job-stats/line_86}
2.546s
test {yaml=plugins/repository-s3/line_311}
2.519s
test {yaml=reference/query-dsl/match-query/line_18}
2.512s
test {yaml=reference/rest-api/info/line_45}
2.501s
test {yaml=reference/ingest/apis/enrich/enrich-stats/line_94}
2.500s
test {yaml=reference/ml/anomaly-detection/functions/count/line_241}
2.499s
test {yaml=reference/licensing/get-basic-status/line_36}
2.493s
test {yaml=reference/search/request/stored-fields/line_13}
2.487s
test {yaml=reference/indices/create-index/line_208}
2.487s
test {yaml=reference/query-dsl/range-query/line_152}
2.479s
test {yaml=reference/cat/shards/line_356}
2.454s
test {yaml=reference/transform/ecommerce-tutorial/line_239}
2.445s
test {yaml=reference/analysis/analyzers/simple-analyzer/line_11}
2.425s
test {yaml=reference/analysis/tokenizers/classic-tokenizer/line_22}
2.400s
test {yaml=reference/ml/anomaly-detection/apis/forecast/line_62}
2.400s
test {yaml=reference/modules/discovery/voting/line_31}
2.399s
test {yaml=reference/indices/create-index/line_195}
2.394s
test {yaml=reference/search/request/named-queries-and-filters/line_7}
2.388s
test {yaml=reference/indices/forcemerge/line_149}
2.376s
test {yaml=reference/ml/anomaly-detection/apis/delete-calendar-job/line_40}
2.372s
test {yaml=plugins/repository-hdfs/line_147}
2.367s
test {yaml=reference/search/request/from-size/line_14}
2.363s
test {yaml=reference/cluster/stats/line_276}
2.357s
test {yaml=reference/aggregations/pipeline/line_54}
2.350s
test {yaml=reference/ilm/apis/slm-api/line_476}
2.345s
test {yaml=reference/transform/apis/start-transform/line_63}
2.339s
test {yaml=reference/analysis/tokenfilters/cjk-bigram-tokenfilter/line_22}
2.329s
test {yaml=reference/transform/ecommerce-tutorial/line_163}
2.323s
test {yaml=reference/query-dsl/query-string-query/line_436}
2.323s
test {yaml=reference/docs/termvectors/line_425}
2.313s
test {yaml=reference/query-dsl/constant-score-query/line_12}
2.300s
test {yaml=reference/ingest/processors/grok/line_283}
2.298s
test {yaml=reference/analysis/tokenizers/lowercase-tokenizer/line_18}
2.293s
test {yaml=reference/ml/anomaly-detection/apis/put-filter/line_53}
2.265s
test {yaml=reference/docs/get/line_299}
2.254s
test {yaml=plugins/repository-s3/line_25}
2.250s
test {yaml=reference/mapping/fields/ignored-field/line_18}
2.249s
test {yaml=reference/analysis/tokenizers/pattern-tokenizer/line_29}
2.248s
test {yaml=reference/indices/analyze/line_140}
2.241s
test {yaml=reference/ml/anomaly-detection/categories/line_155}
2.226s
test {yaml=reference/ml/anomaly-detection/transforms/line_161}
2.219s
test {yaml=reference/query-dsl/boosting-query/line_18}
2.209s
test {yaml=reference/ml/anomaly-detection/apis/put-calendar/line_45}
2.208s
test {yaml=reference/query-dsl/query-string-query/line_271}
2.185s
test {yaml=reference/upgrade/rolling_upgrade/line_124}
2.084s
test {yaml=reference/search/field-caps/line_147}
2.083s
test {yaml=reference/query-dsl/simple-query-string-query/line_24}
2.058s
test {yaml=reference/docs/delete-by-query/line_584}
2.054s
test {yaml=reference/ml/anomaly-detection/apis/post-calendar-event/line_64}
1.934s
test {yaml=reference/query-dsl/span-term-query/line_35}
1.869s

The timings above came from https://gradle-enterprise.elastic.co/s/a5numqgusxnou/tests/byProject?toggled=W1syXSxbMiwwXSxbMiwwLDBdLFsyLDAsMCwwXSxbMiwwLDAsMCwyXV0

[elasticmachine]

Pinging @elastic/es-core-infra (:Core/Infra/Build)

[alpar-t]

There's no way 2 workers produce a load that would explain these times, maybe some faulty hardware ?

[alpar-t]

It seems that the yml tests are overlapping with server integ test that also run on parallel, so we do produce quite a bit of load even with 2 workers.
Will try to disable running in parallel for these jobs until we have a better way to limit the maximum amount of parallelism.

[alpar-t]

We have two successful builds : https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+multijob-darwin-compatibility/338/