Implement fail-fast tests ordering for JUnit 5 #8055

nikita-tkachenko-datadog · 2024-12-04T12:48:32Z

What Does This Do

Implements tests reordering for JUnit 5.
If DD_CIVISIBILITY_TEST_ORDER=failfast environment variable is set, new tests and flaky tests will be executed before others.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Squash your commits prior merging or merge using GitHub's Squash and merge
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SDTEST-986

pr-commenter · 2024-12-04T13:28:59Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/junit5-tests-ordering
git_commit_date	1733317832	1733329614
git_commit_sha	`5b58772`	`a27c34e`
release_version	1.44.0-SNAPSHOT~5b587720dd	1.44.0-SNAPSHOT~a27c34e913

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1733332012	1733332012
ci_job_id	727080358	727080358
ci_pipeline_id	50342727	50342727
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.097 s) : 0, 1097276
Total [baseline] (10.446 s) : 0, 10446095
Agent [candidate] (1.096 s) : 0, 1095745
Total [candidate] (10.437 s) : 0, 10436539
section appsec
Agent [baseline] (1.231 s) : 0, 1231176
Total [baseline] (10.789 s) : 0, 10789173
Agent [candidate] (1.225 s) : 0, 1224545
Total [candidate] (10.771 s) : 0, 10770826
section iast
Agent [baseline] (1.227 s) : 0, 1226569
Total [baseline] (10.907 s) : 0, 10906752
Agent [candidate] (1.222 s) : 0, 1221849
Total [candidate] (10.945 s) : 0, 10945162
section profiling
Agent [baseline] (1.322 s) : 0, 1322179
Total [baseline] (10.864 s) : 0, 10864283
Agent [candidate] (1.317 s) : 0, 1316558
Total [candidate] (10.784 s) : 0, 10784012

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.097 s	-
Agent	appsec	1.231 s	133.9 ms (12.2%)
Agent	iast	1.227 s	129.293 ms (11.8%)
Agent	profiling	1.322 s	224.903 ms (20.5%)
Total	tracing	10.446 s	-
Total	appsec	10.789 s	343.077 ms (3.3%)
Total	iast	10.907 s	460.657 ms (4.4%)
Total	profiling	10.864 s	418.188 ms (4.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.096 s	-
Agent	appsec	1.225 s	128.8 ms (11.8%)
Agent	iast	1.222 s	126.104 ms (11.5%)
Agent	profiling	1.317 s	220.813 ms (20.2%)
Total	tracing	10.437 s	-
Total	appsec	10.771 s	334.287 ms (3.2%)
Total	iast	10.945 s	508.623 ms (4.9%)
Total	profiling	10.784 s	347.473 ms (3.3%)

gantt
    title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (695.325 ms) : 0, 695325
BytebuddyAgent [candidate] (697.213 ms) : 0, 697213
GlobalTracer [baseline] (318.824 ms) : 0, 318824
GlobalTracer [candidate] (319.753 ms) : 0, 319753
AppSec [baseline] (55.171 ms) : 0, 55171
AppSec [candidate] (55.259 ms) : 0, 55259
Remote Config [baseline] (699.473 µs) : 0, 699
Remote Config [candidate] (683.218 µs) : 0, 683
Telemetry [baseline] (13.521 ms) : 0, 13521
Telemetry [candidate] (9.11 ms) : 0, 9110
section appsec
BytebuddyAgent [baseline] (714.573 ms) : 0, 714573
BytebuddyAgent [candidate] (710.228 ms) : 0, 710228
GlobalTracer [baseline] (315.669 ms) : 0, 315669
GlobalTracer [candidate] (314.481 ms) : 0, 314481
AppSec [baseline] (168.098 ms) : 0, 168098
AppSec [candidate] (167.79 ms) : 0, 167790
Remote Config [baseline] (1.062 ms) : 0, 1062
Remote Config [candidate] (637.622 µs) : 0, 638
Telemetry [baseline] (8.265 ms) : 0, 8265
Telemetry [candidate] (8.189 ms) : 0, 8189
IAST [baseline] (19.498 ms) : 0, 19498
IAST [candidate] (19.06 ms) : 0, 19060
section iast
BytebuddyAgent [baseline] (817.212 ms) : 0, 817212
BytebuddyAgent [candidate] (813.684 ms) : 0, 813684
GlobalTracer [baseline] (308.014 ms) : 0, 308014
GlobalTracer [candidate] (307.122 ms) : 0, 307122
AppSec [baseline] (58.114 ms) : 0, 58114
AppSec [candidate] (58.239 ms) : 0, 58239
Remote Config [baseline] (630.681 µs) : 0, 631
Remote Config [candidate] (626.538 µs) : 0, 627
Telemetry [baseline] (7.625 ms) : 0, 7625
Telemetry [candidate] (7.512 ms) : 0, 7512
IAST [baseline] (21.024 ms) : 0, 21024
IAST [candidate] (20.907 ms) : 0, 20907
section profiling
BytebuddyAgent [baseline] (693.221 ms) : 0, 693221
BytebuddyAgent [candidate] (687.961 ms) : 0, 687961
GlobalTracer [baseline] (434.81 ms) : 0, 434810
GlobalTracer [candidate] (434.465 ms) : 0, 434465
AppSec [baseline] (53.188 ms) : 0, 53188
AppSec [candidate] (53.741 ms) : 0, 53741
Remote Config [baseline] (661.354 µs) : 0, 661
Remote Config [candidate] (650.016 µs) : 0, 650
Telemetry [baseline] (7.707 ms) : 0, 7707
Telemetry [candidate] (7.736 ms) : 0, 7736
ProfilingAgent [baseline] (93.221 ms) : 0, 93221
ProfilingAgent [candidate] (92.945 ms) : 0, 92945
Profiling [baseline] (93.244 ms) : 0, 93244
Profiling [candidate] (92.968 ms) : 0, 92968

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.095 s) : 0, 1095408
Total [baseline] (8.687 s) : 0, 8687048
Agent [candidate] (1.09 s) : 0, 1089980
Total [candidate] (8.643 s) : 0, 8643282
section iast
Agent [baseline] (1.222 s) : 0, 1221505
Total [baseline] (9.237 s) : 0, 9236733
Agent [candidate] (1.22 s) : 0, 1219610
Total [candidate] (9.196 s) : 0, 9196208
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.223 s) : 0, 1222947
Total [baseline] (9.187 s) : 0, 9187029
Agent [candidate] (1.22 s) : 0, 1219914
Total [candidate] (9.189 s) : 0, 9189482
section iast_TELEMETRY_OFF
Agent [baseline] (1.216 s) : 0, 1216267
Total [baseline] (9.177 s) : 0, 9176605
Agent [candidate] (1.216 s) : 0, 1215713
Total [candidate] (9.18 s) : 0, 9180139

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.095 s	-
Agent	iast	1.222 s	126.097 ms (11.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.223 s	127.539 ms (11.6%)
Agent	iast_TELEMETRY_OFF	1.216 s	120.859 ms (11.0%)
Total	tracing	8.687 s	-
Total	iast	9.237 s	549.684 ms (6.3%)
Total	iast_HARDCODED_SECRET_DISABLED	9.187 s	499.98 ms (5.8%)
Total	iast_TELEMETRY_OFF	9.177 s	489.557 ms (5.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.09 s	-
Agent	iast	1.22 s	129.63 ms (11.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.22 s	129.934 ms (11.9%)
Agent	iast_TELEMETRY_OFF	1.216 s	125.733 ms (11.5%)
Total	tracing	8.643 s	-
Total	iast	9.196 s	552.925 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.189 s	546.199 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.18 s	536.857 ms (6.2%)

gantt
    title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.226 ms) : 0, 696226
BytebuddyAgent [candidate] (693.581 ms) : 0, 693581
GlobalTracer [baseline] (318.956 ms) : 0, 318956
GlobalTracer [candidate] (317.617 ms) : 0, 317617
AppSec [baseline] (55.205 ms) : 0, 55205
AppSec [candidate] (54.531 ms) : 0, 54531
Remote Config [baseline] (685.902 µs) : 0, 686
Remote Config [candidate] (687.118 µs) : 0, 687
Telemetry [baseline] (10.616 ms) : 0, 10616
Telemetry [candidate] (9.831 ms) : 0, 9831
section iast
BytebuddyAgent [baseline] (813.606 ms) : 0, 813606
BytebuddyAgent [candidate] (812.644 ms) : 0, 812644
GlobalTracer [baseline] (306.694 ms) : 0, 306694
GlobalTracer [candidate] (306.673 ms) : 0, 306673
AppSec [baseline] (55.761 ms) : 0, 55761
AppSec [candidate] (57.601 ms) : 0, 57601
IAST [baseline] (23.481 ms) : 0, 23481
IAST [candidate] (20.847 ms) : 0, 20847
Remote Config [baseline] (638.518 µs) : 0, 639
Remote Config [candidate] (652.553 µs) : 0, 653
Telemetry [baseline] (7.583 ms) : 0, 7583
Telemetry [candidate] (7.463 ms) : 0, 7463
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (815.463 ms) : 0, 815463
BytebuddyAgent [candidate] (812.491 ms) : 0, 812491
GlobalTracer [baseline] (306.368 ms) : 0, 306368
GlobalTracer [candidate] (306.573 ms) : 0, 306573
AppSec [baseline] (57.539 ms) : 0, 57539
AppSec [candidate] (57.833 ms) : 0, 57833
IAST [baseline] (21.664 ms) : 0, 21664
IAST [candidate] (21.078 ms) : 0, 21078
Remote Config [baseline] (626.788 µs) : 0, 627
Remote Config [candidate] (623.772 µs) : 0, 624
Telemetry [baseline] (7.51 ms) : 0, 7510
Telemetry [candidate] (7.531 ms) : 0, 7531
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (809.358 ms) : 0, 809358
BytebuddyAgent [candidate] (809.348 ms) : 0, 809348
GlobalTracer [baseline] (306.4 ms) : 0, 306400
GlobalTracer [candidate] (306.265 ms) : 0, 306265
AppSec [baseline] (57.431 ms) : 0, 57431
AppSec [candidate] (57.737 ms) : 0, 57737
IAST [baseline] (21.237 ms) : 0, 21237
IAST [candidate] (20.577 ms) : 0, 20577
Remote Config [baseline] (618.021 µs) : 0, 618
Remote Config [candidate] (628.929 µs) : 0, 629
Telemetry [baseline] (7.424 ms) : 0, 7424
Telemetry [candidate] (7.39 ms) : 0, 7390

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-12-04T16:36:58	2024-12-04T16:43:58
git_branch	master	nikita-tkachenko/junit5-tests-ordering
git_commit_date	1733317832	1733329614
git_commit_sha	`5b58772`	`a27c34e`
release_version	1.44.0-SNAPSHOT~5b587720dd	1.44.0-SNAPSHOT~a27c34e913
start_time	2024-12-04T16:36:45	2024-12-04T16:43:45

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1733330992	1733330992
ci_job_id	727080359	727080359
ci_pipeline_id	50342727	50342727
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.326 µs) : 352, 391
.   : milestone, 371,
iast (486.223 µs) : 465, 507
.   : milestone, 486,
iast_FULL (647.952 µs) : 626, 669
.   : milestone, 648,
iast_GLOBAL (511.39 µs) : 490, 533
.   : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (495.769 µs) : 474, 518
.   : milestone, 496,
iast_INACTIVE (453.172 µs) : 431, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (480.218 µs) : 458, 502
.   : milestone, 480,
tracing (450.063 µs) : 429, 471
.   : milestone, 450,
section candidate
no_agent (372.352 µs) : 352, 393
.   : milestone, 372,
iast (489.699 µs) : 468, 511
.   : milestone, 490,
iast_FULL (653.404 µs) : 632, 675
.   : milestone, 653,
iast_GLOBAL (523.023 µs) : 500, 546
.   : milestone, 523,
iast_HARDCODED_SECRET_DISABLED (492.615 µs) : 471, 514
.   : milestone, 493,
iast_INACTIVE (456.8 µs) : 435, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (484.625 µs) : 462, 507
.   : milestone, 485,
tracing (451.304 µs) : 430, 472
.   : milestone, 451,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	371.326 µs [351.524 µs, 391.129 µs]	-
iast	486.223 µs [465.038 µs, 507.409 µs]	114.897 µs (30.9%)
iast_FULL	647.952 µs [626.493 µs, 669.412 µs]	276.626 µs (74.5%)
iast_GLOBAL	511.39 µs [490.13 µs, 532.65 µs]	140.063 µs (37.7%)
iast_HARDCODED_SECRET_DISABLED	495.769 µs [473.698 µs, 517.841 µs]	124.443 µs (33.5%)
iast_INACTIVE	453.172 µs [431.313 µs, 475.03 µs]	81.845 µs (22.0%)
iast_TELEMETRY_OFF	480.218 µs [458.23 µs, 502.206 µs]	108.892 µs (29.3%)
tracing	450.063 µs [428.636 µs, 471.49 µs]	78.736 µs (21.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	372.352 µs [351.681 µs, 393.023 µs]	-
iast	489.699 µs [468.386 µs, 511.012 µs]	117.347 µs (31.5%)
iast_FULL	653.404 µs [631.739 µs, 675.069 µs]	281.052 µs (75.5%)
iast_GLOBAL	523.023 µs [500.003 µs, 546.044 µs]	150.671 µs (40.5%)
iast_HARDCODED_SECRET_DISABLED	492.615 µs [470.97 µs, 514.26 µs]	120.262 µs (32.3%)
iast_INACTIVE	456.8 µs [434.949 µs, 478.651 µs]	84.448 µs (22.7%)
iast_TELEMETRY_OFF	484.625 µs [462.281 µs, 506.97 µs]	112.273 µs (30.2%)
tracing	451.304 µs [430.3 µs, 472.307 µs]	78.952 µs (21.2%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.367 ms) : 1346, 1387
.   : milestone, 1367,
appsec (1.75 ms) : 1724, 1775
.   : milestone, 1750,
appsec_no_iast (1.758 ms) : 1733, 1783
.   : milestone, 1758,
iast (1.506 ms) : 1483, 1529
.   : milestone, 1506,
profiling (1.551 ms) : 1526, 1576
.   : milestone, 1551,
tracing (1.5 ms) : 1476, 1525
.   : milestone, 1500,
section candidate
no_agent (1.354 ms) : 1334, 1374
.   : milestone, 1354,
appsec (1.754 ms) : 1729, 1778
.   : milestone, 1754,
appsec_no_iast (1.735 ms) : 1711, 1760
.   : milestone, 1735,
iast (1.486 ms) : 1463, 1509
.   : milestone, 1486,
profiling (1.518 ms) : 1493, 1543
.   : milestone, 1518,
tracing (1.498 ms) : 1472, 1523
.   : milestone, 1498,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.367 ms [1.346 ms, 1.387 ms]	-
appsec	1.75 ms [1.724 ms, 1.775 ms]	383.186 µs (28.0%)
appsec_no_iast	1.758 ms [1.733 ms, 1.783 ms]	391.331 µs (28.6%)
iast	1.506 ms [1.483 ms, 1.529 ms]	139.396 µs (10.2%)
profiling	1.551 ms [1.526 ms, 1.576 ms]	184.314 µs (13.5%)
tracing	1.5 ms [1.476 ms, 1.525 ms]	133.452 µs (9.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.334 ms, 1.374 ms]	-
appsec	1.754 ms [1.729 ms, 1.778 ms]	399.241 µs (29.5%)
appsec_no_iast	1.735 ms [1.711 ms, 1.76 ms]	381.088 µs (28.1%)
iast	1.486 ms [1.463 ms, 1.509 ms]	131.361 µs (9.7%)
profiling	1.518 ms [1.493 ms, 1.543 ms]	163.725 µs (12.1%)
tracing	1.498 ms [1.472 ms, 1.523 ms]	143.595 µs (10.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/junit5-tests-ordering
git_commit_date	1733317832	1733329614
git_commit_sha	`5b58772`	`a27c34e`
release_version	1.44.0-SNAPSHOT~5b587720dd	1.44.0-SNAPSHOT~a27c34e913

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1733331688	1733331688
ci_job_id	727080360	727080360
ci_pipeline_id	50342727	50342727
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.89 s) : 14890000, 14890000
.   : milestone, 14890000,
appsec (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
iast (18.898 s) : 18898000, 18898000
.   : milestone, 18898000,
iast_GLOBAL (17.82 s) : 17820000, 17820000
.   : milestone, 17820000,
profiling (15.12 s) : 15120000, 15120000
.   : milestone, 15120000,
tracing (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
section candidate
no_agent (15.594 s) : 15594000, 15594000
.   : milestone, 15594000,
appsec (15.141 s) : 15141000, 15141000
.   : milestone, 15141000,
iast (18.532 s) : 18532000, 18532000
.   : milestone, 18532000,
iast_GLOBAL (17.787 s) : 17787000, 17787000
.   : milestone, 17787000,
profiling (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
tracing (15.056 s) : 15056000, 15056000
.   : milestone, 15056000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.89 s [14.89 s, 14.89 s]	-
appsec	15.051 s [15.051 s, 15.051 s]	161.0 ms (1.1%)
iast	18.898 s [18.898 s, 18.898 s]	4.008 s (26.9%)
iast_GLOBAL	17.82 s [17.82 s, 17.82 s]	2.93 s (19.7%)
profiling	15.12 s [15.12 s, 15.12 s]	230.0 ms (1.5%)
tracing	15.01 s [15.01 s, 15.01 s]	120.0 ms (0.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.594 s [15.594 s, 15.594 s]	-
appsec	15.141 s [15.141 s, 15.141 s]	-453.0 ms (-2.9%)
iast	18.532 s [18.532 s, 18.532 s]	2.938 s (18.8%)
iast_GLOBAL	17.787 s [17.787 s, 17.787 s]	2.193 s (14.1%)
profiling	15.004 s [15.004 s, 15.004 s]	-590.0 ms (-3.8%)
tracing	15.056 s [15.056 s, 15.056 s]	-538.0 ms (-3.5%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~a27c34e913, baseline=1.44.0-SNAPSHOT~5b587720dd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.338 ms) : 2296, 2379
.   : milestone, 2338,
iast (2.083 ms) : 2030, 2136
.   : milestone, 2083,
iast_GLOBAL (2.131 ms) : 2078, 2184
.   : milestone, 2131,
profiling (1.952 ms) : 1909, 1995
.   : milestone, 1952,
tracing (1.924 ms) : 1883, 1964
.   : milestone, 1924,
section candidate
no_agent (1.462 ms) : 1451, 1473
.   : milestone, 1462,
appsec (2.342 ms) : 2300, 2383
.   : milestone, 2342,
iast (2.078 ms) : 2026, 2131
.   : milestone, 2078,
iast_GLOBAL (2.128 ms) : 2075, 2182
.   : milestone, 2128,
profiling (1.951 ms) : 1908, 1994
.   : milestone, 1951,
tracing (1.925 ms) : 1885, 1966
.   : milestone, 1925,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.464 ms [1.453 ms, 1.476 ms]	-
appsec	2.338 ms [2.296 ms, 2.379 ms]	873.342 µs (59.6%)
iast	2.083 ms [2.03 ms, 2.136 ms]	618.952 µs (42.3%)
iast_GLOBAL	2.131 ms [2.078 ms, 2.184 ms]	666.806 µs (45.5%)
profiling	1.952 ms [1.909 ms, 1.995 ms]	487.986 µs (33.3%)
tracing	1.924 ms [1.883 ms, 1.964 ms]	459.54 µs (31.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.462 ms [1.451 ms, 1.473 ms]	-
appsec	2.342 ms [2.3 ms, 2.383 ms]	879.616 µs (60.2%)
iast	2.078 ms [2.026 ms, 2.131 ms]	616.332 µs (42.2%)
iast_GLOBAL	2.128 ms [2.075 ms, 2.182 ms]	666.371 µs (45.6%)
profiling	1.951 ms [1.908 ms, 1.994 ms]	489.174 µs (33.5%)
tracing	1.925 ms [1.885 ms, 1.966 ms]	463.349 µs (31.7%)

daniel-mohedano · 2024-12-05T09:03:56Z

...junit-5.8/src/main/java/datadog/trace/instrumentation/junit5/order/FailFastClassOrderer.java

+    }
+    if (testDescriptor.isTest() || JUnitPlatformUtils.isParameterizedTest(testDescriptor)) {
+      TestIdentifier testIdentifier = JUnitPlatformUtils.toTestIdentifier(testDescriptor);
+      return testEventsHandler.isNew(testIdentifier) || testEventsHandler.isFlaky(testIdentifier)


Would it make sense to introduce some sort of priority/weight difference between new tests and flaky tests?

That's an interesting thought, perhaps even more useful would be adding weights based on a test's flakiness rate. For now I'd keep it simple though

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.google.api.grpc:proto-google-common-protos](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.49.0` -> `2.50.0` | | [com.google.cloud:google-cloud-core-http](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.48.0` -> `2.49.0` | | [com.google.cloud:google-cloud-spanner](https://github.com/googleapis/java-spanner) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `6.82.0` -> `6.83.0` | | [com.google.cloud:google-cloud-logging](https://github.com/googleapis/java-logging) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.20.7` -> `3.21.0` | | [com.google.cloud:google-cloud-datastore](https://github.com/googleapis/java-datastore) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.24.3` -> `2.25.1` | | [com.google.cloud:google-cloud-core](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.48.0` -> `2.49.0` | | [com.google.api:gax](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.58.0` -> `2.59.0` | | [com.autonomousapps.dependency-analysis](https://github.com/autonomousapps/dependency-analysis-android-gradle-plugin) | plugin | misk/gradle/libs.versions.toml | gradle | patch | `2.6.0` -> `2.6.1` | | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.43.0` -> `1.44.1` | | [com.datadoghq:dd-trace-ot](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.43.0` -> `1.44.1` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.29.32` -> `2.29.34` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.29.32` -> `2.29.34` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.29.32` -> `2.29.34` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.29.32` -> `2.29.34` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.29.32` -> `2.29.34` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.29.32` -> `2.29.34` | | [com.amazonaws:aws-java-sdk-sqs](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.779` -> `1.12.780` | | [com.amazonaws:aws-java-sdk-s3](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.779` -> `1.12.780` | | [com.amazonaws:aws-java-sdk-dynamodb](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.779` -> `1.12.780` | | [com.amazonaws:aws-java-sdk-core](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.779` -> `1.12.780` | --- ### Release Notes <details> <summary>googleapis/sdk-platform-java (com.google.api.grpc:proto-google-common-protos)</summary> ### [`v2.50.0`](https://github.com/googleapis/sdk-platform-java/blob/HEAD/CHANGELOG.md#2500-2024-11-14) ##### Features - Add experimental S2A integration in client libraries grpc transport ([#3326](googleapis/sdk-platform-java#3326)) ([1138ca6](googleapis/sdk-platform-java@1138ca6)) - enable selective generation based on service config include list ([#3323](googleapis/sdk-platform-java#3323)) ([0cddadb](googleapis/sdk-platform-java@0cddadb)) - introduce `java.time` to java-core ([#3330](googleapis/sdk-platform-java#3330)) ([f202c3b](googleapis/sdk-platform-java@f202c3b)) - Update Gapic-Generator to generate libraries using `java.time` methods ([#3321](googleapis/sdk-platform-java#3321)) ([b21c9a4](googleapis/sdk-platform-java@b21c9a4)) ##### Bug Fixes - Fix flaky test ScheduledRetryingExecutorTest.testCancelOuterFutureAfterStart ([#3335](googleapis/sdk-platform-java#3335)) ([e73740d](googleapis/sdk-platform-java@e73740d)) - httpjson callables to trace attempts (started, failed) ([#3300](googleapis/sdk-platform-java#3300)) ([15a64ee](googleapis/sdk-platform-java@15a64ee)) - instantiate GaxProperties at build time to ensure we get the protobuf version ([#3365](googleapis/sdk-platform-java#3365)) ([bb2a3be](googleapis/sdk-platform-java@bb2a3be)) - protobuf version not always getting set in headers ([#3322](googleapis/sdk-platform-java#3322)) ([7f6e470](googleapis/sdk-platform-java@7f6e470)) - use BuildKit instead of legacy builder to build the Hermetic Build images ([#3338](googleapis/sdk-platform-java#3338)) ([222fb45](googleapis/sdk-platform-java@222fb45)) ##### Dependencies - update google auth library dependencies to v1.30.0 ([#3367](googleapis/sdk-platform-java#3367)) ([a31c682](googleapis/sdk-platform-java@a31c682)) - update grpc dependencies to v1.68.1 ([#3240](googleapis/sdk-platform-java#3240)) ([c8e3941](googleapis/sdk-platform-java@c8e3941)) ##### Documentation - fix list num ([#3356](googleapis/sdk-platform-java#3356)) ([b7d6296](googleapis/sdk-platform-java@b7d6296)) - **hermetic-build:** indicate usage of Docker Buildkit in development guide ([#3337](googleapis/sdk-platform-java#3337)) ([01e742d](googleapis/sdk-platform-java@01e742d)) - modify hermetic build docs ([#3331](googleapis/sdk-platform-java#3331)) ([25023af](googleapis/sdk-platform-java@25023af)) </details> <details> <summary>googleapis/java-spanner (com.google.cloud:google-cloud-spanner)</summary> ### [`v6.83.0`](https://github.com/googleapis/java-spanner/blob/HEAD/CHANGELOG.md#6830-2024-12-13) ##### Features - Add Metrics host for built in metrics ([#3519](googleapis/java-spanner#3519)) ([4ed455a](googleapis/java-spanner@4ed455a)) - Add opt-in for using multiplexed sessions for blind writes ([#3540](googleapis/java-spanner#3540)) ([216f53e](googleapis/java-spanner@216f53e)) - Add UUID in Spanner TypeCode enum ([41f83dc](googleapis/java-spanner@41f83dc)) - Introduce java.time variables and methods ([#3495](googleapis/java-spanner#3495)) ([8a7d533](googleapis/java-spanner@8a7d533)) - **spanner:** Support multiplexed session for Partitioned operations ([#3231](googleapis/java-spanner#3231)) ([4501a3e](googleapis/java-spanner@4501a3e)) - Support 'set local' for retry_aborts_internally ([#3532](googleapis/java-spanner#3532)) ([331942f](googleapis/java-spanner@331942f)) ##### Bug Fixes - **deps:** Update the Java code generator (gapic-generator-java) to 2.51.0 ([41f83dc](googleapis/java-spanner@41f83dc)) ##### Dependencies - Update sdk platform java dependencies ([#3549](googleapis/java-spanner#3549)) ([6235f0f](googleapis/java-spanner@6235f0f)) </details> <details> <summary>googleapis/java-logging (com.google.cloud:google-cloud-logging)</summary> ### [`v3.21.0`](https://github.com/googleapis/java-logging/blob/HEAD/CHANGELOG.md#3210-2024-12-13) ##### Features - Introduce `java.time` methods ([#1729](googleapis/java-logging#1729)) ([323eb33](googleapis/java-logging@323eb33)) ##### Bug Fixes - **deps:** Update the Java code generator (gapic-generator-java) to 2.51.0 ([04d8868](googleapis/java-logging@04d8868)) ##### Dependencies - Update dependency io.opentelemetry:opentelemetry-bom to v1.45.0 ([#1638](googleapis/java-logging#1638)) ([7e007d4](googleapis/java-logging@7e007d4)) - Update sdk platform java dependencies ([#1736](googleapis/java-logging#1736)) ([88b4cdf](googleapis/java-logging@88b4cdf)) </details> <details> <summary>googleapis/java-datastore (com.google.cloud:google-cloud-datastore)</summary> ### [`v2.25.1`](https://github.com/googleapis/java-datastore/blob/HEAD/CHANGELOG.md#2251-2024-12-13) ##### Bug Fixes - **deps:** Update the Java code generator (gapic-generator-java) to 2.51.0 ([106ee4d](googleapis/java-datastore@106ee4d)) ##### Dependencies - Update sdk platform java dependencies ([#1685](googleapis/java-datastore#1685)) ([4372350](googleapis/java-datastore@4372350)) ### [`v2.25.0`](https://github.com/googleapis/java-datastore/blob/HEAD/CHANGELOG.md#2250-2024-12-11) ##### Features - Introduce `java.time` methods and variables ([#1671](googleapis/java-datastore#1671)) ([5a78a80](googleapis/java-datastore@5a78a80)) ##### Dependencies - Update dependency com.google.cloud:gapic-libraries-bom to v1.48.0 ([#1605](googleapis/java-datastore#1605)) ([5c6a678](googleapis/java-datastore@5c6a678)) ##### Documentation - Update gapic upgrade installation instructions ([#1677](googleapis/java-datastore#1677)) ([b3fbfcc](googleapis/java-datastore@b3fbfcc)) </details> <details> <summary>autonomousapps/dependency-analysis-android-gradle-plugin (com.autonomousapps.dependency-analysis)</summary> ### [`v2.6.1`](https://github.com/autonomousapps/dependency-analysis-android-gradle-plugin/blob/HEAD/CHANGELOG.md#Version-261) - \[Fix]: `superClassName` can be null (Object has no superclass). </details> <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.44.1`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.44.1): 1.44.1 ##### Components ##### Continuous Integration Visibility - 🐛 Fix tracing JUnit5 tests in Maven projects with multiple forks ([#8089](DataDog/dd-trace-java#8089) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) ### [`v1.44.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.44.0): 1.44.0 ##### Known Issues > \[!WARNING]\ > This release contains a known issue that causes failures when using Test Optimization to trace JUnit 5 tests in a Maven project where Maven Surefire is configured with `forkCount` > 1. > The issue is fixed in v1.44.1 ##### Breaking Changes > \[!WARNING]\ > Support for `X-Forwarded` header is dropped from default client IP resolution. > It can still be re-activated using the `dd.trace.client-ip-header=x-forwarded` system property, or the `DD_TRACE_CLIENT_IP_HEADER=x-forwarded` environment variable. See [#7946](DataDog/dd-trace-java#7946). ##### Components ##### Application Security Management (IAST) - ✨ Set unexpected IAST exceptions to debug log level ([#8044](DataDog/dd-trace-java#8044) - [@smola](https://github.com/smola)) - ✨ Increase IAST propagation to StringBuffer subSequence ([#8038](DataDog/dd-trace-java#8038) - [@Mariovido](https://github.com/Mariovido)) - ✨ Increase IAST propagation to StringBuilder subSequence ([#8026](DataDog/dd-trace-java#8026) - [@Mariovido](https://github.com/Mariovido)) - ✨ Add IAST propagation to String valueOf ([#8013](DataDog/dd-trace-java#8013) - [@Mariovido](https://github.com/Mariovido)) - ✨ Increase IAST propagation to StringBuilder append ([#8010](DataDog/dd-trace-java#8010) - [@Mariovido](https://github.com/Mariovido)) - ✨ Expand SSRF support in IAST to apache-httpclient-5 and apache-httpasyncclient-4 ([#7920](DataDog/dd-trace-java#7920) - [@Mariovido](https://github.com/Mariovido)) ##### Build & Tooling - ✨ Generate Muzzle classes for Groovy instrumentations ([#8004](DataDog/dd-trace-java#8004) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) ##### Continuous Integration Visibility - ✨ Support distributed traces in tests ([#8078](DataDog/dd-trace-java#8078) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Implement fail-fast tests ordering for JUnit 5 ([#8055](DataDog/dd-trace-java#8055) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Mark JUnit 5 setup and teardown action spans as failed if there is an error ([#8033](DataDog/dd-trace-java#8033) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add tracing of setup and teardown actions in JUnit 4 ([#8030](DataDog/dd-trace-java#8030) - [@daniel-mohedano](https://github.com/daniel-mohedano)) ##### Crash tracking - ✨ Improve crash tracking install logging ([#8045](DataDog/dd-trace-java#8045) - [@PerfectSlayer](https://github.com/PerfectSlayer)) ##### Data Streams Monitoring - 🐛 Add Data Streams support in AWS SQS without raw message delivery ([#8071](DataDog/dd-trace-java#8071) - [@piochelepiotr](https://github.com/piochelepiotr)) - ✨ Add new tag for enabled products / features to DSM checkpoints ([#8051](DataDog/dd-trace-java#8051) - [@kr-igor](https://github.com/kr-igor)) - 💡 Instrument self hosted Kafka connectors ([#7959](DataDog/dd-trace-java#7959) - [@piochelepiotr](https://github.com/piochelepiotr)) ##### Dynamic Instrumentation - ✨ Add Micronaut 4 support for code origin for spans ([#8039](DataDog/dd-trace-java#8039) - [@jpbempel](https://github.com/jpbempel)) - ✨ Refactor probe matching for methods ([#8021](DataDog/dd-trace-java#8021) - [@jpbempel](https://github.com/jpbempel)) - ✨ Update the CodeOriginProbe fingerprint to not rely on a stack walk ([#8016](DataDog/dd-trace-java#8016) - [@evanchooly](https://github.com/evanchooly)) - ✨ Implement code origin support for grpc server entry spans ([#7942](DataDog/dd-trace-java#7942) - [@evanchooly](https://github.com/evanchooly)) ##### GraalVM native-image - 🐛 Update Graal build-time instrumentation config for TracePropagationStyle ([#8065](DataDog/dd-trace-java#8065) - [@MattAlp](https://github.com/MattAlp)) - 🐛 Fix NoClassDefFoundError: Could not initialize class DDSpanLink$EncoderHolder in Graal native-image ([#8036](DataDog/dd-trace-java#8036) - [@mcculls](https://github.com/mcculls)) - 🐛🧹 Fix native-image generation of reactive applications ([#8012](DataDog/dd-trace-java#8012) - [@mcculls](https://github.com/mcculls)) ##### OpenTracing - 🧹 Custom ScopeManagers are deprecated and will be removed in a future release of dd-trace-ot ([#8058](DataDog/dd-trace-java#8058) - [@mcculls](https://github.com/mcculls)) ##### Tracer core - ✨🧪 Service naming: split by jee deployment ([#8064](DataDog/dd-trace-java#8064) - [@amarziali](https://github.com/amarziali)) - ✨ Exclude jboss mdb proxies from instrumenting ([#8061](DataDog/dd-trace-java#8061) - [@amarziali](https://github.com/amarziali)) - ✨ Add a built-in trace interceptor for keeping traces depending of their latency ([#8040](DataDog/dd-trace-java#8040) - [@cecile75](https://github.com/cecile75)) - 💡 Introduce marker mechanism for eagerly initializing helpers ([#8028](DataDog/dd-trace-java#8028) - [@mcculls](https://github.com/mcculls)) - 💡 Add JSON component ([#7973](DataDog/dd-trace-java#7973) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨⚠️ Remove support for X-Forwarded in client IP resolution ([#7946](DataDog/dd-trace-java#7946) - [@smola](https://github.com/smola)) ##### Instrumentations ##### Apache HttpComponents - ✨ Expand SSRF support in IAST to apache-httpclient-5 and apache-httpasyncclient-4 ([#7920](DataDog/dd-trace-java#7920) - [@Mariovido](https://github.com/Mariovido)) ##### gRPC instrumentation - 🐛 Use lower priorities for grpc server errors ([#8043](DataDog/dd-trace-java#8043) - [@amarziali](https://github.com/amarziali)) ##### JDBC instrumentation - ✨ Add trace injection for prepared statements in Postgres ([#7940](DataDog/dd-trace-java#7940) - [@nenadnoveljic](https://github.com/nenadnoveljic)) ##### JMS instrumentation - 🐛 Protect mdb from instrumenting multiple time the same event ([#8062](DataDog/dd-trace-java#8062) - [@amarziali](https://github.com/amarziali)) ##### Kafka instrumentation - 💡 Instrument self hosted Kafka connectors ([#7959](DataDog/dd-trace-java#7959) - [@piochelepiotr](https://github.com/piochelepiotr)) ##### OpenTelemetry instrumentation - 🐛 Support using OpenTelemetry Event API inside `@WithSpan` annotated method ([#8019](DataDog/dd-trace-java#8019) - [@mcculls](https://github.com/mcculls)) ##### Reactor instrumentation - 🐛🧹 Fix native-image generation of reactive applications ([#8012](DataDog/dd-trace-java#8012) - [@mcculls](https://github.com/mcculls)) ##### Spring instrumentation - 🐛 Avoid double instrumenting lambdas on latest spring scheduling ([#8005](DataDog/dd-trace-java#8005) - [@amarziali](https://github.com/amarziali)) ##### All other instrumentations - 🐛 Twilio: allow service name flattening ([#8025](DataDog/dd-trace-java#8025) - [@amarziali](https://github.com/amarziali)) - ✨ Instrument Mulesoft 4.5.0+ ([#7981](DataDog/dd-trace-java#7981) - [@amarziali](https://github.com/amarziali)) </details> <details> <summary>aws/aws-sdk-java (com.amazonaws:aws-java-sdk-sqs)</summary> ### [`v1.12.780`](https://github.com/aws/aws-sdk-java/blob/HEAD/CHANGELOG.md#112780-2024-12-11) [Compare Source](aws/aws-sdk-java@1.12.779...1.12.780) #### **Amazon Simple Storage Service** - ### Bugfixes - AWS SDK for Java 1.x now includes additional validation for Amazon S3 client APIs to handle scenarios where an empty string ('') is passed as the key argument to the following operations: PutObject, DeleteObject, ListObjects, GetObjectMetaData, ListObjectsV2, SetObjectTagging, GetObjectTagging, SetObjectAcl, GetObjectAcl, SetObjectLegalHold, GetObjectLegalHold, CopyObject, CopyPart, SelectObjectContent, SetObjectRetention, GetObjectRetention, AbortMultipartUpload, CompleteMultipartUpload, InitiateMultipartUpload, ListParts, UploadPart, RestoreObjectV2, and RestoreObject. The SDK will validate the key argument and throw an exception if it is an empty string, ensuring correct and expected behavior. </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 69831bc62ea4d80cdcd42cef2aa9bd8eda28ae8c

nikita-tkachenko-datadog added 2 commits December 2, 2024 18:24

Implement fail-fast tests ordering for JUnit 5

943847f

Add priority-ordering for flaky tests

33e6929

nikita-tkachenko-datadog added the comp: ci visibility Continuous Integration Visibility label Dec 4, 2024

nikita-tkachenko-datadog changed the title ~~Nikita tkachenko/junit5 tests ordering~~ Implement fail-fast tests ordering for JUnit 5 Dec 4, 2024

Add telemetry

923e06f

nikita-tkachenko-datadog added 2 commits December 4, 2024 15:01

More telemetry

c5e236f

Fix instrumentation tests

68a3001

nikita-tkachenko-datadog marked this pull request as ready for review December 4, 2024 16:15

nikita-tkachenko-datadog requested review from a team as code owners December 4, 2024 16:15

nikita-tkachenko-datadog requested review from tonyredondo, amarziali and daniel-mohedano December 4, 2024 16:15

Remove redundant test fixture

a27c34e

daniel-mohedano approved these changes Dec 5, 2024

View reviewed changes

nikita-tkachenko-datadog merged commit 70a9d04 into master Dec 5, 2024
153 checks passed

nikita-tkachenko-datadog deleted the nikita-tkachenko/junit5-tests-ordering branch December 5, 2024 13:55

github-actions bot added this to the 1.44.0 milestone Dec 5, 2024

PerfectSlayer added the type: enhancement label Dec 12, 2024

This was referenced Dec 13, 2024

Fix tracing JUnit5 tests in Maven projects with multiple forks #8086

Merged

[🍒 8086] Fix tracing JUnit5 tests in Maven projects with multiple forks #8087

Merged

[🍒 8086] Fix tracing JUnit5 tests in Maven projects with multiple forks #8089

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Implement fail-fast tests ordering for JUnit 5 #8055

Implement fail-fast tests ordering for JUnit 5 #8055

nikita-tkachenko-datadog commented Dec 4, 2024 •

edited

Loading

pr-commenter bot commented Dec 4, 2024 •

edited

Loading

daniel-mohedano Dec 5, 2024

nikita-tkachenko-datadog Dec 5, 2024

Implement fail-fast tests ordering for JUnit 5 #8055

Implement fail-fast tests ordering for JUnit 5 #8055

Conversation

nikita-tkachenko-datadog commented Dec 4, 2024 • edited Loading

What Does This Do

Contributor Checklist

pr-commenter bot commented Dec 4, 2024 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

daniel-mohedano Dec 5, 2024

Choose a reason for hiding this comment

nikita-tkachenko-datadog Dec 5, 2024

Choose a reason for hiding this comment

nikita-tkachenko-datadog commented Dec 4, 2024 •

edited

Loading

pr-commenter bot commented Dec 4, 2024 •

edited

Loading