Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix JUnit test case name uniqueness when uploading results #8024

Merged
merged 1 commit into from
Nov 27, 2024
Merged

Fix JUnit test case name uniqueness when uploading results #8024

merged 1 commit into from
Nov 27, 2024

Conversation

PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Nov 27, 2024 •
edited
Loading

What Does This Do

This PR will alter JUnit test reports that are uploaded to CI Visibility to remove Java object hashCode from the test case name, replacing them by HASHCODE.

Motivation

This will help with CI monitoring to keep track of test execution.

Additional Notes

In addition, the script will now dump the collected result files, their mapping, and warn about hashCode presence.

Output example:

Saving test results:
- ./internal-api/build/test-results/forkedTest/TEST-datadog.trace.api.WithGlobalTracerForkedTest.xml as internal-api_forkedTest_TEST-datadog.trace.api.WithGlobalTracerForkedTest.xml
- ./internal-api/build/test-results/forkedTest/TEST-datadog.trace.api.naming.NamingV0ForkedTest.xml as internal-api_forkedTest_TEST-datadog.trace.api.naming.NamingV0ForkedTest.xml
- ./internal-api/build/test-results/test/TEST-datadog.trace.api.cache.QualifiedClassNameCacheTest.xml as internal-api_test_TEST-datadog.trace.api.cache.QualifiedClassNameCacheTest.xml (hashCode replaced)
- ...

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner November 27, 2024 09:42
@PerfectSlayer PerfectSlayer requested a review from ygree November 27, 2024 09:42
@pr-commenter
Copy link

pr-commenter bot commented Nov 27, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci-junit-result
git_commit_date 1732656091 1732702686
git_commit_sha 9eaf5a0 81b5001
release_version 1.44.0-SNAPSHOT~9eaf5a01bb 1.44.0-SNAPSHOT~81b5001337
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732705106 1732705106
ci_job_id 721791363 721791363
ci_pipeline_id 50049380 50049380
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1091611
Total [baseline] (8.672 s) : 0, 8672083
Agent [candidate] (1.098 s) : 0, 1097616
Total [candidate] (8.672 s) : 0, 8672316
section iast
Agent [baseline] (1.232 s) : 0, 1232207
Total [baseline] (9.237 s) : 0, 9237266
Agent [candidate] (1.218 s) : 0, 1218412
Total [candidate] (9.199 s) : 0, 9199269
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.22 s) : 0, 1219853
Total [baseline] (9.175 s) : 0, 9174852
Agent [candidate] (1.222 s) : 0, 1221837
Total [candidate] (9.16 s) : 0, 9160475
section iast_TELEMETRY_OFF
Agent [baseline] (1.222 s) : 0, 1221671
Total [baseline] (9.195 s) : 0, 9194709
Agent [candidate] (1.224 s) : 0, 1224305
Total [candidate] (9.22 s) : 0, 9219876
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent iast 1.232 s 140.596 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.22 s 128.242 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.222 s 130.06 ms (11.9%)
Total tracing 8.672 s -
Total iast 9.237 s 565.183 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.175 s 502.769 ms (5.8%)
Total iast_TELEMETRY_OFF 9.195 s 522.626 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.098 s -
Agent iast 1.218 s 120.796 ms (11.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.222 s 124.222 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.224 s 126.689 ms (11.5%)
Total tracing 8.672 s -
Total iast 9.199 s 526.953 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.16 s 488.159 ms (5.6%)
Total iast_TELEMETRY_OFF 9.22 s 547.56 ms (6.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (695.259 ms) : 0, 695259
BytebuddyAgent [candidate] (698.88 ms) : 0, 698880
GlobalTracer [baseline] (318.742 ms) : 0, 318742
GlobalTracer [candidate] (320.047 ms) : 0, 320047
AppSec [baseline] (54.763 ms) : 0, 54763
AppSec [candidate] (54.94 ms) : 0, 54940
Remote Config [baseline] (675.143 µs) : 0, 675
Remote Config [candidate] (685.449 µs) : 0, 685
Telemetry [baseline] (8.42 ms) : 0, 8420
Telemetry [candidate] (9.224 ms) : 0, 9224
section iast
BytebuddyAgent [baseline] (821.192 ms) : 0, 821192
BytebuddyAgent [candidate] (811.105 ms) : 0, 811105
GlobalTracer [baseline] (308.727 ms) : 0, 308727
GlobalTracer [candidate] (306.493 ms) : 0, 306493
AppSec [baseline] (57.038 ms) : 0, 57038
AppSec [candidate] (56.388 ms) : 0, 56388
Remote Config [baseline] (622.423 µs) : 0, 622
Remote Config [candidate] (634.545 µs) : 0, 635
Telemetry [baseline] (7.647 ms) : 0, 7647
Telemetry [candidate] (7.555 ms) : 0, 7555
IAST [baseline] (23.038 ms) : 0, 23038
IAST [candidate] (22.479 ms) : 0, 22479
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (811.975 ms) : 0, 811975
BytebuddyAgent [candidate] (813.392 ms) : 0, 813392
GlobalTracer [baseline] (306.949 ms) : 0, 306949
GlobalTracer [candidate] (307.649 ms) : 0, 307649
AppSec [baseline] (58.189 ms) : 0, 58189
AppSec [candidate] (58.108 ms) : 0, 58108
Remote Config [baseline] (626.055 µs) : 0, 626
Remote Config [candidate] (621.026 µs) : 0, 621
Telemetry [baseline] (7.554 ms) : 0, 7554
Telemetry [candidate] (7.512 ms) : 0, 7512
IAST [baseline] (20.811 ms) : 0, 20811
IAST [candidate] (20.781 ms) : 0, 20781
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (812.829 ms) : 0, 812829
BytebuddyAgent [candidate] (814.228 ms) : 0, 814228
GlobalTracer [baseline] (307.868 ms) : 0, 307868
GlobalTracer [candidate] (308.699 ms) : 0, 308699
AppSec [baseline] (56.06 ms) : 0, 56060
AppSec [candidate] (57.842 ms) : 0, 57842
Remote Config [baseline] (617.096 µs) : 0, 617
Remote Config [candidate] (640.457 µs) : 0, 640
Telemetry [baseline] (7.374 ms) : 0, 7374
Telemetry [candidate] (7.484 ms) : 0, 7484
IAST [baseline] (23.126 ms) : 0, 23126
IAST [candidate] (21.549 ms) : 0, 21549
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.098 s) : 0, 1097818
Total [baseline] (10.473 s) : 0, 10472784
Agent [candidate] (1.105 s) : 0, 1104918
Total [candidate] (10.454 s) : 0, 10454281
section appsec
Agent [baseline] (1.232 s) : 0, 1231752
Total [baseline] (10.825 s) : 0, 10825218
Agent [candidate] (1.228 s) : 0, 1227677
Total [candidate] (10.75 s) : 0, 10750168
section iast
Agent [baseline] (1.229 s) : 0, 1228632
Total [baseline] (11.027 s) : 0, 11027490
Agent [candidate] (1.219 s) : 0, 1219373
Total [candidate] (10.968 s) : 0, 10967821
section profiling
Agent [baseline] (1.313 s) : 0, 1313327
Total [baseline] (10.845 s) : 0, 10844985
Agent [candidate] (1.314 s) : 0, 1314332
Total [candidate] (10.744 s) : 0, 10744009
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.098 s -
Agent appsec 1.232 s 133.934 ms (12.2%)
Agent iast 1.229 s 130.814 ms (11.9%)
Agent profiling 1.313 s 215.509 ms (19.6%)
Total tracing 10.473 s -
Total appsec 10.825 s 352.434 ms (3.4%)
Total iast 11.027 s 554.707 ms (5.3%)
Total profiling 10.845 s 372.202 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.105 s -
Agent appsec 1.228 s 122.759 ms (11.1%)
Agent iast 1.219 s 114.455 ms (10.4%)
Agent profiling 1.314 s 209.414 ms (19.0%)
Total tracing 10.454 s -
Total appsec 10.75 s 295.886 ms (2.8%)
Total iast 10.968 s 513.539 ms (4.9%)
Total profiling 10.744 s 289.727 ms (2.8%) 
gantt
    title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (698.659 ms) : 0, 698659
BytebuddyAgent [candidate] (703.429 ms) : 0, 703429
GlobalTracer [baseline] (320.349 ms) : 0, 320349
GlobalTracer [candidate] (322.79 ms) : 0, 322790
AppSec [baseline] (55.056 ms) : 0, 55056
AppSec [candidate] (54.851 ms) : 0, 54851
Remote Config [baseline] (686.667 µs) : 0, 687
Remote Config [candidate] (689.824 µs) : 0, 690
Telemetry [baseline] (9.215 ms) : 0, 9215
Telemetry [candidate] (9.209 ms) : 0, 9209
section appsec
BytebuddyAgent [baseline] (715.174 ms) : 0, 715174
BytebuddyAgent [candidate] (712.932 ms) : 0, 712932
GlobalTracer [baseline] (316.082 ms) : 0, 316082
GlobalTracer [candidate] (315.453 ms) : 0, 315453
AppSec [baseline] (168.11 ms) : 0, 168110
AppSec [candidate] (166.113 ms) : 0, 166113
Remote Config [baseline] (638.972 µs) : 0, 639
Remote Config [candidate] (650.409 µs) : 0, 650
Telemetry [baseline] (8.513 ms) : 0, 8513
Telemetry [candidate] (9.281 ms) : 0, 9281
IAST [baseline] (18.903 ms) : 0, 18903
IAST [candidate] (19.035 ms) : 0, 19035
section iast
BytebuddyAgent [baseline] (818.848 ms) : 0, 818848
BytebuddyAgent [candidate] (811.978 ms) : 0, 811978
GlobalTracer [baseline] (309.184 ms) : 0, 309184
GlobalTracer [candidate] (306.56 ms) : 0, 306560
AppSec [baseline] (56.163 ms) : 0, 56163
AppSec [candidate] (55.511 ms) : 0, 55511
Remote Config [baseline] (632.729 µs) : 0, 633
Remote Config [candidate] (618.243 µs) : 0, 618
Telemetry [baseline] (7.488 ms) : 0, 7488
Telemetry [candidate] (7.558 ms) : 0, 7558
IAST [baseline] (22.347 ms) : 0, 22347
IAST [candidate] (23.412 ms) : 0, 23412
section profiling
BytebuddyAgent [baseline] (686.949 ms) : 0, 686949
BytebuddyAgent [candidate] (686.462 ms) : 0, 686462
GlobalTracer [baseline] (432.551 ms) : 0, 432551
GlobalTracer [candidate] (433.617 ms) : 0, 433617
AppSec [baseline] (53.543 ms) : 0, 53543
AppSec [candidate] (53.722 ms) : 0, 53722
Remote Config [baseline] (644.618 µs) : 0, 645
Remote Config [candidate] (653.49 µs) : 0, 653
Telemetry [baseline] (7.661 ms) : 0, 7661
Telemetry [candidate] (7.694 ms) : 0, 7694
ProfilingAgent [baseline] (92.959 ms) : 0, 92959
ProfilingAgent [candidate] (93.194 ms) : 0, 93194
Profiling [baseline] (92.984 ms) : 0, 92984
Profiling [candidate] (93.218 ms) : 0, 93218
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-27T10:28:41 2024-11-27T10:35:43
git_branch master bbujon/ci-junit-result
git_commit_date 1732656091 1732702686
git_commit_sha 9eaf5a0 81b5001
release_version 1.44.0-SNAPSHOT~9eaf5a01bb 1.44.0-SNAPSHOT~81b5001337
start_time 2024-11-27T10:28:28 2024-11-27T10:35:29
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732704098 1732704098
ci_job_id 721791364 721791364
ci_pipeline_id 50049380 50049380
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.219 µs) : 360, 400
.   : milestone, 380,
iast (499.368 µs) : 478, 521
.   : milestone, 499,
iast_FULL (658.76 µs) : 637, 680
.   : milestone, 659,
iast_GLOBAL (525.445 µs) : 504, 547
.   : milestone, 525,
iast_HARDCODED_SECRET_DISABLED (501.191 µs) : 480, 523
.   : milestone, 501,
iast_INACTIVE (450.258 µs) : 430, 471
.   : milestone, 450,
iast_TELEMETRY_OFF (491.614 µs) : 470, 513
.   : milestone, 492,
tracing (462.334 µs) : 442, 483
.   : milestone, 462,
section candidate
no_agent (376.74 µs) : 356, 397
.   : milestone, 377,
iast (493.752 µs) : 473, 515
.   : milestone, 494,
iast_FULL (659.446 µs) : 638, 681
.   : milestone, 659,
iast_GLOBAL (526.29 µs) : 505, 548
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (496.058 µs) : 475, 518
.   : milestone, 496,
iast_INACTIVE (459.704 µs) : 439, 481
.   : milestone, 460,
iast_TELEMETRY_OFF (484.893 µs) : 463, 506
.   : milestone, 485,
tracing (457.545 µs) : 437, 479
.   : milestone, 458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.219 µs [360.014 µs, 400.424 µs] -
iast 499.368 µs [477.713 µs, 521.022 µs] 119.149 µs (31.3%)
iast_FULL 658.76 µs [637.293 µs, 680.227 µs] 278.541 µs (73.3%)
iast_GLOBAL 525.445 µs [503.621 µs, 547.27 µs] 145.226 µs (38.2%)
iast_HARDCODED_SECRET_DISABLED 501.191 µs [479.541 µs, 522.841 µs] 120.972 µs (31.8%)
iast_INACTIVE 450.258 µs [429.539 µs, 470.978 µs] 70.039 µs (18.4%)
iast_TELEMETRY_OFF 491.614 µs [470.143 µs, 513.085 µs] 111.395 µs (29.3%)
tracing 462.334 µs [441.726 µs, 482.942 µs] 82.115 µs (21.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.74 µs [356.404 µs, 397.076 µs] -
iast 493.752 µs [472.511 µs, 514.994 µs] 117.012 µs (31.1%)
iast_FULL 659.446 µs [637.809 µs, 681.083 µs] 282.706 µs (75.0%)
iast_GLOBAL 526.29 µs [505.028 µs, 547.551 µs] 149.55 µs (39.7%)
iast_HARDCODED_SECRET_DISABLED 496.058 µs [474.61 µs, 517.506 µs] 119.318 µs (31.7%)
iast_INACTIVE 459.704 µs [438.631 µs, 480.778 µs] 82.964 µs (22.0%)
iast_TELEMETRY_OFF 484.893 µs [463.311 µs, 506.476 µs] 108.153 µs (28.7%)
tracing 457.545 µs [436.562 µs, 478.528 µs] 80.805 µs (21.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.374 ms) : 1354, 1393
.   : milestone, 1374,
appsec (1.766 ms) : 1741, 1791
.   : milestone, 1766,
appsec_no_iast (1.754 ms) : 1729, 1780
.   : milestone, 1754,
iast (1.502 ms) : 1479, 1525
.   : milestone, 1502,
profiling (1.564 ms) : 1539, 1589
.   : milestone, 1564,
tracing (1.484 ms) : 1459, 1509
.   : milestone, 1484,
section candidate
no_agent (1.371 ms) : 1352, 1390
.   : milestone, 1371,
appsec (1.756 ms) : 1731, 1781
.   : milestone, 1756,
appsec_no_iast (1.748 ms) : 1723, 1773
.   : milestone, 1748,
iast (1.511 ms) : 1488, 1533
.   : milestone, 1511,
profiling (1.507 ms) : 1484, 1531
.   : milestone, 1507,
tracing (1.513 ms) : 1488, 1539
.   : milestone, 1513,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.374 ms [1.354 ms, 1.393 ms] -
appsec 1.766 ms [1.741 ms, 1.791 ms] 392.368 µs (28.6%)
appsec_no_iast 1.754 ms [1.729 ms, 1.78 ms] 380.823 µs (27.7%)
iast 1.502 ms [1.479 ms, 1.525 ms] 128.479 µs (9.4%)
profiling 1.564 ms [1.539 ms, 1.589 ms] 190.617 µs (13.9%)
tracing 1.484 ms [1.459 ms, 1.509 ms] 110.737 µs (8.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.371 ms [1.352 ms, 1.39 ms] -
appsec 1.756 ms [1.731 ms, 1.781 ms] 384.836 µs (28.1%)
appsec_no_iast 1.748 ms [1.723 ms, 1.773 ms] 377.224 µs (27.5%)
iast 1.511 ms [1.488 ms, 1.533 ms] 139.64 µs (10.2%)
profiling 1.507 ms [1.484 ms, 1.531 ms] 136.421 µs (10.0%)
tracing 1.513 ms [1.488 ms, 1.539 ms] 142.526 µs (10.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci-junit-result
git_commit_date 1732656091 1732702686
git_commit_sha 9eaf5a0 81b5001
release_version 1.44.0-SNAPSHOT~9eaf5a01bb 1.44.0-SNAPSHOT~81b5001337
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1732704642 1732704642
ci_job_id 721791365 721791365
ci_pipeline_id 50049380 50049380
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1451, 1474
.   : milestone, 1462,
appsec (2.336 ms) : 2295, 2377
.   : milestone, 2336,
iast (2.071 ms) : 2018, 2124
.   : milestone, 2071,
iast_GLOBAL (2.116 ms) : 2064, 2169
.   : milestone, 2116,
profiling (1.951 ms) : 1908, 1994
.   : milestone, 1951,
tracing (1.916 ms) : 1876, 1957
.   : milestone, 1916,
section candidate
no_agent (1.461 ms) : 1450, 1473
.   : milestone, 1461,
appsec (2.331 ms) : 2290, 2373
.   : milestone, 2331,
iast (2.08 ms) : 2028, 2132
.   : milestone, 2080,
iast_GLOBAL (2.121 ms) : 2068, 2174
.   : milestone, 2121,
profiling (1.942 ms) : 1900, 1985
.   : milestone, 1942,
tracing (1.922 ms) : 1882, 1962
.   : milestone, 1922,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.474 ms] -
appsec 2.336 ms [2.295 ms, 2.377 ms] 873.77 µs (59.8%)
iast 2.071 ms [2.018 ms, 2.124 ms] 608.774 µs (41.6%)
iast_GLOBAL 2.116 ms [2.064 ms, 2.169 ms] 654.232 µs (44.7%)
profiling 1.951 ms [1.908 ms, 1.994 ms] 488.982 µs (33.4%)
tracing 1.916 ms [1.876 ms, 1.957 ms] 454.125 µs (31.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.45 ms, 1.473 ms] -
appsec 2.331 ms [2.29 ms, 2.373 ms] 870.031 µs (59.5%)
iast 2.08 ms [2.028 ms, 2.132 ms] 618.876 µs (42.4%)
iast_GLOBAL 2.121 ms [2.068 ms, 2.174 ms] 659.731 µs (45.1%)
profiling 1.942 ms [1.9 ms, 1.985 ms] 480.935 µs (32.9%)
tracing 1.922 ms [1.882 ms, 1.962 ms] 460.489 µs (31.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~81b5001337, baseline=1.44.0-SNAPSHOT~9eaf5a01bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.403 s) : 15403000, 15403000
.   : milestone, 15403000,
appsec (14.806 s) : 14806000, 14806000
.   : milestone, 14806000,
iast (19.013 s) : 19013000, 19013000
.   : milestone, 19013000,
iast_GLOBAL (17.865 s) : 17865000, 17865000
.   : milestone, 17865000,
profiling (15.352 s) : 15352000, 15352000
.   : milestone, 15352000,
tracing (14.865 s) : 14865000, 14865000
.   : milestone, 14865000,
section candidate
no_agent (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
appsec (14.764 s) : 14764000, 14764000
.   : milestone, 14764000,
iast (18.684 s) : 18684000, 18684000
.   : milestone, 18684000,
iast_GLOBAL (17.872 s) : 17872000, 17872000
.   : milestone, 17872000,
profiling (15.718 s) : 15718000, 15718000
.   : milestone, 15718000,
tracing (15.167 s) : 15167000, 15167000
.   : milestone, 15167000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.403 s [15.403 s, 15.403 s] -
appsec 14.806 s [14.806 s, 14.806 s] -597.0 ms (-3.9%)
iast 19.013 s [19.013 s, 19.013 s] 3.61 s (23.4%)
iast_GLOBAL 17.865 s [17.865 s, 17.865 s] 2.462 s (16.0%)
profiling 15.352 s [15.352 s, 15.352 s] -51.0 ms (-0.3%)
tracing 14.865 s [14.865 s, 14.865 s] -538.0 ms (-3.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.919 s [14.919 s, 14.919 s] -
appsec 14.764 s [14.764 s, 14.764 s] -155.0 ms (-1.0%)
iast 18.684 s [18.684 s, 18.684 s] 3.765 s (25.2%)
iast_GLOBAL 17.872 s [17.872 s, 17.872 s] 2.953 s (19.8%)
profiling 15.718 s [15.718 s, 15.718 s] 799.0 ms (5.4%)
tracing 15.167 s [15.167 s, 15.167 s] 248.0 ms (1.7%)

@PerfectSlayer PerfectSlayer merged commit 966ef84 into master Nov 27, 2024
102 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci-junit-result branch November 27, 2024 12:08
@github-actions github-actions bot added this to the 1.44.0 milestone Nov 27, 2024
@PerfectSlayer PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Nov 27, 2024
PerfectSlayer added a commit that referenced this pull request Nov 28, 2024
@PerfectSlayer
fix(ci): Fix JUnit test case name uniqueness (#8024)
5f9de24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug
Projects
None yet
Milestone
1.44.0
Development

Successfully merging this pull request may close these issues.
2 participants
@PerfectSlayer @smola