Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[🍒 7784] Fix automatic coverage includes calculation for headless test sessions #7809

Merged
merged 1 commit into from
Oct 18, 2024
Merged

[🍒 7784] Fix automatic coverage includes calculation for headless test sessions #7809

merged 1 commit into from
Oct 18, 2024

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

Cherry pick #7784

What Does This Do

Fixes automatic configuration of code coverage-enabled packages for headless sessions.

Motivation

"Headless" sessions are those where the build system is not instrumented.
At the moment we support instrumenting Maven and Gradle, so when a Maven or a Gradle build is traced, the tracer is injected into the parent build system process. The list of coverage-enabled packages is computed in the parent process and is then propagated to children.

For headless sessions, where there is no instrumented parent process, the list of packages needs to be computed inside the child process (JVM that runs the tests).

Contributor Checklist

Jira ticket: SDTEST-1130

@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: bug comp: ci visibility Continuous Integration Visibility labels Oct 18, 2024
@nikita-tkachenko-datadog nikita-tkachenko-datadog added this to the 1.41.1 milestone Oct 18, 2024
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review October 18, 2024 13:37
@pr-commenter
Copy link

pr-commenter bot commented Oct 18, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7784
git_commit_date 1729257196 1729254359
git_commit_sha 00856e0 c766655
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~c766655939
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729259649 1729259649
ci_job_id 676839816 676839816
ci_pipeline_id 46913163 46913163
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1084348
Total [baseline] (8.609 s) : 0, 8609396
Agent [candidate] (1.074 s) : 0, 1073826
Total [candidate] (8.592 s) : 0, 8592315
section iast
Agent [baseline] (1.208 s) : 0, 1208402
Total [baseline] (9.117 s) : 0, 9116823
Agent [candidate] (1.202 s) : 0, 1202266
Total [candidate] (9.122 s) : 0, 9122001
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.204 s) : 0, 1203994
Total [baseline] (9.092 s) : 0, 9092081
Agent [candidate] (1.199 s) : 0, 1199461
Total [candidate] (9.073 s) : 0, 9072719
section iast_TELEMETRY_OFF
Agent [baseline] (1.198 s) : 0, 1198306
Total [baseline] (9.084 s) : 0, 9083874
Agent [candidate] (1.205 s) : 0, 1205415
Total [candidate] (9.077 s) : 0, 9077182
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent iast 1.208 s 124.054 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.204 s 119.646 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.198 s 113.957 ms (10.5%)
Total tracing 8.609 s -
Total iast 9.117 s 507.428 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.092 s 482.686 ms (5.6%)
Total iast_TELEMETRY_OFF 9.084 s 474.478 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.202 s 128.441 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.199 s 125.635 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.205 s 131.589 ms (12.3%)
Total tracing 8.592 s -
Total iast 9.122 s 529.686 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.073 s 480.405 ms (5.6%)
Total iast_TELEMETRY_OFF 9.077 s 484.867 ms (5.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.343 ms) : 0, 690343
BytebuddyAgent [candidate] (685.313 ms) : 0, 685313
GlobalTracer [baseline] (314.367 ms) : 0, 314367
GlobalTracer [candidate] (312.615 ms) : 0, 312615
AppSec [baseline] (54.16 ms) : 0, 54160
AppSec [candidate] (54.049 ms) : 0, 54049
Remote Config [baseline] (676.743 µs) : 0, 677
Remote Config [candidate] (664.245 µs) : 0, 664
Telemetry [baseline] (11.073 ms) : 0, 11073
Telemetry [candidate] (7.495 ms) : 0, 7495
section iast
BytebuddyAgent [baseline] (806.201 ms) : 0, 806201
BytebuddyAgent [candidate] (800.459 ms) : 0, 800459
GlobalTracer [baseline] (303.235 ms) : 0, 303235
GlobalTracer [candidate] (302.151 ms) : 0, 302151
AppSec [baseline] (56.759 ms) : 0, 56759
AppSec [candidate] (57.957 ms) : 0, 57957
Remote Config [baseline] (588.657 µs) : 0, 589
Remote Config [candidate] (594.147 µs) : 0, 594
Telemetry [baseline] (7.826 ms) : 0, 7826
Telemetry [candidate] (7.035 ms) : 0, 7035
IAST [baseline] (20.05 ms) : 0, 20050
IAST [candidate] (20.348 ms) : 0, 20348
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.565 ms) : 0, 802565
BytebuddyAgent [candidate] (797.997 ms) : 0, 797997
GlobalTracer [baseline] (302.287 ms) : 0, 302287
GlobalTracer [candidate] (301.676 ms) : 0, 301676
AppSec [baseline] (57.371 ms) : 0, 57371
AppSec [candidate] (56.291 ms) : 0, 56291
Remote Config [baseline] (600.588 µs) : 0, 601
Remote Config [candidate] (604.933 µs) : 0, 605
Telemetry [baseline] (7.079 ms) : 0, 7079
Telemetry [candidate] (7.038 ms) : 0, 7038
IAST [baseline] (20.383 ms) : 0, 20383
IAST [candidate] (22.149 ms) : 0, 22149
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.49 ms) : 0, 797490
BytebuddyAgent [candidate] (802.09 ms) : 0, 802090
GlobalTracer [baseline] (301.681 ms) : 0, 301681
GlobalTracer [candidate] (304.112 ms) : 0, 304112
AppSec [baseline] (57.817 ms) : 0, 57817
AppSec [candidate] (56.293 ms) : 0, 56293
Remote Config [baseline] (603.363 µs) : 0, 603
Remote Config [candidate] (609.903 µs) : 0, 610
Telemetry [baseline] (6.978 ms) : 0, 6978
Telemetry [candidate] (6.996 ms) : 0, 6996
IAST [baseline] (20.086 ms) : 0, 20086
IAST [candidate] (21.493 ms) : 0, 21493
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1075338
Total [baseline] (10.411 s) : 0, 10410918
Agent [candidate] (1.073 s) : 0, 1073400
Total [candidate] (10.374 s) : 0, 10373600
section appsec
Agent [baseline] (1.209 s) : 0, 1209228
Total [baseline] (10.639 s) : 0, 10638964
Agent [candidate] (1.21 s) : 0, 1209819
Total [candidate] (10.609 s) : 0, 10609425
section iast
Agent [baseline] (1.212 s) : 0, 1211510
Total [baseline] (10.943 s) : 0, 10943396
Agent [candidate] (1.209 s) : 0, 1209262
Total [candidate] (10.845 s) : 0, 10844622
section profiling
Agent [baseline] (1.285 s) : 0, 1284987
Total [baseline] (10.704 s) : 0, 10704075
Agent [candidate] (1.274 s) : 0, 1274005
Total [candidate] (10.597 s) : 0, 10597234
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.209 s 133.889 ms (12.5%)
Agent iast 1.212 s 136.172 ms (12.7%)
Agent profiling 1.285 s 209.649 ms (19.5%)
Total tracing 10.411 s -
Total appsec 10.639 s 228.046 ms (2.2%)
Total iast 10.943 s 532.478 ms (5.1%)
Total profiling 10.704 s 293.158 ms (2.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.21 s 136.419 ms (12.7%)
Agent iast 1.209 s 135.862 ms (12.7%)
Agent profiling 1.274 s 200.606 ms (18.7%)
Total tracing 10.374 s -
Total appsec 10.609 s 235.826 ms (2.3%)
Total iast 10.845 s 471.022 ms (4.5%)
Total profiling 10.597 s 223.634 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.985 ms) : 0, 684985
BytebuddyAgent [candidate] (685.352 ms) : 0, 685352
GlobalTracer [baseline] (312.48 ms) : 0, 312480
GlobalTracer [candidate] (312.487 ms) : 0, 312487
AppSec [baseline] (53.935 ms) : 0, 53935
AppSec [candidate] (53.725 ms) : 0, 53725
Remote Config [baseline] (659.053 µs) : 0, 659
Remote Config [candidate] (673.244 µs) : 0, 673
Telemetry [baseline] (9.614 ms) : 0, 9614
Telemetry [candidate] (7.47 ms) : 0, 7470
section appsec
BytebuddyAgent [baseline] (702.499 ms) : 0, 702499
BytebuddyAgent [candidate] (702.471 ms) : 0, 702471
GlobalTracer [baseline] (309.483 ms) : 0, 309483
GlobalTracer [candidate] (310.886 ms) : 0, 310886
AppSec [baseline] (165.296 ms) : 0, 165296
AppSec [candidate] (164.025 ms) : 0, 164025
Remote Config [baseline] (629.511 µs) : 0, 630
Remote Config [candidate] (633.652 µs) : 0, 634
Telemetry [baseline] (8.414 ms) : 0, 8414
Telemetry [candidate] (8.113 ms) : 0, 8113
IAST [baseline] (18.495 ms) : 0, 18495
IAST [candidate] (19.92 ms) : 0, 19920
section iast
BytebuddyAgent [baseline] (807.986 ms) : 0, 807986
BytebuddyAgent [candidate] (805.308 ms) : 0, 805308
GlobalTracer [baseline] (304.183 ms) : 0, 304183
GlobalTracer [candidate] (303.579 ms) : 0, 303579
AppSec [baseline] (57.226 ms) : 0, 57226
AppSec [candidate] (56.76 ms) : 0, 56760
Remote Config [baseline] (590.482 µs) : 0, 590
Remote Config [candidate] (604.149 µs) : 0, 604
Telemetry [baseline] (7.142 ms) : 0, 7142
Telemetry [candidate] (7.129 ms) : 0, 7129
IAST [baseline] (20.569 ms) : 0, 20569
IAST [candidate] (22.117 ms) : 0, 22117
section profiling
BytebuddyAgent [baseline] (684.938 ms) : 0, 684938
BytebuddyAgent [candidate] (679.117 ms) : 0, 679117
GlobalTracer [baseline] (400.33 ms) : 0, 400330
GlobalTracer [candidate] (396.385 ms) : 0, 396385
AppSec [baseline] (55.181 ms) : 0, 55181
AppSec [candidate] (54.59 ms) : 0, 54590
Remote Config [baseline] (657.909 µs) : 0, 658
Remote Config [candidate] (652.174 µs) : 0, 652
Telemetry [baseline] (11.817 ms) : 0, 11817
Telemetry [candidate] (7.488 ms) : 0, 7488
ProfilingAgent [baseline] (93.116 ms) : 0, 93116
ProfilingAgent [candidate] (96.979 ms) : 0, 96979
Profiling [baseline] (93.14 ms) : 0, 93140
Profiling [candidate] (97.003 ms) : 0, 97003
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-18T13:26:41 2024-10-18T13:33:30
git_branch master nikita-tkachenko/backport-pr-7784
git_commit_date 1729257196 1729254359
git_commit_sha 00856e0 c766655
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~c766655939
start_time 2024-10-18T13:26:27 2024-10-18T13:33:17
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729258759 1729258759
ci_job_id 676839817 676839817
ci_pipeline_id 46913163 46913163
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+55.658µs; +107.788µs] or [+3.776%; +7.312%]		 unstable
[-582.784op/s; +582.784op/s] or [-18.940%; +18.940%]		 1.556ms 3076.923op/s 1.474ms 3076.923op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (364.852 µs) : 345, 384
.   : milestone, 365,
iast (483.623 µs) : 462, 505
.   : milestone, 484,
iast_FULL (549.739 µs) : 528, 571
.   : milestone, 550,
iast_GLOBAL (502.716 µs) : 481, 525
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (485.33 µs) : 464, 507
.   : milestone, 485,
iast_INACTIVE (442.502 µs) : 422, 463
.   : milestone, 443,
iast_TELEMETRY_OFF (464.315 µs) : 443, 485
.   : milestone, 464,
tracing (442.803 µs) : 422, 463
.   : milestone, 443,
section candidate
no_agent (365.476 µs) : 346, 385
.   : milestone, 365,
iast (483.144 µs) : 462, 504
.   : milestone, 483,
iast_FULL (551.834 µs) : 531, 573
.   : milestone, 552,
iast_GLOBAL (498.738 µs) : 477, 520
.   : milestone, 499,
iast_HARDCODED_SECRET_DISABLED (493.352 µs) : 471, 515
.   : milestone, 493,
iast_INACTIVE (443.448 µs) : 423, 464
.   : milestone, 443,
iast_TELEMETRY_OFF (474.258 µs) : 452, 496
.   : milestone, 474,
tracing (440.757 µs) : 420, 462
.   : milestone, 441,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.852 µs [345.295 µs, 384.41 µs] -
iast 483.623 µs [462.236 µs, 505.01 µs] 118.771 µs (32.6%)
iast_FULL 549.739 µs [528.376 µs, 571.102 µs] 184.887 µs (50.7%)
iast_GLOBAL 502.716 µs [480.735 µs, 524.697 µs] 137.863 µs (37.8%)
iast_HARDCODED_SECRET_DISABLED 485.33 µs [463.985 µs, 506.676 µs] 120.478 µs (33.0%)
iast_INACTIVE 442.502 µs [421.628 µs, 463.376 µs] 77.65 µs (21.3%)
iast_TELEMETRY_OFF 464.315 µs [443.432 µs, 485.198 µs] 99.463 µs (27.3%)
tracing 442.803 µs [422.116 µs, 463.491 µs] 77.951 µs (21.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 365.476 µs [345.66 µs, 385.292 µs] -
iast 483.144 µs [461.852 µs, 504.437 µs] 117.668 µs (32.2%)
iast_FULL 551.834 µs [530.734 µs, 572.934 µs] 186.358 µs (51.0%)
iast_GLOBAL 498.738 µs [477.471 µs, 520.004 µs] 133.262 µs (36.5%)
iast_HARDCODED_SECRET_DISABLED 493.352 µs [471.405 µs, 515.3 µs] 127.876 µs (35.0%)
iast_INACTIVE 443.448 µs [422.65 µs, 464.247 µs] 77.972 µs (21.3%)
iast_TELEMETRY_OFF 474.258 µs [452.351 µs, 496.164 µs] 108.782 µs (29.8%)
tracing 440.757 µs [419.846 µs, 461.669 µs] 75.281 µs (20.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.316 ms) : 1297, 1334
.   : milestone, 1316,
appsec (1.724 ms) : 1700, 1749
.   : milestone, 1724,
appsec_no_iast (1.718 ms) : 1692, 1743
.   : milestone, 1718,
iast (1.49 ms) : 1468, 1513
.   : milestone, 1490,
profiling (1.474 ms) : 1450, 1498
.   : milestone, 1474,
tracing (1.471 ms) : 1447, 1495
.   : milestone, 1471,
section candidate
no_agent (1.347 ms) : 1327, 1366
.   : milestone, 1347,
appsec (1.732 ms) : 1709, 1754
.   : milestone, 1732,
appsec_no_iast (1.724 ms) : 1699, 1748
.   : milestone, 1724,
iast (1.485 ms) : 1462, 1507
.   : milestone, 1485,
profiling (1.556 ms) : 1532, 1580
.   : milestone, 1556,
tracing (1.486 ms) : 1460, 1512
.   : milestone, 1486,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.316 ms [1.297 ms, 1.334 ms] -
appsec 1.724 ms [1.7 ms, 1.749 ms] 408.935 µs (31.1%)
appsec_no_iast 1.718 ms [1.692 ms, 1.743 ms] 402.014 µs (30.6%)
iast 1.49 ms [1.468 ms, 1.513 ms] 174.753 µs (13.3%)
profiling 1.474 ms [1.45 ms, 1.498 ms] 158.61 µs (12.1%)
tracing 1.471 ms [1.447 ms, 1.495 ms] 155.323 µs (11.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.347 ms [1.327 ms, 1.366 ms] -
appsec 1.732 ms [1.709 ms, 1.754 ms] 384.999 µs (28.6%)
appsec_no_iast 1.724 ms [1.699 ms, 1.748 ms] 376.962 µs (28.0%)
iast 1.485 ms [1.462 ms, 1.507 ms] 138.063 µs (10.3%)
profiling 1.556 ms [1.532 ms, 1.58 ms] 209.232 µs (15.5%)
tracing 1.486 ms [1.46 ms, 1.512 ms] 139.054 µs (10.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7784
git_commit_date 1729257196 1729254359
git_commit_sha 00856e0 c766655
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~c766655939
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1729259293 1729259293
ci_job_id 676839818 676839818
ci_pipeline_id 46913163 46913163
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1480
.   : milestone, 1468,
appsec (2.333 ms) : 2291, 2374
.   : milestone, 2333,
iast (2.07 ms) : 2019, 2121
.   : milestone, 2070,
iast_GLOBAL (2.123 ms) : 2070, 2176
.   : milestone, 2123,
profiling (1.943 ms) : 1902, 1985
.   : milestone, 1943,
tracing (1.927 ms) : 1887, 1967
.   : milestone, 1927,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.352 ms) : 2311, 2393
.   : milestone, 2352,
iast (2.079 ms) : 2026, 2131
.   : milestone, 2079,
iast_GLOBAL (2.122 ms) : 2069, 2174
.   : milestone, 2122,
profiling (1.93 ms) : 1889, 1971
.   : milestone, 1930,
tracing (1.915 ms) : 1875, 1955
.   : milestone, 1915,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.48 ms] -
appsec 2.333 ms [2.291 ms, 2.374 ms] 864.799 µs (58.9%)
iast 2.07 ms [2.019 ms, 2.121 ms] 602.082 µs (41.0%)
iast_GLOBAL 2.123 ms [2.07 ms, 2.176 ms] 654.925 µs (44.6%)
profiling 1.943 ms [1.902 ms, 1.985 ms] 475.461 µs (32.4%)
tracing 1.927 ms [1.887 ms, 1.967 ms] 459.286 µs (31.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.352 ms [2.311 ms, 2.393 ms] 882.886 µs (60.1%)
iast 2.079 ms [2.026 ms, 2.131 ms] 609.179 µs (41.5%)
iast_GLOBAL 2.122 ms [2.069 ms, 2.174 ms] 652.16 µs (44.4%)
profiling 1.93 ms [1.889 ms, 1.971 ms] 460.923 µs (31.4%)
tracing 1.915 ms [1.875 ms, 1.955 ms] 445.681 µs (30.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~c766655939, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
appsec (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
iast (18.711 s) : 18711000, 18711000
.   : milestone, 18711000,
iast_GLOBAL (17.971 s) : 17971000, 17971000
.   : milestone, 17971000,
profiling (15.253 s) : 15253000, 15253000
.   : milestone, 15253000,
tracing (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
section candidate
no_agent (15.774 s) : 15774000, 15774000
.   : milestone, 15774000,
appsec (15.313 s) : 15313000, 15313000
.   : milestone, 15313000,
iast (18.7 s) : 18700000, 18700000
.   : milestone, 18700000,
iast_GLOBAL (18.119 s) : 18119000, 18119000
.   : milestone, 18119000,
profiling (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
tracing (15.191 s) : 15191000, 15191000
.   : milestone, 15191000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.923 s [14.923 s, 14.923 s] -
appsec 15.048 s [15.048 s, 15.048 s] 125.0 ms (0.8%)
iast 18.711 s [18.711 s, 18.711 s] 3.788 s (25.4%)
iast_GLOBAL 17.971 s [17.971 s, 17.971 s] 3.048 s (20.4%)
profiling 15.253 s [15.253 s, 15.253 s] 330.0 ms (2.2%)
tracing 15.094 s [15.094 s, 15.094 s] 171.0 ms (1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.774 s [15.774 s, 15.774 s] -
appsec 15.313 s [15.313 s, 15.313 s] -461.0 ms (-2.9%)
iast 18.7 s [18.7 s, 18.7 s] 2.926 s (18.5%)
iast_GLOBAL 18.119 s [18.119 s, 18.119 s] 2.345 s (14.9%)
profiling 14.831 s [14.831 s, 14.831 s] -943.0 ms (-6.0%)
tracing 15.191 s [15.191 s, 15.191 s] -583.0 ms (-3.7%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit d0ae08a into release/v1.41.x Oct 18, 2024
109 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/backport-pr-7784 branch October 18, 2024 14:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@juan-fernandez juan-fernandez juan-fernandez approved these changes

@tonyredondo tonyredondo Awaiting requested review from tonyredondo tonyredondo is a code owner automatically assigned from DataDog/ci-app-libraries-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility type: bug
Projects
None yet
Milestone
1.41.1
Development

Successfully merging this pull request may close these issues.
2 participants
@nikita-tkachenko-datadog @juan-fernandez