Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[🍒 7736] Update bundled Jacoco version #7769

Merged
merged 1 commit into from
Oct 16, 2024
Merged

[🍒 7736] Update bundled Jacoco version #7769

merged 1 commit into from
Oct 16, 2024

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

Cherry pick #7736

What Does This Do

Updates Jacoco version that is bundled with the tracer.

Motivation

Jacoco is used, among other things, for parsing coverage data gathered by the JVMs that run the tests.
If the customer's project is using a newer version of Jacoco, the coverage data may not be compatible with the older version that the tracer uses.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog added the comp: ci visibility Continuous Integration Visibility label Oct 16, 2024
@manuel-alvarez-alvarez manuel-alvarez-alvarez added this to the 1.40.2 milestone Oct 16, 2024
@pr-commenter
Copy link

pr-commenter bot commented Oct 16, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7736
git_commit_date 1729065190 1729068479
git_commit_sha f74856b 0b14c1e
release_version 1.41.0-SNAPSHOT~f74856b0fd 1.41.0-SNAPSHOT~0b14c1edb4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729070976 1729070976
ci_job_id 673582200 673582200
ci_pipeline_id 46692714 46692714
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 8 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:iast:AppSec better
[-8.028ms; -4.070ms] or [-13.993%; -7.094%]		 51.326ms 57.375ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1083141
Total [baseline] (8.606 s) : 0, 8605807
Agent [candidate] (1.079 s) : 0, 1078908
Total [candidate] (8.573 s) : 0, 8572958
section iast
Agent [baseline] (1.203 s) : 0, 1202859
Total [baseline] (9.099 s) : 0, 9099001
Agent [candidate] (1.198 s) : 0, 1197695
Total [candidate] (9.109 s) : 0, 9109319
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.201 s) : 0, 1201180
Total [baseline] (9.113 s) : 0, 9112755
Agent [candidate] (1.207 s) : 0, 1207226
Total [candidate] (9.152 s) : 0, 9152087
section iast_TELEMETRY_OFF
Agent [baseline] (1.203 s) : 0, 1202968
Total [baseline] (9.084 s) : 0, 9084363
Agent [candidate] (1.215 s) : 0, 1215218
Total [candidate] (9.157 s) : 0, 9156570
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.203 s 119.718 ms (11.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.201 s 118.039 ms (10.9%)
Agent iast_TELEMETRY_OFF 1.203 s 119.827 ms (11.1%)
Total tracing 8.606 s -
Total iast 9.099 s 493.194 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.113 s 506.948 ms (5.9%)
Total iast_TELEMETRY_OFF 9.084 s 478.556 ms (5.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.198 s 118.786 ms (11.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.207 s 128.317 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.215 s 136.309 ms (12.6%)
Total tracing 8.573 s -
Total iast 9.109 s 536.361 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.152 s 579.129 ms (6.8%)
Total iast_TELEMETRY_OFF 9.157 s 583.612 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.189 ms) : 0, 690189
BytebuddyAgent [candidate] (688.702 ms) : 0, 688702
GlobalTracer [baseline] (316.173 ms) : 0, 316173
GlobalTracer [candidate] (313.524 ms) : 0, 313524
AppSec [baseline] (54.69 ms) : 0, 54690
AppSec [candidate] (54.464 ms) : 0, 54464
Remote Config [baseline] (666.011 µs) : 0, 666
Remote Config [candidate] (671.933 µs) : 0, 672
Telemetry [baseline] (7.564 ms) : 0, 7564
Telemetry [candidate] (7.68 ms) : 0, 7680
section iast
BytebuddyAgent [baseline] (800.158 ms) : 0, 800158
BytebuddyAgent [candidate] (797.706 ms) : 0, 797706
GlobalTracer [baseline] (302.318 ms) : 0, 302318
GlobalTracer [candidate] (300.359 ms) : 0, 300359
AppSec [baseline] (56.71 ms) : 0, 56710
AppSec [candidate] (54.602 ms) : 0, 54602
IAST [baseline] (22.144 ms) : 0, 22144
IAST [candidate] (23.493 ms) : 0, 23493
Remote Config [baseline] (612.162 µs) : 0, 612
Remote Config [candidate] (630.308 µs) : 0, 630
Telemetry [baseline] (7.1 ms) : 0, 7100
Telemetry [candidate] (7.05 ms) : 0, 7050
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (798.514 ms) : 0, 798514
BytebuddyAgent [candidate] (803.647 ms) : 0, 803647
GlobalTracer [baseline] (302.253 ms) : 0, 302253
GlobalTracer [candidate] (302.968 ms) : 0, 302968
AppSec [baseline] (56.722 ms) : 0, 56722
AppSec [candidate] (55.617 ms) : 0, 55617
IAST [baseline] (22.126 ms) : 0, 22126
IAST [candidate] (23.226 ms) : 0, 23226
Remote Config [baseline] (618.266 µs) : 0, 618
Remote Config [candidate] (630.928 µs) : 0, 631
Telemetry [baseline] (7.1 ms) : 0, 7100
Telemetry [candidate] (7.173 ms) : 0, 7173
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.046 ms) : 0, 801046
BytebuddyAgent [candidate] (808.062 ms) : 0, 808062
GlobalTracer [baseline] (302.641 ms) : 0, 302641
GlobalTracer [candidate] (305.623 ms) : 0, 305623
AppSec [baseline] (54.773 ms) : 0, 54773
AppSec [candidate] (55.984 ms) : 0, 55984
IAST [baseline] (23.028 ms) : 0, 23028
IAST [candidate] (23.789 ms) : 0, 23789
Remote Config [baseline] (594.072 µs) : 0, 594
Remote Config [candidate] (627.873 µs) : 0, 628
Telemetry [baseline] (6.967 ms) : 0, 6967
Telemetry [candidate] (7.038 ms) : 0, 7038
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1079526
Total [baseline] (10.447 s) : 0, 10447492
Agent [candidate] (1.07 s) : 0, 1069768
Total [candidate] (10.39 s) : 0, 10390228
section appsec
Agent [baseline] (1.21 s) : 0, 1210469
Total [baseline] (10.645 s) : 0, 10644650
Agent [candidate] (1.208 s) : 0, 1207865
Total [candidate] (10.589 s) : 0, 10588578
section iast
Agent [baseline] (1.2 s) : 0, 1200199
Total [baseline] (10.908 s) : 0, 10907680
Agent [candidate] (1.198 s) : 0, 1198078
Total [candidate] (10.866 s) : 0, 10865679
section profiling
Agent [baseline] (1.281 s) : 0, 1281335
Total [baseline] (10.719 s) : 0, 10718913
Agent [candidate] (1.27 s) : 0, 1270133
Total [candidate] (10.644 s) : 0, 10644392
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.21 s 130.943 ms (12.1%)
Agent iast 1.2 s 120.673 ms (11.2%)
Agent profiling 1.281 s 201.809 ms (18.7%)
Total tracing 10.447 s -
Total appsec 10.645 s 197.158 ms (1.9%)
Total iast 10.908 s 460.189 ms (4.4%)
Total profiling 10.719 s 271.421 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.208 s 138.098 ms (12.9%)
Agent iast 1.198 s 128.311 ms (12.0%)
Agent profiling 1.27 s 200.366 ms (18.7%)
Total tracing 10.39 s -
Total appsec 10.589 s 198.35 ms (1.9%)
Total iast 10.866 s 475.451 ms (4.6%)
Total profiling 10.644 s 254.164 ms (2.4%) 
gantt
    title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.072 ms) : 0, 688072
BytebuddyAgent [candidate] (682.414 ms) : 0, 682414
GlobalTracer [baseline] (315.154 ms) : 0, 315154
GlobalTracer [candidate] (311.222 ms) : 0, 311222
AppSec [baseline] (54.202 ms) : 0, 54202
AppSec [candidate] (53.974 ms) : 0, 53974
Remote Config [baseline] (677.84 µs) : 0, 678
Remote Config [candidate] (674.417 µs) : 0, 674
Telemetry [baseline] (7.55 ms) : 0, 7550
Telemetry [candidate] (7.743 ms) : 0, 7743
section appsec
BytebuddyAgent [baseline] (702.304 ms) : 0, 702304
BytebuddyAgent [candidate] (702.306 ms) : 0, 702306
GlobalTracer [baseline] (310.68 ms) : 0, 310680
GlobalTracer [candidate] (308.514 ms) : 0, 308514
AppSec [baseline] (162.632 ms) : 0, 162632
AppSec [candidate] (163.28 ms) : 0, 163280
IAST [baseline] (20.283 ms) : 0, 20283
IAST [candidate] (20.771 ms) : 0, 20771
Remote Config [baseline] (644.79 µs) : 0, 645
Remote Config [candidate] (648.354 µs) : 0, 648
Telemetry [baseline] (10.266 ms) : 0, 10266
Telemetry [candidate] (8.919 ms) : 0, 8919
section iast
BytebuddyAgent [baseline] (798.019 ms) : 0, 798019
BytebuddyAgent [candidate] (796.868 ms) : 0, 796868
GlobalTracer [baseline] (301.969 ms) : 0, 301969
GlobalTracer [candidate] (300.333 ms) : 0, 300333
AppSec [baseline] (57.375 ms) : 0, 57375
AppSec [candidate] (51.326 ms) : 0, 51326
IAST [baseline] (21.378 ms) : 0, 21378
IAST [candidate] (28.125 ms) : 0, 28125
Remote Config [baseline] (601.611 µs) : 0, 602
Remote Config [candidate] (614.719 µs) : 0, 615
Telemetry [baseline] (7.123 ms) : 0, 7123
Telemetry [candidate] (7.024 ms) : 0, 7024
section profiling
BytebuddyAgent [baseline] (681.795 ms) : 0, 681795
BytebuddyAgent [candidate] (676.256 ms) : 0, 676256
GlobalTracer [baseline] (398.991 ms) : 0, 398991
GlobalTracer [candidate] (394.264 ms) : 0, 394264
AppSec [baseline] (55.493 ms) : 0, 55493
AppSec [candidate] (55.083 ms) : 0, 55083
Remote Config [baseline] (664.403 µs) : 0, 664
Remote Config [candidate] (659.565 µs) : 0, 660
Telemetry [baseline] (7.556 ms) : 0, 7556
Telemetry [candidate] (7.471 ms) : 0, 7471
ProfilingAgent [baseline] (97.634 ms) : 0, 97634
ProfilingAgent [candidate] (97.589 ms) : 0, 97589
Profiling [baseline] (97.657 ms) : 0, 97657
Profiling [candidate] (97.612 ms) : 0, 97612
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-16T09:00:01 2024-10-16T09:06:52
git_branch master nikita-tkachenko/backport-pr-7736
git_commit_date 1729065190 1729068479
git_commit_sha f74856b 0b14c1e
release_version 1.41.0-SNAPSHOT~f74856b0fd 1.41.0-SNAPSHOT~0b14c1edb4
start_time 2024-10-16T08:59:48 2024-10-16T09:06:38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729069956 1729069956
ci_job_id 673582202 673582202
ci_pipeline_id 46692714 46692714
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.342 ms) : 1323, 1361
.   : milestone, 1342,
appsec (1.721 ms) : 1697, 1746
.   : milestone, 1721,
appsec_no_iast (1.712 ms) : 1688, 1735
.   : milestone, 1712,
iast (1.463 ms) : 1440, 1486
.   : milestone, 1463,
profiling (1.468 ms) : 1444, 1492
.   : milestone, 1468,
tracing (1.466 ms) : 1441, 1490
.   : milestone, 1466,
section candidate
no_agent (1.346 ms) : 1326, 1366
.   : milestone, 1346,
appsec (1.714 ms) : 1690, 1739
.   : milestone, 1714,
appsec_no_iast (1.702 ms) : 1678, 1727
.   : milestone, 1702,
iast (1.473 ms) : 1450, 1495
.   : milestone, 1473,
profiling (1.466 ms) : 1442, 1490
.   : milestone, 1466,
tracing (1.441 ms) : 1417, 1465
.   : milestone, 1441,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.342 ms [1.323 ms, 1.361 ms] -
appsec 1.721 ms [1.697 ms, 1.746 ms] 379.551 µs (28.3%)
appsec_no_iast 1.712 ms [1.688 ms, 1.735 ms] 369.989 µs (27.6%)
iast 1.463 ms [1.44 ms, 1.486 ms] 121.048 µs (9.0%)
profiling 1.468 ms [1.444 ms, 1.492 ms] 126.118 µs (9.4%)
tracing 1.466 ms [1.441 ms, 1.49 ms] 123.694 µs (9.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.346 ms [1.326 ms, 1.366 ms] -
appsec 1.714 ms [1.69 ms, 1.739 ms] 368.333 µs (27.4%)
appsec_no_iast 1.702 ms [1.678 ms, 1.727 ms] 355.98 µs (26.4%)
iast 1.473 ms [1.45 ms, 1.495 ms] 126.367 µs (9.4%)
profiling 1.466 ms [1.442 ms, 1.49 ms] 119.739 µs (8.9%)
tracing 1.441 ms [1.417 ms, 1.465 ms] 94.686 µs (7.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.04 µs) : 349, 388
.   : milestone, 368,
iast (486.607 µs) : 465, 508
.   : milestone, 487,
iast_FULL (549.251 µs) : 528, 570
.   : milestone, 549,
iast_GLOBAL (511.053 µs) : 489, 533
.   : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (486.554 µs) : 465, 508
.   : milestone, 487,
iast_INACTIVE (441.934 µs) : 421, 462
.   : milestone, 442,
iast_TELEMETRY_OFF (465.366 µs) : 444, 486
.   : milestone, 465,
tracing (442.596 µs) : 420, 465
.   : milestone, 443,
section candidate
no_agent (368.108 µs) : 348, 388
.   : milestone, 368,
iast (480.911 µs) : 460, 502
.   : milestone, 481,
iast_FULL (549.532 µs) : 528, 571
.   : milestone, 550,
iast_GLOBAL (502.558 µs) : 481, 524
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (481.979 µs) : 461, 503
.   : milestone, 482,
iast_INACTIVE (446.3 µs) : 425, 468
.   : milestone, 446,
iast_TELEMETRY_OFF (468.286 µs) : 447, 490
.   : milestone, 468,
tracing (442.356 µs) : 421, 464
.   : milestone, 442,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.04 µs [348.533 µs, 387.547 µs] -
iast 486.607 µs [464.801 µs, 508.413 µs] 118.567 µs (32.2%)
iast_FULL 549.251 µs [528.108 µs, 570.395 µs] 181.211 µs (49.2%)
iast_GLOBAL 511.053 µs [488.807 µs, 533.298 µs] 143.012 µs (38.9%)
iast_HARDCODED_SECRET_DISABLED 486.554 µs [465.159 µs, 507.949 µs] 118.513 µs (32.2%)
iast_INACTIVE 441.934 µs [421.376 µs, 462.491 µs] 73.894 µs (20.1%)
iast_TELEMETRY_OFF 465.366 µs [444.258 µs, 486.473 µs] 97.325 µs (26.4%)
tracing 442.596 µs [419.878 µs, 465.314 µs] 74.556 µs (20.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.108 µs [348.213 µs, 388.004 µs] -
iast 480.911 µs [459.771 µs, 502.051 µs] 112.803 µs (30.6%)
iast_FULL 549.532 µs [528.272 µs, 570.793 µs] 181.424 µs (49.3%)
iast_GLOBAL 502.558 µs [480.996 µs, 524.121 µs] 134.45 µs (36.5%)
iast_HARDCODED_SECRET_DISABLED 481.979 µs [460.672 µs, 503.286 µs] 113.871 µs (30.9%)
iast_INACTIVE 446.3 µs [425.02 µs, 467.581 µs] 78.192 µs (21.2%)
iast_TELEMETRY_OFF 468.286 µs [446.833 µs, 489.738 µs] 100.177 µs (27.2%)
tracing 442.356 µs [420.745 µs, 463.966 µs] 74.247 µs (20.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7736
git_commit_date 1729065190 1729068479
git_commit_sha f74856b 0b14c1e
release_version 1.41.0-SNAPSHOT~f74856b0fd 1.41.0-SNAPSHOT~0b14c1edb4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1729070521 1729070521
ci_job_id 673582205 673582205
ci_pipeline_id 46692714 46692714
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.327 ms) : 2286, 2368
.   : milestone, 2327,
iast (2.087 ms) : 2035, 2138
.   : milestone, 2087,
iast_GLOBAL (2.12 ms) : 2068, 2173
.   : milestone, 2120,
profiling (1.926 ms) : 1885, 1967
.   : milestone, 1926,
tracing (1.926 ms) : 1886, 1965
.   : milestone, 1926,
section candidate
no_agent (1.475 ms) : 1463, 1487
.   : milestone, 1475,
appsec (2.328 ms) : 2288, 2369
.   : milestone, 2328,
iast (2.076 ms) : 2024, 2127
.   : milestone, 2076,
iast_GLOBAL (2.117 ms) : 2066, 2169
.   : milestone, 2117,
profiling (1.931 ms) : 1889, 1973
.   : milestone, 1931,
tracing (1.93 ms) : 1890, 1969
.   : milestone, 1930,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.327 ms [2.286 ms, 2.368 ms] 858.482 µs (58.5%)
iast 2.087 ms [2.035 ms, 2.138 ms] 618.041 µs (42.1%)
iast_GLOBAL 2.12 ms [2.068 ms, 2.173 ms] 651.744 µs (44.4%)
profiling 1.926 ms [1.885 ms, 1.967 ms] 457.425 µs (31.1%)
tracing 1.926 ms [1.886 ms, 1.965 ms] 457.145 µs (31.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.487 ms] -
appsec 2.328 ms [2.288 ms, 2.369 ms] 853.92 µs (57.9%)
iast 2.076 ms [2.024 ms, 2.127 ms] 601.217 µs (40.8%)
iast_GLOBAL 2.117 ms [2.066 ms, 2.169 ms] 642.929 µs (43.6%)
profiling 1.931 ms [1.889 ms, 1.973 ms] 456.535 µs (31.0%)
tracing 1.93 ms [1.89 ms, 1.969 ms] 455.087 µs (30.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~0b14c1edb4, baseline=1.41.0-SNAPSHOT~f74856b0fd
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
appsec (15.316 s) : 15316000, 15316000
.   : milestone, 15316000,
iast (19.083 s) : 19083000, 19083000
.   : milestone, 19083000,
iast_GLOBAL (18.293 s) : 18293000, 18293000
.   : milestone, 18293000,
profiling (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
tracing (15.329 s) : 15329000, 15329000
.   : milestone, 15329000,
section candidate
no_agent (15.077 s) : 15077000, 15077000
.   : milestone, 15077000,
appsec (15.353 s) : 15353000, 15353000
.   : milestone, 15353000,
iast (19.133 s) : 19133000, 19133000
.   : milestone, 19133000,
iast_GLOBAL (17.888 s) : 17888000, 17888000
.   : milestone, 17888000,
profiling (15.151 s) : 15151000, 15151000
.   : milestone, 15151000,
tracing (15.303 s) : 15303000, 15303000
.   : milestone, 15303000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.149 s [15.149 s, 15.149 s] -
appsec 15.316 s [15.316 s, 15.316 s] 167.0 ms (1.1%)
iast 19.083 s [19.083 s, 19.083 s] 3.934 s (26.0%)
iast_GLOBAL 18.293 s [18.293 s, 18.293 s] 3.144 s (20.8%)
profiling 15.005 s [15.005 s, 15.005 s] -144.0 ms (-1.0%)
tracing 15.329 s [15.329 s, 15.329 s] 180.0 ms (1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.077 s [15.077 s, 15.077 s] -
appsec 15.353 s [15.353 s, 15.353 s] 276.0 ms (1.8%)
iast 19.133 s [19.133 s, 19.133 s] 4.056 s (26.9%)
iast_GLOBAL 17.888 s [17.888 s, 17.888 s] 2.811 s (18.6%)
profiling 15.151 s [15.151 s, 15.151 s] 74.0 ms (0.5%)
tracing 15.303 s [15.303 s, 15.303 s] 226.0 ms (1.5%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review October 16, 2024 09:37
@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 0bf75a3 into release/v1.40.x Oct 16, 2024
94 of 98 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/backport-pr-7736 branch October 16, 2024 09:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@anmarchenko anmarchenko Awaiting requested review from anmarchenko anmarchenko is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility
Projects
None yet
Milestone
1.40.2
Development

Successfully merging this pull request may close these issues.
3 participants
@nikita-tkachenko-datadog @smola @manuel-alvarez-alvarez