Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Gradle dependencies #8248

Open
wants to merge 47 commits into
base: master
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Jan 19, 2025
@github-actions github-actions bot requested review from a team as code owners January 19, 2025 04:21
@github-actions github-actions bot requested review from smola, sezen-datadog, cimi and tonyredondo and removed request for a team January 19, 2025 04:21
@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1737261297 1737261669
end_time 2025-01-19T04:36:14 2025-01-19T04:42:25
git_branch master ci/update-gradle-dependencies-20250119
git_commit_sha 0b239ae d5c232c
start_time 2025-01-19T04:34:58 2025-01-19T04:41:10
See matching parameters
Baseline Candidate
ci_job_id 772007071 772007071
ci_pipeline_id 53421325 53421325
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1737260429 1737260429

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+528.508µs; +592.184µs] or [+5.291%; +5.928%]
worse
[+515.847µs; +611.062µs] or [+5.080%; +6.018%]
worse
[+485.469µs; +606.377µs] or [+4.736%; +5.915%]
worse
[+411.965µs; +761.676µs] or [+3.893%; +7.198%]
worse
[-6.199op/s; -4.591op/s] or [-6.354%; -4.706%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-15.774µs; +28.593µs] or [-5.973%; +10.828%]
unstable
[-25.224µs; +41.624µs] or [-8.351%; +13.781%]
unstable
[-34.158µs; +54.005µs] or [-10.844%; +17.145%]
unstable
[-99.534µs; +81.462µs] or [-16.567%; +13.559%]
same
scenario:basic same same same unstable
[-48.531µs; +37.194µs] or [-8.855%; +6.786%]
unstable
[-130.765op/s; +130.765op/s] or [-5.231%; +5.231%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (302.045 µs) : 280, 324
.   : milestone, 302,
basic (315.153 µs) : 307, 324
.   : milestone, 315,
loop (10.154 ms) : 10115, 10194
.   : milestone, 10154,
section candidate
noprobe (310.245 µs) : 271, 350
.   : milestone, 310,
basic (310.723 µs) : 302, 320
.   : milestone, 311,
loop (10.718 ms) : 10670, 10766
.   : milestone, 10718,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 302.045 µs [280.051 µs, 324.039 µs]
basic 315.153 µs [306.706 µs, 323.6 µs]
loop 10.154 ms [10.115 ms, 10.194 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 310.245 µs [270.908 µs, 349.582 µs]
basic 310.723 µs [301.901 µs, 319.544 µs]
loop 10.718 ms [10.67 ms, 10.766 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737139405 1737260447
git_commit_sha 0b239ae 571cc29
release_version 1.46.0-SNAPSHOT~0b239ae5cc 1.46.0-SNAPSHOT~571cc29a44
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737263134 1737263134
ci_job_id 772007866 772007866
ci_pipeline_id 53421339 53421339
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057500
Total [baseline] (10.484 s) : 0, 10483742
Agent [candidate] (1.055 s) : 0, 1055273
Total [candidate] (10.465 s) : 0, 10465468
section appsec
Agent [baseline] (1.188 s) : 0, 1188053
Total [baseline] (10.703 s) : 0, 10702602
Agent [candidate] (1.19 s) : 0, 1189874
Total [candidate] (10.717 s) : 0, 10717177
section iast
Agent [baseline] (1.182 s) : 0, 1181875
Total [baseline] (11.01 s) : 0, 11010443
Agent [candidate] (1.181 s) : 0, 1180748
Total [candidate] (10.979 s) : 0, 10979167
section profiling
Agent [baseline] (1.253 s) : 0, 1252917
Total [baseline] (10.823 s) : 0, 10823384
Agent [candidate] (1.269 s) : 0, 1268585
Total [candidate] (10.829 s) : 0, 10829410
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.188 s 130.553 ms (12.3%)
Agent iast 1.182 s 124.375 ms (11.8%)
Agent profiling 1.253 s 195.417 ms (18.5%)
Total tracing 10.484 s -
Total appsec 10.703 s 218.861 ms (2.1%)
Total iast 11.01 s 526.701 ms (5.0%)
Total profiling 10.823 s 339.643 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.19 s 134.6 ms (12.8%)
Agent iast 1.181 s 125.474 ms (11.9%)
Agent profiling 1.269 s 213.312 ms (20.2%)
Total tracing 10.465 s -
Total appsec 10.717 s 251.709 ms (2.4%)
Total iast 10.979 s 513.699 ms (4.9%)
Total profiling 10.829 s 363.942 ms (3.5%)
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.503 ms) : 0, 716503
BytebuddyAgent [candidate] (713.406 ms) : 0, 713406
GlobalTracer [baseline] (256.455 ms) : 0, 256455
GlobalTracer [candidate] (255.65 ms) : 0, 255650
AppSec [baseline] (55.834 ms) : 0, 55834
AppSec [candidate] (55.31 ms) : 0, 55310
Remote Config [baseline] (737.744 µs) : 0, 738
Remote Config [candidate] (737.529 µs) : 0, 738
Telemetry [baseline] (12.864 ms) : 0, 12864
Telemetry [candidate] (15.189 ms) : 0, 15189
section appsec
BytebuddyAgent [baseline] (730.442 ms) : 0, 730442
BytebuddyAgent [candidate] (731.481 ms) : 0, 731481
GlobalTracer [baseline] (252.836 ms) : 0, 252836
GlobalTracer [candidate] (253.021 ms) : 0, 253021
AppSec [baseline] (171.303 ms) : 0, 171303
AppSec [candidate] (171.255 ms) : 0, 171255
Remote Config [baseline] (667.921 µs) : 0, 668
Remote Config [candidate] (668.942 µs) : 0, 669
Telemetry [baseline] (8.178 ms) : 0, 8178
Telemetry [candidate] (8.592 ms) : 0, 8592
IAST [baseline] (19.303 ms) : 0, 19303
IAST [candidate] (19.609 ms) : 0, 19609
section iast
BytebuddyAgent [baseline] (831.479 ms) : 0, 831479
BytebuddyAgent [candidate] (830.975 ms) : 0, 830975
GlobalTracer [baseline] (246.428 ms) : 0, 246428
GlobalTracer [candidate] (246.115 ms) : 0, 246115
AppSec [baseline] (57.811 ms) : 0, 57811
AppSec [candidate] (57.682 ms) : 0, 57682
Remote Config [baseline] (665.065 µs) : 0, 665
Remote Config [candidate] (663.724 µs) : 0, 664
Telemetry [baseline] (8.859 ms) : 0, 8859
Telemetry [candidate] (8.81 ms) : 0, 8810
IAST [baseline] (21.55 ms) : 0, 21550
IAST [candidate] (21.463 ms) : 0, 21463
section profiling
ProfilingAgent [baseline] (95.06 ms) : 0, 95060
ProfilingAgent [candidate] (97.056 ms) : 0, 97056
BytebuddyAgent [baseline] (702.641 ms) : 0, 702641
BytebuddyAgent [candidate] (709.282 ms) : 0, 709282
GlobalTracer [baseline] (349.044 ms) : 0, 349044
GlobalTracer [candidate] (355.187 ms) : 0, 355187
AppSec [baseline] (54.795 ms) : 0, 54795
AppSec [candidate] (54.898 ms) : 0, 54898
Remote Config [baseline] (701.015 µs) : 0, 701
Remote Config [candidate] (724.391 µs) : 0, 724
Telemetry [baseline] (8.781 ms) : 0, 8781
Telemetry [candidate] (9.022 ms) : 0, 9022
Profiling [baseline] (95.084 ms) : 0, 95084
Profiling [candidate] (97.081 ms) : 0, 97081
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060644
Total [baseline] (8.636 s) : 0, 8635774
Agent [candidate] (1.062 s) : 0, 1061909
Total [candidate] (8.607 s) : 0, 8607105
section iast
Agent [baseline] (1.184 s) : 0, 1183622
Total [baseline] (9.17 s) : 0, 9170341
Agent [candidate] (1.183 s) : 0, 1183079
Total [candidate] (9.196 s) : 0, 9196363
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.181 s) : 0, 1181094
Total [baseline] (9.196 s) : 0, 9196299
Agent [candidate] (1.184 s) : 0, 1183784
Total [candidate] (9.182 s) : 0, 9181574
section iast_TELEMETRY_OFF
Agent [baseline] (1.177 s) : 0, 1177481
Total [baseline] (9.221 s) : 0, 9220661
Agent [candidate] (1.19 s) : 0, 1189532
Total [candidate] (9.224 s) : 0, 9224337
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.184 s 122.979 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.181 s 120.451 ms (11.4%)
Agent iast_TELEMETRY_OFF 1.177 s 116.837 ms (11.0%)
Total tracing 8.636 s -
Total iast 9.17 s 534.567 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.196 s 560.525 ms (6.5%)
Total iast_TELEMETRY_OFF 9.221 s 584.887 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.183 s 121.17 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 121.875 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.19 s 127.624 ms (12.0%)
Total tracing 8.607 s -
Total iast 9.196 s 589.258 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.182 s 574.469 ms (6.7%)
Total iast_TELEMETRY_OFF 9.224 s 617.232 ms (7.2%)
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.169 ms) : 0, 717169
BytebuddyAgent [candidate] (717.65 ms) : 0, 717650
GlobalTracer [baseline] (257.199 ms) : 0, 257199
GlobalTracer [candidate] (257.484 ms) : 0, 257484
AppSec [baseline] (57.283 ms) : 0, 57283
AppSec [candidate] (57.427 ms) : 0, 57427
Remote Config [baseline] (742.97 µs) : 0, 743
Remote Config [candidate] (755.31 µs) : 0, 755
Telemetry [baseline] (13.119 ms) : 0, 13119
Telemetry [candidate] (13.554 ms) : 0, 13554
section iast
BytebuddyAgent [baseline] (832.878 ms) : 0, 832878
BytebuddyAgent [candidate] (831.925 ms) : 0, 831925
GlobalTracer [baseline] (246.7 ms) : 0, 246700
GlobalTracer [candidate] (246.847 ms) : 0, 246847
AppSec [baseline] (58.085 ms) : 0, 58085
AppSec [candidate] (58.131 ms) : 0, 58131
Remote Config [baseline] (660.42 µs) : 0, 660
Remote Config [candidate] (670.291 µs) : 0, 670
Telemetry [baseline] (8.809 ms) : 0, 8809
Telemetry [candidate] (8.833 ms) : 0, 8833
IAST [baseline] (21.512 ms) : 0, 21512
IAST [candidate] (21.669 ms) : 0, 21669
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (829.819 ms) : 0, 829819
BytebuddyAgent [candidate] (831.904 ms) : 0, 831904
GlobalTracer [baseline] (246.727 ms) : 0, 246727
GlobalTracer [candidate] (247.406 ms) : 0, 247406
AppSec [baseline] (58.271 ms) : 0, 58271
AppSec [candidate] (58.235 ms) : 0, 58235
Remote Config [baseline] (673.181 µs) : 0, 673
Remote Config [candidate] (679.299 µs) : 0, 679
Telemetry [baseline] (8.926 ms) : 0, 8926
Telemetry [candidate] (8.878 ms) : 0, 8878
IAST [baseline] (21.682 ms) : 0, 21682
IAST [candidate] (21.66 ms) : 0, 21660
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (827.873 ms) : 0, 827873
BytebuddyAgent [candidate] (835.823 ms) : 0, 835823
GlobalTracer [baseline] (246.569 ms) : 0, 246569
GlobalTracer [candidate] (248.755 ms) : 0, 248755
AppSec [baseline] (57.94 ms) : 0, 57940
AppSec [candidate] (58.822 ms) : 0, 58822
Remote Config [baseline] (668.205 µs) : 0, 668
Remote Config [candidate] (686.649 µs) : 0, 687
Telemetry [baseline] (8.593 ms) : 0, 8593
Telemetry [candidate] (8.888 ms) : 0, 8888
IAST [baseline] (20.825 ms) : 0, 20825
IAST [candidate] (21.412 ms) : 0, 21412
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-19T04:35:51 2025-01-19T04:42:54
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737139405 1737260447
git_commit_sha 0b239ae 571cc29
release_version 1.46.0-SNAPSHOT~0b239ae5cc 1.46.0-SNAPSHOT~571cc29a44
start_time 2025-01-19T04:35:37 2025-01-19T04:42:40
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737262132 1737262132
ci_job_id 772007867 772007867
ci_pipeline_id 53421339 53421339
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.363 ms) : 1344, 1383
.   : milestone, 1363,
appsec (1.763 ms) : 1738, 1787
.   : milestone, 1763,
appsec_no_iast (1.76 ms) : 1736, 1784
.   : milestone, 1760,
iast (1.504 ms) : 1479, 1528
.   : milestone, 1504,
profiling (1.522 ms) : 1497, 1547
.   : milestone, 1522,
tracing (1.49 ms) : 1465, 1514
.   : milestone, 1490,
section candidate
no_agent (1.351 ms) : 1332, 1371
.   : milestone, 1351,
appsec (1.756 ms) : 1731, 1780
.   : milestone, 1756,
appsec_no_iast (1.746 ms) : 1722, 1770
.   : milestone, 1746,
iast (1.516 ms) : 1492, 1541
.   : milestone, 1516,
profiling (1.518 ms) : 1495, 1541
.   : milestone, 1518,
tracing (1.505 ms) : 1481, 1529
.   : milestone, 1505,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.363 ms [1.344 ms, 1.383 ms] -
appsec 1.763 ms [1.738 ms, 1.787 ms] 399.247 µs (29.3%)
appsec_no_iast 1.76 ms [1.736 ms, 1.784 ms] 396.378 µs (29.1%)
iast 1.504 ms [1.479 ms, 1.528 ms] 140.068 µs (10.3%)
profiling 1.522 ms [1.497 ms, 1.547 ms] 158.789 µs (11.6%)
tracing 1.49 ms [1.465 ms, 1.514 ms] 126.227 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.332 ms, 1.371 ms] -
appsec 1.756 ms [1.731 ms, 1.78 ms] 404.616 µs (29.9%)
appsec_no_iast 1.746 ms [1.722 ms, 1.77 ms] 394.889 µs (29.2%)
iast 1.516 ms [1.492 ms, 1.541 ms] 165.34 µs (12.2%)
profiling 1.518 ms [1.495 ms, 1.541 ms] 166.854 µs (12.3%)
tracing 1.505 ms [1.481 ms, 1.529 ms] 154.09 µs (11.4%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.898 µs) : 359, 399
.   : milestone, 379,
iast (506.427 µs) : 485, 528
.   : milestone, 506,
iast_FULL (742.315 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (554.619 µs) : 533, 576
.   : milestone, 555,
iast_HARDCODED_SECRET_DISABLED (510.184 µs) : 489, 532
.   : milestone, 510,
iast_INACTIVE (463.994 µs) : 442, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (494.416 µs) : 473, 516
.   : milestone, 494,
tracing (451.942 µs) : 431, 472
.   : milestone, 452,
section candidate
no_agent (379.218 µs) : 359, 399
.   : milestone, 379,
iast (508.285 µs) : 487, 530
.   : milestone, 508,
iast_FULL (745.017 µs) : 723, 767
.   : milestone, 745,
iast_GLOBAL (551.124 µs) : 529, 573
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (512.854 µs) : 491, 535
.   : milestone, 513,
iast_INACTIVE (463.996 µs) : 443, 485
.   : milestone, 464,
iast_TELEMETRY_OFF (498.93 µs) : 477, 521
.   : milestone, 499,
tracing (448.766 µs) : 428, 470
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.898 µs [358.771 µs, 399.025 µs] -
iast 506.427 µs [484.985 µs, 527.868 µs] 127.529 µs (33.7%)
iast_FULL 742.315 µs [720.341 µs, 764.289 µs] 363.417 µs (95.9%)
iast_GLOBAL 554.619 µs [532.926 µs, 576.311 µs] 175.72 µs (46.4%)
iast_HARDCODED_SECRET_DISABLED 510.184 µs [488.53 µs, 531.839 µs] 131.286 µs (34.6%)
iast_INACTIVE 463.994 µs [442.273 µs, 485.715 µs] 85.096 µs (22.5%)
iast_TELEMETRY_OFF 494.416 µs [472.883 µs, 515.949 µs] 115.518 µs (30.5%)
tracing 451.942 µs [431.44 µs, 472.444 µs] 73.044 µs (19.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.218 µs [359.423 µs, 399.012 µs] -
iast 508.285 µs [486.559 µs, 530.011 µs] 129.067 µs (34.0%)
iast_FULL 745.017 µs [723.169 µs, 766.864 µs] 365.799 µs (96.5%)
iast_GLOBAL 551.124 µs [529.419 µs, 572.828 µs] 171.906 µs (45.3%)
iast_HARDCODED_SECRET_DISABLED 512.854 µs [491.09 µs, 534.619 µs] 133.637 µs (35.2%)
iast_INACTIVE 463.996 µs [442.615 µs, 485.377 µs] 84.778 µs (22.4%)
iast_TELEMETRY_OFF 498.93 µs [477.043 µs, 520.818 µs] 119.713 µs (31.6%)
tracing 448.766 µs [427.784 µs, 469.748 µs] 69.548 µs (18.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737139405 1737260447
git_commit_sha 0b239ae 571cc29
release_version 1.46.0-SNAPSHOT~0b239ae5cc 1.46.0-SNAPSHOT~571cc29a44
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737262554 1737262554
ci_job_id 772007868 772007868
ci_pipeline_id 53421339 53421339
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.373 ms) : 2330, 2416
.   : milestone, 2373,
iast (2.121 ms) : 2067, 2176
.   : milestone, 2121,
iast_GLOBAL (2.156 ms) : 2101, 2210
.   : milestone, 2156,
profiling (1.995 ms) : 1950, 2039
.   : milestone, 1995,
tracing (1.951 ms) : 1909, 1992
.   : milestone, 1951,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.374 ms) : 2331, 2417
.   : milestone, 2374,
iast (2.109 ms) : 2055, 2164
.   : milestone, 2109,
iast_GLOBAL (2.163 ms) : 2108, 2218
.   : milestone, 2163,
profiling (1.982 ms) : 1938, 2026
.   : milestone, 1982,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.373 ms [2.33 ms, 2.416 ms] 897.472 µs (60.8%)
iast 2.121 ms [2.067 ms, 2.176 ms] 645.471 µs (43.7%)
iast_GLOBAL 2.156 ms [2.101 ms, 2.21 ms] 679.925 µs (46.1%)
profiling 1.995 ms [1.95 ms, 2.039 ms] 518.794 µs (35.2%)
tracing 1.951 ms [1.909 ms, 1.992 ms] 474.818 µs (32.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.374 ms [2.331 ms, 2.417 ms] 900.761 µs (61.1%)
iast 2.109 ms [2.055 ms, 2.164 ms] 635.657 µs (43.1%)
iast_GLOBAL 2.163 ms [2.108 ms, 2.218 ms] 689.764 µs (46.8%)
profiling 1.982 ms [1.938 ms, 2.026 ms] 508.475 µs (34.5%)
tracing 1.95 ms [1.908 ms, 1.992 ms] 476.362 µs (32.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~571cc29a44, baseline=1.46.0-SNAPSHOT~0b239ae5cc
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.48 s) : 15480000, 15480000
.   : milestone, 15480000,
appsec (15.155 s) : 15155000, 15155000
.   : milestone, 15155000,
iast (18.82 s) : 18820000, 18820000
.   : milestone, 18820000,
iast_GLOBAL (18.264 s) : 18264000, 18264000
.   : milestone, 18264000,
profiling (15.604 s) : 15604000, 15604000
.   : milestone, 15604000,
tracing (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
section candidate
no_agent (15.517 s) : 15517000, 15517000
.   : milestone, 15517000,
appsec (15.093 s) : 15093000, 15093000
.   : milestone, 15093000,
iast (18.577 s) : 18577000, 18577000
.   : milestone, 18577000,
iast_GLOBAL (18.124 s) : 18124000, 18124000
.   : milestone, 18124000,
profiling (15.175 s) : 15175000, 15175000
.   : milestone, 15175000,
tracing (15.186 s) : 15186000, 15186000
.   : milestone, 15186000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.48 s [15.48 s, 15.48 s] -
appsec 15.155 s [15.155 s, 15.155 s] -325.0 ms (-2.1%)
iast 18.82 s [18.82 s, 18.82 s] 3.34 s (21.6%)
iast_GLOBAL 18.264 s [18.264 s, 18.264 s] 2.784 s (18.0%)
profiling 15.604 s [15.604 s, 15.604 s] 124.0 ms (0.8%)
tracing 15.051 s [15.051 s, 15.051 s] -429.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.517 s [15.517 s, 15.517 s] -
appsec 15.093 s [15.093 s, 15.093 s] -424.0 ms (-2.7%)
iast 18.577 s [18.577 s, 18.577 s] 3.06 s (19.7%)
iast_GLOBAL 18.124 s [18.124 s, 18.124 s] 2.607 s (16.8%)
profiling 15.175 s [15.175 s, 15.175 s] -342.0 ms (-2.2%)
tracing 15.186 s [15.186 s, 15.186 s] -331.0 ms (-2.1%)

@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737139405 1737260440
git_commit_sha 0b239ae 36dc9ec
See matching parameters
Baseline Candidate
ci_job_date 1737261766 1737261766
ci_job_id 772007573 772007573
ci_pipeline_id 53421332 53421332
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737139405 1737260470
git_commit_sha 0b239ae 619419b
See matching parameters
Baseline Candidate
ci_job_date 1737261808 1737261808
ci_job_id 772008447 772008447
ci_pipeline_id 53421347 53421347
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants