Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[🍒 7915] Bump ddprof to 1.17.0 #7917

Merged
merged 1 commit into from
Nov 8, 2024
Merged

[🍒 7915] Bump ddprof to 1.17.0 #7917

merged 1 commit into from
Nov 8, 2024

Conversation

jbachorik
Copy link
Contributor

Backport #7915 to release/v1.42.x

@jbachorik
Bump ddprof to 1.17.0
2b90bed 
Required to pull in DataDog/java-profiler#150

(cherry picked from commit 49067b0)
@jbachorik jbachorik requested a review from a team as a code owner November 8, 2024 09:45
@jbachorik jbachorik requested a review from amarziali November 8, 2024 09:45
@jbachorik jbachorik added tag: dependencies Dependencies related changes comp: profiling Profiling labels Nov 8, 2024
@jbachorik jbachorik added this to the 1.42.1 milestone Nov 8, 2024
@pr-commenter
Copy link

pr-commenter bot commented Nov 8, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1731059685 1731060064
end_time 2024-11-08T09:56:00 2024-11-08T10:02:19
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_sha 864879a 2b90bed
start_time 2024-11-08T09:54:46 2024-11-08T10:01:05
See matching parameters
Baseline Candidate
ci_job_id 700245326 700245326
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1731059112 1731059112

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+422.678µs; +513.872µs] or [+4.094%; +4.978%]		 worse
[+411.284µs; +529.184µs] or [+3.918%; +5.042%]		 worse
[+377.227µs; +518.820µs] or [+3.567%; +4.906%]		 worse
[+307.872µs; +888.567µs] or [+2.811%; +8.114%]		 worse
[-4.604op/s; -3.080op/s] or [-4.881%; -3.264%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-25.040µs; +15.014µs] or [-9.467%; +5.677%]		 unstable
[-41.838µs; +19.463µs] or [-13.764%; +6.403%]		 unstable
[-56.363µs; +28.694µs] or [-17.697%; +9.009%]		 unstable
[-110.267µs; +85.373µs] or [-17.916%; +13.871%]		 same
scenario:basic unsure
[+1.165µs; +11.470µs] or [+0.429%; +4.220%]		 same same unstable
[-35.676µs; +60.547µs] or [-6.646%; +11.279%]		 unstable
[-171.405op/s; +171.405op/s] or [-6.685%; +6.685%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (303.961 µs) : 269, 339
.   : milestone, 304,
basic (297.865 µs) : 290, 306
.   : milestone, 298,
loop (10.497 ms) : 10428, 10565
.   : milestone, 10497,
section candidate
noprobe (292.774 µs) : 271, 315
.   : milestone, 293,
basic (304.037 µs) : 295, 313
.   : milestone, 304,
loop (10.967 ms) : 10931, 11003
.   : milestone, 10967,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 303.961 µs [268.902 µs, 339.021 µs]
basic 297.865 µs [289.95 µs, 305.781 µs]
loop 10.497 ms [10.428 ms, 10.565 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 292.774 µs [270.857 µs, 314.691 µs]
basic 304.037 µs [295.023 µs, 313.051 µs]
loop 10.967 ms [10.931 ms, 11.003 ms]

@pr-commenter
Copy link

pr-commenter bot commented Nov 8, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_date 1731059125 1731059112
git_commit_sha 864879a 2b90bed
release_version 1.43.0-SNAPSHOT~864879a988 1.43.0-SNAPSHOT~2b90bed8d6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731061530 1731061530
ci_job_id 700245320 700245320
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1077426
Total [baseline] (10.338 s) : 0, 10337950
Agent [candidate] (1.08 s) : 0, 1079634
Total [candidate] (10.331 s) : 0, 10330561
section appsec
Agent [baseline] (1.214 s) : 0, 1213557
Total [baseline] (10.623 s) : 0, 10622540
Agent [candidate] (1.215 s) : 0, 1214620
Total [candidate] (10.643 s) : 0, 10643234
section iast
Agent [baseline] (1.204 s) : 0, 1203990
Total [baseline] (10.841 s) : 0, 10840512
Agent [candidate] (1.208 s) : 0, 1208159
Total [candidate] (10.846 s) : 0, 10845816
section profiling
Agent [baseline] (1.281 s) : 0, 1280757
Total [baseline] (10.627 s) : 0, 10626809
Agent [candidate] (1.287 s) : 0, 1287156
Total [candidate] (10.743 s) : 0, 10743098
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent appsec 1.214 s 136.131 ms (12.6%)
Agent iast 1.204 s 126.564 ms (11.7%)
Agent profiling 1.281 s 203.331 ms (18.9%)
Total tracing 10.338 s -
Total appsec 10.623 s 284.59 ms (2.8%)
Total iast 10.841 s 502.562 ms (4.9%)
Total profiling 10.627 s 288.859 ms (2.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.215 s 134.986 ms (12.5%)
Agent iast 1.208 s 128.525 ms (11.9%)
Agent profiling 1.287 s 207.522 ms (19.2%)
Total tracing 10.331 s -
Total appsec 10.643 s 312.672 ms (3.0%)
Total iast 10.846 s 515.255 ms (5.0%)
Total profiling 10.743 s 412.537 ms (4.0%) 
gantt
    title petclinic - break down per module: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.932 ms) : 0, 684932
BytebuddyAgent [candidate] (687.049 ms) : 0, 687049
GlobalTracer [baseline] (314.336 ms) : 0, 314336
GlobalTracer [candidate] (316.428 ms) : 0, 316428
AppSec [baseline] (53.964 ms) : 0, 53964
AppSec [candidate] (54.032 ms) : 0, 54032
Remote Config [baseline] (676.246 µs) : 0, 676
Remote Config [candidate] (673.038 µs) : 0, 673
Telemetry [baseline] (9.891 ms) : 0, 9891
Telemetry [candidate] (7.796 ms) : 0, 7796
section appsec
BytebuddyAgent [baseline] (703.136 ms) : 0, 703136
BytebuddyAgent [candidate] (703.222 ms) : 0, 703222
GlobalTracer [baseline] (312.327 ms) : 0, 312327
GlobalTracer [candidate] (313.215 ms) : 0, 313215
AppSec [baseline] (166.372 ms) : 0, 166372
AppSec [candidate] (165.866 ms) : 0, 165866
IAST [baseline] (18.687 ms) : 0, 18687
IAST [candidate] (19.849 ms) : 0, 19849
Remote Config [baseline] (628.728 µs) : 0, 629
Remote Config [candidate] (637.293 µs) : 0, 637
Telemetry [baseline] (8.133 ms) : 0, 8133
Telemetry [candidate] (8.093 ms) : 0, 8093
section iast
BytebuddyAgent [baseline] (800.168 ms) : 0, 800168
BytebuddyAgent [candidate] (803.362 ms) : 0, 803362
GlobalTracer [baseline] (304.358 ms) : 0, 304358
GlobalTracer [candidate] (305.084 ms) : 0, 305084
AppSec [baseline] (57.252 ms) : 0, 57252
AppSec [candidate] (56.683 ms) : 0, 56683
IAST [baseline] (20.501 ms) : 0, 20501
IAST [candidate] (21.301 ms) : 0, 21301
Remote Config [baseline] (606.746 µs) : 0, 607
Remote Config [candidate] (594.922 µs) : 0, 595
Telemetry [baseline] (7.467 ms) : 0, 7467
Telemetry [candidate] (7.395 ms) : 0, 7395
section profiling
BytebuddyAgent [baseline] (685.194 ms) : 0, 685194
BytebuddyAgent [candidate] (685.896 ms) : 0, 685896
GlobalTracer [baseline] (397.931 ms) : 0, 397931
GlobalTracer [candidate] (401.401 ms) : 0, 401401
AppSec [baseline] (54.452 ms) : 0, 54452
AppSec [candidate] (54.942 ms) : 0, 54942
Remote Config [baseline] (663.159 µs) : 0, 663
Remote Config [candidate] (675.868 µs) : 0, 676
Telemetry [baseline] (10.614 ms) : 0, 10614
Telemetry [candidate] (12.07 ms) : 0, 12070
ProfilingAgent [baseline] (92.824 ms) : 0, 92824
ProfilingAgent [candidate] (93.02 ms) : 0, 93020
Profiling [baseline] (92.848 ms) : 0, 92848
Profiling [candidate] (93.044 ms) : 0, 93044
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1079366
Total [baseline] (8.557 s) : 0, 8556878
Agent [candidate] (1.082 s) : 0, 1081588
Total [candidate] (8.525 s) : 0, 8524789
section iast
Agent [baseline] (1.203 s) : 0, 1203392
Total [baseline] (9.156 s) : 0, 9156227
Agent [candidate] (1.222 s) : 0, 1221776
Total [candidate] (9.122 s) : 0, 9122133
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.204 s) : 0, 1203619
Total [baseline] (9.089 s) : 0, 9088788
Agent [candidate] (1.21 s) : 0, 1210490
Total [candidate] (9.096 s) : 0, 9095673
section iast_TELEMETRY_OFF
Agent [baseline] (1.205 s) : 0, 1205245
Total [baseline] (9.103 s) : 0, 9103485
Agent [candidate] (1.2 s) : 0, 1200117
Total [candidate] (9.103 s) : 0, 9102502
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.203 s 124.026 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.204 s 124.253 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.205 s 125.879 ms (11.7%)
Total tracing 8.557 s -
Total iast 9.156 s 599.349 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.089 s 531.91 ms (6.2%)
Total iast_TELEMETRY_OFF 9.103 s 546.607 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent iast 1.222 s 140.188 ms (13.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.21 s 128.903 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.2 s 118.529 ms (11.0%)
Total tracing 8.525 s -
Total iast 9.122 s 597.344 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.096 s 570.884 ms (6.7%)
Total iast_TELEMETRY_OFF 9.103 s 577.714 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.441 ms) : 0, 686441
BytebuddyAgent [candidate] (685.855 ms) : 0, 685855
GlobalTracer [baseline] (315.181 ms) : 0, 315181
GlobalTracer [candidate] (315.518 ms) : 0, 315518
AppSec [baseline] (54.108 ms) : 0, 54108
AppSec [candidate] (53.951 ms) : 0, 53951
Remote Config [baseline] (679.751 µs) : 0, 680
Remote Config [candidate] (670.438 µs) : 0, 670
Telemetry [baseline] (9.274 ms) : 0, 9274
Telemetry [candidate] (11.878 ms) : 0, 11878
section iast
BytebuddyAgent [baseline] (799.939 ms) : 0, 799939
BytebuddyAgent [candidate] (815.933 ms) : 0, 815933
GlobalTracer [baseline] (303.83 ms) : 0, 303830
GlobalTracer [candidate] (306.515 ms) : 0, 306515
AppSec [baseline] (57.164 ms) : 0, 57164
AppSec [candidate] (56.103 ms) : 0, 56103
IAST [baseline] (20.632 ms) : 0, 20632
IAST [candidate] (21.203 ms) : 0, 21203
Remote Config [baseline] (618.005 µs) : 0, 618
Remote Config [candidate] (613.918 µs) : 0, 614
Telemetry [baseline] (7.55 ms) : 0, 7550
Telemetry [candidate] (7.445 ms) : 0, 7445
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (799.754 ms) : 0, 799754
BytebuddyAgent [candidate] (803.204 ms) : 0, 803204
GlobalTracer [baseline] (303.979 ms) : 0, 303979
GlobalTracer [candidate] (306.858 ms) : 0, 306858
AppSec [baseline] (56.627 ms) : 0, 56627
AppSec [candidate] (57.204 ms) : 0, 57204
IAST [baseline] (21.565 ms) : 0, 21565
IAST [candidate] (21.329 ms) : 0, 21329
Remote Config [baseline] (624.507 µs) : 0, 625
Remote Config [candidate] (614.738 µs) : 0, 615
Telemetry [baseline] (7.442 ms) : 0, 7442
Telemetry [candidate] (7.528 ms) : 0, 7528
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.801 ms) : 0, 801801
BytebuddyAgent [candidate] (796.523 ms) : 0, 796523
GlobalTracer [baseline] (304.134 ms) : 0, 304134
GlobalTracer [candidate] (304.033 ms) : 0, 304033
AppSec [baseline] (57.526 ms) : 0, 57526
AppSec [candidate] (57.571 ms) : 0, 57571
IAST [baseline] (20.094 ms) : 0, 20094
IAST [candidate] (20.317 ms) : 0, 20317
Remote Config [baseline] (595.893 µs) : 0, 596
Remote Config [candidate] (596.009 µs) : 0, 596
Telemetry [baseline] (7.367 ms) : 0, 7367
Telemetry [candidate] (7.407 ms) : 0, 7407
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-08T09:55:57 2024-11-08T10:02:53
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_date 1731059125 1731059112
git_commit_sha 864879a 2b90bed
release_version 1.43.0-SNAPSHOT~864879a988 1.43.0-SNAPSHOT~2b90bed8d6
start_time 2024-11-08T09:55:43 2024-11-08T10:02:40
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731060525 1731060525
ci_job_id 700245321 700245321
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.68 µs) : 359, 398
.   : milestone, 379,
iast (495.721 µs) : 474, 517
.   : milestone, 496,
iast_FULL (651.647 µs) : 630, 673
.   : milestone, 652,
iast_GLOBAL (514.523 µs) : 493, 536
.   : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (500.641 µs) : 479, 522
.   : milestone, 501,
iast_INACTIVE (461.256 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (488.934 µs) : 467, 511
.   : milestone, 489,
tracing (453.324 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (380.108 µs) : 360, 400
.   : milestone, 380,
iast (493.378 µs) : 472, 514
.   : milestone, 493,
iast_FULL (651.527 µs) : 630, 673
.   : milestone, 652,
iast_GLOBAL (520.226 µs) : 499, 542
.   : milestone, 520,
iast_HARDCODED_SECRET_DISABLED (501.615 µs) : 480, 523
.   : milestone, 502,
iast_INACTIVE (457.452 µs) : 436, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (480.647 µs) : 459, 502
.   : milestone, 481,
tracing (453.727 µs) : 432, 475
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.68 µs [359.081 µs, 398.278 µs] -
iast 495.721 µs [474.267 µs, 517.176 µs] 117.041 µs (30.9%)
iast_FULL 651.647 µs [630.188 µs, 673.107 µs] 272.968 µs (72.1%)
iast_GLOBAL 514.523 µs [493.361 µs, 535.685 µs] 135.844 µs (35.9%)
iast_HARDCODED_SECRET_DISABLED 500.641 µs [479.14 µs, 522.142 µs] 121.961 µs (32.2%)
iast_INACTIVE 461.256 µs [439.512 µs, 482.999 µs] 82.576 µs (21.8%)
iast_TELEMETRY_OFF 488.934 µs [467.078 µs, 510.79 µs] 110.254 µs (29.1%)
tracing 453.324 µs [432.445 µs, 474.203 µs] 74.644 µs (19.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.108 µs [360.462 µs, 399.753 µs] -
iast 493.378 µs [472.387 µs, 514.37 µs] 113.271 µs (29.8%)
iast_FULL 651.527 µs [630.089 µs, 672.964 µs] 271.419 µs (71.4%)
iast_GLOBAL 520.226 µs [498.638 µs, 541.813 µs] 140.118 µs (36.9%)
iast_HARDCODED_SECRET_DISABLED 501.615 µs [479.878 µs, 523.353 µs] 121.508 µs (32.0%)
iast_INACTIVE 457.452 µs [435.944 µs, 478.961 µs] 77.345 µs (20.3%)
iast_TELEMETRY_OFF 480.647 µs [459.385 µs, 501.91 µs] 100.54 µs (26.5%)
tracing 453.727 µs [432.434 µs, 475.021 µs] 73.62 µs (19.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1365
.   : milestone, 1345,
appsec (1.752 ms) : 1729, 1775
.   : milestone, 1752,
appsec_no_iast (1.74 ms) : 1716, 1764
.   : milestone, 1740,
iast (1.47 ms) : 1448, 1493
.   : milestone, 1470,
profiling (1.479 ms) : 1456, 1502
.   : milestone, 1479,
tracing (1.475 ms) : 1451, 1499
.   : milestone, 1475,
section candidate
no_agent (1.352 ms) : 1332, 1371
.   : milestone, 1352,
appsec (1.741 ms) : 1718, 1765
.   : milestone, 1741,
appsec_no_iast (1.749 ms) : 1725, 1773
.   : milestone, 1749,
iast (1.505 ms) : 1482, 1527
.   : milestone, 1505,
profiling (1.495 ms) : 1471, 1518
.   : milestone, 1495,
tracing (1.469 ms) : 1445, 1494
.   : milestone, 1469,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.326 ms, 1.365 ms] -
appsec 1.752 ms [1.729 ms, 1.775 ms] 406.809 µs (30.2%)
appsec_no_iast 1.74 ms [1.716 ms, 1.764 ms] 394.79 µs (29.3%)
iast 1.47 ms [1.448 ms, 1.493 ms] 124.891 µs (9.3%)
profiling 1.479 ms [1.456 ms, 1.502 ms] 133.599 µs (9.9%)
tracing 1.475 ms [1.451 ms, 1.499 ms] 129.651 µs (9.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.332 ms, 1.371 ms] -
appsec 1.741 ms [1.718 ms, 1.765 ms] 389.67 µs (28.8%)
appsec_no_iast 1.749 ms [1.725 ms, 1.773 ms] 397.131 µs (29.4%)
iast 1.505 ms [1.482 ms, 1.527 ms] 152.829 µs (11.3%)
profiling 1.495 ms [1.471 ms, 1.518 ms] 143.011 µs (10.6%)
tracing 1.469 ms [1.445 ms, 1.494 ms] 117.709 µs (8.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_date 1731059125 1731059112
git_commit_sha 864879a 2b90bed
release_version 1.43.0-SNAPSHOT~864879a988 1.43.0-SNAPSHOT~2b90bed8d6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1731060940 1731060940
ci_job_id 700245322 700245322
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.35 ms) : 2308, 2392
.   : milestone, 2350,
iast (2.076 ms) : 2024, 2129
.   : milestone, 2076,
iast_GLOBAL (2.114 ms) : 2062, 2166
.   : milestone, 2114,
profiling (2.405 ms) : 2231, 2579
.   : milestone, 2405,
tracing (1.912 ms) : 1872, 1951
.   : milestone, 1912,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.346 ms) : 2305, 2388
.   : milestone, 2346,
iast (2.079 ms) : 2027, 2131
.   : milestone, 2079,
iast_GLOBAL (2.125 ms) : 2072, 2177
.   : milestone, 2125,
profiling (1.942 ms) : 1900, 1984
.   : milestone, 1942,
tracing (1.92 ms) : 1880, 1961
.   : milestone, 1920,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.35 ms [2.308 ms, 2.392 ms] 875.984 µs (59.4%)
iast 2.076 ms [2.024 ms, 2.129 ms] 602.064 µs (40.8%)
iast_GLOBAL 2.114 ms [2.062 ms, 2.166 ms] 639.797 µs (43.4%)
profiling 2.405 ms [2.231 ms, 2.579 ms] 930.428 µs (63.1%)
tracing 1.912 ms [1.872 ms, 1.951 ms] 437.452 µs (29.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.346 ms [2.305 ms, 2.388 ms] 877.16 µs (59.7%)
iast 2.079 ms [2.027 ms, 2.131 ms] 610.21 µs (41.5%)
iast_GLOBAL 2.125 ms [2.072 ms, 2.177 ms] 655.953 µs (44.7%)
profiling 1.942 ms [1.9 ms, 1.984 ms] 472.979 µs (32.2%)
tracing 1.92 ms [1.88 ms, 1.961 ms] 451.272 µs (30.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.37 s) : 15370000, 15370000
.   : milestone, 15370000,
appsec (15.467 s) : 15467000, 15467000
.   : milestone, 15467000,
iast (18.866 s) : 18866000, 18866000
.   : milestone, 18866000,
iast_GLOBAL (17.705 s) : 17705000, 17705000
.   : milestone, 17705000,
profiling (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
tracing (15.309 s) : 15309000, 15309000
.   : milestone, 15309000,
section candidate
no_agent (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
appsec (15.297 s) : 15297000, 15297000
.   : milestone, 15297000,
iast (18.529 s) : 18529000, 18529000
.   : milestone, 18529000,
iast_GLOBAL (18.473 s) : 18473000, 18473000
.   : milestone, 18473000,
profiling (15.214 s) : 15214000, 15214000
.   : milestone, 15214000,
tracing (15.384 s) : 15384000, 15384000
.   : milestone, 15384000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.37 s [15.37 s, 15.37 s] -
appsec 15.467 s [15.467 s, 15.467 s] 97.0 ms (0.6%)
iast 18.866 s [18.866 s, 18.866 s] 3.496 s (22.7%)
iast_GLOBAL 17.705 s [17.705 s, 17.705 s] 2.335 s (15.2%)
profiling 15.018 s [15.018 s, 15.018 s] -352.0 ms (-2.3%)
tracing 15.309 s [15.309 s, 15.309 s] -61.0 ms (-0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.105 s [15.105 s, 15.105 s] -
appsec 15.297 s [15.297 s, 15.297 s] 192.0 ms (1.3%)
iast 18.529 s [18.529 s, 18.529 s] 3.424 s (22.7%)
iast_GLOBAL 18.473 s [18.473 s, 18.473 s] 3.368 s (22.3%)
profiling 15.214 s [15.214 s, 15.214 s] 109.0 ms (0.7%)
tracing 15.384 s [15.384 s, 15.384 s] 279.0 ms (1.8%)

@jbachorik jbachorik merged commit df0ec27 into release/v1.42.x Nov 8, 2024
99 of 101 checks passed
@jbachorik jbachorik deleted the jaroslav.bachorik/backport-pr-7915 branch November 8, 2024 13:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

@richardstartin richardstartin Awaiting requested review from richardstartin

Assignees
No one assigned
Labels
comp: profiling Profiling tag: dependencies Dependencies related changes type: bug
Projects
None yet
Milestone
1.42.1
Development

Successfully merging this pull request may close these issues.
2 participants
@jbachorik @PerfectSlayer