Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rename the DebuggerProbe to TriggerProbe #7737

Merged
merged 1 commit into from
Oct 7, 2024
Merged

Conversation

evanchooly
Copy link
Contributor

@evanchooly evanchooly commented Oct 4, 2024

What Does This Do

Renames the DebuggerProbe to TriggerProbe and updates all references accordingly.

Contributor Checklist

Jira ticket: DEBUG-2952

@evanchooly evanchooly added the comp: debugger Dynamic Instrumentation label Oct 4, 2024
@@ -226,7 +226,7 @@ public Configuration.Builder add(Collection<? extends ProbeDefinition> definitio
}
for (ProbeDefinition definition : definitions) {
if (definition instanceof MetricProbe) add((MetricProbe) definition);
if (definition instanceof DebuggerProbe) add((DebuggerProbe) definition);
if (definition instanceof TriggerProbe) add((TriggerProbe) definition);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Quality Violation

Suggested change
if (definition instanceof TriggerProbe) add((TriggerProbe) definition);
if (definition instanceof TriggerProbe) {add((TriggerProbe) definition)};
single if statement should be wrapped in a brace (...read more)

Omitting braces {} is valid in multiple statements, such as, for loops, if statements, and while loops. However, enforcing the use of control braces throughout your codebase will make the code more consistent and can make it easier to add statements in the future.

View in Datadog  Leave us feedback  Documentation

@@ -161,7 +161,7 @@ public void commit(PollingRateHinter pollingRateHinter) {

static class DefinitionBuilder {
private final Collection<ProbeDefinition> definitions = new ArrayList<>();
private int debuggerProbeCount = 0;
private int triggerProbeCount = 0;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Code Quality Violation

Suggested change
private int triggerProbeCount = 0;
private int triggerProbeCount;
Remove initialization, this is already the default value. (...read more)

When initializing fields, prevent initializing fields to the default value. Any additional initialization means more bytecode instructions, and allocating many of these objects may impact your application performance.

If you initialize to a default value, remove the initialization.

View in Datadog  Leave us feedback  Documentation

@pr-commenter
Copy link

pr-commenter bot commented Oct 4, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1728068252 1728068627
end_time 2024-10-04T18:58:47 2024-10-04T19:05:02
git_branch master evanchooly/DEBUG-2952
git_commit_sha fd84e8c addfed4
start_time 2024-10-04T18:57:33 2024-10-04T19:03:48
See matching parameters
Baseline Candidate
ci_job_id 662344400 662344400
ci_pipeline_id 45871133 45871133
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1728067589 1728067589

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+775.719µs; +853.242µs] or [+7.665%; +8.431%]
worse
[+779.162µs; +881.309µs] or [+7.574%; +8.567%]
worse
[+746.407µs; +882.851µs] or [+7.185%; +8.499%]
worse
[+617.151µs; +1037.003µs] or [+5.744%; +9.652%]
worse
[-8.190op/s; -5.420op/s] or [-8.558%; -5.664%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-23301.986ns; +24572.893ns] or [-8.845%; +9.328%]
unstable
[-35728.191ns; +37651.538ns] or [-11.830%; +12.467%]
unstable
[-48508.059ns; +48627.952ns] or [-15.333%; +15.371%]
unstable
[-97163.011ns; +98763.631ns] or [-16.382%; +16.652%]
same
scenario:basic unsure
[+0.805µs; +14.241µs] or [+0.301%; +5.320%]
same same unstable
[-63.296µs; +39.402µs] or [-11.201%; +6.973%]
unstable
[-203.233op/s; +68.280op/s] or [-7.723%; +2.595%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (302.001 µs) : 264, 340
.   : milestone, 302,
basic (296.534 µs) : 285, 308
.   : milestone, 297,
loop (10.287 ms) : 10251, 10323
.   : milestone, 10287,
section candidate
noprobe (302.963 µs) : 272, 334
.   : milestone, 303,
basic (307.121 µs) : 298, 316
.   : milestone, 307,
loop (11.118 ms) : 11061, 11174
.   : milestone, 11118,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 302.001 µs [263.753 µs, 340.25 µs]
basic 296.534 µs [284.815 µs, 308.254 µs]
loop 10.287 ms [10.251 ms, 10.323 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 302.963 µs [271.553 µs, 334.373 µs]
basic 307.121 µs [297.819 µs, 316.424 µs]
loop 11.118 ms [11.061 ms, 11.174 ms]

@pr-commenter
Copy link

pr-commenter bot commented Oct 4, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/DEBUG-2952
git_commit_date 1728056864 1728067589
git_commit_sha fd84e8c addfed4
release_version 1.41.0-SNAPSHOT~fd84e8c84a 1.41.0-SNAPSHOT~addfed4906
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1728069970 1728069970
ci_job_id 662344389 662344389
ci_pipeline_id 45871133 45871133
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1074342
Total [baseline] (10.379 s) : 0, 10379491
Agent [candidate] (1.067 s) : 0, 1067132
Total [candidate] (10.417 s) : 0, 10417452
section appsec
Agent [baseline] (1.201 s) : 0, 1200523
Total [baseline] (10.645 s) : 0, 10644581
Agent [candidate] (1.2 s) : 0, 1199721
Total [candidate] (10.579 s) : 0, 10579428
section iast
Agent [baseline] (1.196 s) : 0, 1195542
Total [baseline] (10.836 s) : 0, 10836022
Agent [candidate] (1.204 s) : 0, 1203748
Total [candidate] (10.85 s) : 0, 10850006
section profiling
Agent [baseline] (1.267 s) : 0, 1266888
Total [baseline] (10.604 s) : 0, 10603606
Agent [candidate] (1.275 s) : 0, 1275461
Total [candidate] (10.629 s) : 0, 10629427
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.201 s 126.181 ms (11.7%)
Agent iast 1.196 s 121.2 ms (11.3%)
Agent profiling 1.267 s 192.546 ms (17.9%)
Total tracing 10.379 s -
Total appsec 10.645 s 265.09 ms (2.6%)
Total iast 10.836 s 456.531 ms (4.4%)
Total profiling 10.604 s 224.115 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.2 s 132.589 ms (12.4%)
Agent iast 1.204 s 136.617 ms (12.8%)
Agent profiling 1.275 s 208.329 ms (19.5%)
Total tracing 10.417 s -
Total appsec 10.579 s 161.977 ms (1.6%)
Total iast 10.85 s 432.554 ms (4.2%)
Total profiling 10.629 s 211.975 ms (2.0%)
gantt
    title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.446 ms) : 0, 685446
BytebuddyAgent [candidate] (680.823 ms) : 0, 680823
GlobalTracer [baseline] (312.562 ms) : 0, 312562
GlobalTracer [candidate] (310.705 ms) : 0, 310705
AppSec [baseline] (54.247 ms) : 0, 54247
AppSec [candidate] (53.679 ms) : 0, 53679
Remote Config [baseline] (664.059 µs) : 0, 664
Remote Config [candidate] (662.749 µs) : 0, 663
Telemetry [baseline] (7.664 ms) : 0, 7664
Telemetry [candidate] (7.604 ms) : 0, 7604
section appsec
BytebuddyAgent [baseline] (697.728 ms) : 0, 697728
BytebuddyAgent [candidate] (697.57 ms) : 0, 697570
GlobalTracer [baseline] (307.501 ms) : 0, 307501
GlobalTracer [candidate] (307.519 ms) : 0, 307519
AppSec [baseline] (160.988 ms) : 0, 160988
AppSec [candidate] (161.727 ms) : 0, 161727
Remote Config [baseline] (638.956 µs) : 0, 639
Remote Config [candidate] (642.163 µs) : 0, 642
Telemetry [baseline] (8.151 ms) : 0, 8151
Telemetry [candidate] (8.208 ms) : 0, 8208
IAST [baseline] (23.719 ms) : 0, 23719
IAST [candidate] (20.833 ms) : 0, 20833
section iast
BytebuddyAgent [baseline] (796.285 ms) : 0, 796285
BytebuddyAgent [candidate] (801.997 ms) : 0, 801997
GlobalTracer [baseline] (300.012 ms) : 0, 300012
GlobalTracer [candidate] (301.275 ms) : 0, 301275
AppSec [baseline] (56.637 ms) : 0, 56637
AppSec [candidate] (54.322 ms) : 0, 54322
Remote Config [baseline] (611.224 µs) : 0, 611
Remote Config [candidate] (609.932 µs) : 0, 610
Telemetry [baseline] (7.131 ms) : 0, 7131
Telemetry [candidate] (7.827 ms) : 0, 7827
IAST [baseline] (21.183 ms) : 0, 21183
IAST [candidate] (23.942 ms) : 0, 23942
section profiling
BytebuddyAgent [baseline] (675.151 ms) : 0, 675151
BytebuddyAgent [candidate] (680.127 ms) : 0, 680127
GlobalTracer [baseline] (393.343 ms) : 0, 393343
GlobalTracer [candidate] (396.274 ms) : 0, 396274
AppSec [baseline] (54.824 ms) : 0, 54824
AppSec [candidate] (54.897 ms) : 0, 54897
Remote Config [baseline] (657.05 µs) : 0, 657
Remote Config [candidate] (658.907 µs) : 0, 659
Telemetry [baseline] (7.446 ms) : 0, 7446
Telemetry [candidate] (7.501 ms) : 0, 7501
ProfilingAgent [baseline] (96.857 ms) : 0, 96857
ProfilingAgent [candidate] (97.137 ms) : 0, 97137
Profiling [baseline] (96.881 ms) : 0, 96881
Profiling [candidate] (97.16 ms) : 0, 97160
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1075980
Total [baseline] (8.56 s) : 0, 8559676
Agent [candidate] (1.067 s) : 0, 1067043
Total [candidate] (8.572 s) : 0, 8572395
section iast
Agent [baseline] (1.196 s) : 0, 1195794
Total [baseline] (9.065 s) : 0, 9065093
Agent [candidate] (1.203 s) : 0, 1203336
Total [candidate] (9.092 s) : 0, 9091605
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.197 s) : 0, 1197459
Total [baseline] (9.099 s) : 0, 9099196
Agent [candidate] (1.201 s) : 0, 1200714
Total [candidate] (9.102 s) : 0, 9101998
section iast_TELEMETRY_OFF
Agent [baseline] (1.201 s) : 0, 1200511
Total [baseline] (9.095 s) : 0, 9095152
Agent [candidate] (1.199 s) : 0, 1199470
Total [candidate] (9.085 s) : 0, 9084773
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent iast 1.196 s 119.814 ms (11.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.197 s 121.479 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.201 s 124.531 ms (11.6%)
Total tracing 8.56 s -
Total iast 9.065 s 505.418 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.099 s 539.521 ms (6.3%)
Total iast_TELEMETRY_OFF 9.095 s 535.477 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.203 s 136.293 ms (12.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.201 s 133.67 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.199 s 132.427 ms (12.4%)
Total tracing 8.572 s -
Total iast 9.092 s 519.21 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.102 s 529.603 ms (6.2%)
Total iast_TELEMETRY_OFF 9.085 s 512.378 ms (6.0%)
gantt
    title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.837 ms) : 0, 686837
BytebuddyAgent [candidate] (681.033 ms) : 0, 681033
GlobalTracer [baseline] (313.064 ms) : 0, 313064
GlobalTracer [candidate] (310.378 ms) : 0, 310378
AppSec [baseline] (53.921 ms) : 0, 53921
AppSec [candidate] (53.75 ms) : 0, 53750
Remote Config [baseline] (690.864 µs) : 0, 691
Remote Config [candidate] (664.482 µs) : 0, 664
Telemetry [baseline] (7.674 ms) : 0, 7674
Telemetry [candidate] (7.567 ms) : 0, 7567
section iast
BytebuddyAgent [baseline] (796.849 ms) : 0, 796849
BytebuddyAgent [candidate] (801.96 ms) : 0, 801960
GlobalTracer [baseline] (299.781 ms) : 0, 299781
GlobalTracer [candidate] (301.167 ms) : 0, 301167
AppSec [baseline] (55.061 ms) : 0, 55061
AppSec [candidate] (54.149 ms) : 0, 54149
Remote Config [baseline] (602.741 µs) : 0, 603
Remote Config [candidate] (611.318 µs) : 0, 611
Telemetry [baseline] (7.072 ms) : 0, 7072
Telemetry [candidate] (7.057 ms) : 0, 7057
IAST [baseline] (22.685 ms) : 0, 22685
IAST [candidate] (24.576 ms) : 0, 24576
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (796.867 ms) : 0, 796867
BytebuddyAgent [candidate] (800.03 ms) : 0, 800030
GlobalTracer [baseline] (300.821 ms) : 0, 300821
GlobalTracer [candidate] (300.403 ms) : 0, 300403
AppSec [baseline] (56.314 ms) : 0, 56314
AppSec [candidate] (54.336 ms) : 0, 54336
Remote Config [baseline] (616.639 µs) : 0, 617
Remote Config [candidate] (613.188 µs) : 0, 613
Telemetry [baseline] (7.07 ms) : 0, 7070
Telemetry [candidate] (7.112 ms) : 0, 7112
IAST [baseline] (22.006 ms) : 0, 22006
IAST [candidate] (24.387 ms) : 0, 24387
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.849 ms) : 0, 798849
BytebuddyAgent [candidate] (797.704 ms) : 0, 797704
GlobalTracer [baseline] (301.834 ms) : 0, 301834
GlobalTracer [candidate] (301.63 ms) : 0, 301630
AppSec [baseline] (55.643 ms) : 0, 55643
AppSec [candidate] (55.584 ms) : 0, 55584
Remote Config [baseline] (629.202 µs) : 0, 629
Remote Config [candidate] (614.63 µs) : 0, 615
Telemetry [baseline] (7.099 ms) : 0, 7099
Telemetry [candidate] (6.919 ms) : 0, 6919
IAST [baseline] (22.648 ms) : 0, 22648
IAST [candidate] (23.246 ms) : 0, 23246
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-04T18:56:38 2024-10-04T19:03:30
git_branch master evanchooly/DEBUG-2952
git_commit_date 1728056864 1728067589
git_commit_sha fd84e8c addfed4
release_version 1.41.0-SNAPSHOT~fd84e8c84a 1.41.0-SNAPSHOT~addfed4906
start_time 2024-10-04T18:56:25 2024-10-04T19:03:16
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1728068955 1728068955
ci_job_id 662344390 662344390
ci_pipeline_id 45871133 45871133
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-98.794µs; -46.046µs] or [-6.460%; -3.011%]
unstable
[-598.044op/s; +598.044op/s] or [-19.436%; +19.436%]
1.457ms 3076.923op/s 1.529ms 3076.923op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1374
.   : milestone, 1355,
appsec (1.739 ms) : 1716, 1763
.   : milestone, 1739,
appsec_no_iast (1.714 ms) : 1690, 1738
.   : milestone, 1714,
iast (1.476 ms) : 1454, 1499
.   : milestone, 1476,
profiling (1.529 ms) : 1503, 1555
.   : milestone, 1529,
tracing (1.465 ms) : 1441, 1489
.   : milestone, 1465,
section candidate
no_agent (1.33 ms) : 1309, 1351
.   : milestone, 1330,
appsec (1.721 ms) : 1697, 1746
.   : milestone, 1721,
appsec_no_iast (1.729 ms) : 1706, 1753
.   : milestone, 1729,
iast (1.467 ms) : 1445, 1490
.   : milestone, 1467,
profiling (1.457 ms) : 1434, 1480
.   : milestone, 1457,
tracing (1.485 ms) : 1461, 1509
.   : milestone, 1485,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.374 ms] -
appsec 1.739 ms [1.716 ms, 1.763 ms] 384.804 µs (28.4%)
appsec_no_iast 1.714 ms [1.69 ms, 1.738 ms] 359.35 µs (26.5%)
iast 1.476 ms [1.454 ms, 1.499 ms] 121.868 µs (9.0%)
profiling 1.529 ms [1.503 ms, 1.555 ms] 174.692 µs (12.9%)
tracing 1.465 ms [1.441 ms, 1.489 ms] 110.234 µs (8.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.33 ms [1.309 ms, 1.351 ms] -
appsec 1.721 ms [1.697 ms, 1.746 ms] 391.215 µs (29.4%)
appsec_no_iast 1.729 ms [1.706 ms, 1.753 ms] 399.17 µs (30.0%)
iast 1.467 ms [1.445 ms, 1.49 ms] 137.295 µs (10.3%)
profiling 1.457 ms [1.434 ms, 1.48 ms] 126.702 µs (9.5%)
tracing 1.485 ms [1.461 ms, 1.509 ms] 155.059 µs (11.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.378 µs) : 349, 390
.   : milestone, 369,
iast (481.671 µs) : 460, 503
.   : milestone, 482,
iast_FULL (551.338 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (503.272 µs) : 482, 524
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (486.256 µs) : 465, 508
.   : milestone, 486,
iast_INACTIVE (444.026 µs) : 424, 465
.   : milestone, 444,
iast_TELEMETRY_OFF (471.609 µs) : 450, 493
.   : milestone, 472,
tracing (434.25 µs) : 414, 455
.   : milestone, 434,
section candidate
no_agent (372.409 µs) : 350, 395
.   : milestone, 372,
iast (480.695 µs) : 460, 502
.   : milestone, 481,
iast_FULL (556.669 µs) : 535, 578
.   : milestone, 557,
iast_GLOBAL (508.346 µs) : 487, 530
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (489.578 µs) : 468, 511
.   : milestone, 490,
iast_INACTIVE (443.374 µs) : 423, 464
.   : milestone, 443,
iast_TELEMETRY_OFF (467.963 µs) : 447, 489
.   : milestone, 468,
tracing (445.396 µs) : 425, 466
.   : milestone, 445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.378 µs [349.105 µs, 389.65 µs] -
iast 481.671 µs [460.42 µs, 502.922 µs] 112.293 µs (30.4%)
iast_FULL 551.338 µs [530.287 µs, 572.389 µs] 181.961 µs (49.3%)
iast_GLOBAL 503.272 µs [482.298 µs, 524.245 µs] 133.894 µs (36.2%)
iast_HARDCODED_SECRET_DISABLED 486.256 µs [464.813 µs, 507.7 µs] 116.879 µs (31.6%)
iast_INACTIVE 444.026 µs [423.514 µs, 464.537 µs] 74.648 µs (20.2%)
iast_TELEMETRY_OFF 471.609 µs [450.107 µs, 493.111 µs] 102.232 µs (27.7%)
tracing 434.25 µs [413.821 µs, 454.678 µs] 64.872 µs (17.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.409 µs [349.964 µs, 394.855 µs] -
iast 480.695 µs [459.546 µs, 501.843 µs] 108.285 µs (29.1%)
iast_FULL 556.669 µs [534.986 µs, 578.351 µs] 184.259 µs (49.5%)
iast_GLOBAL 508.346 µs [486.75 µs, 529.941 µs] 135.936 µs (36.5%)
iast_HARDCODED_SECRET_DISABLED 489.578 µs [468.449 µs, 510.707 µs] 117.169 µs (31.5%)
iast_INACTIVE 443.374 µs [422.967 µs, 463.782 µs] 70.965 µs (19.1%)
iast_TELEMETRY_OFF 467.963 µs [446.886 µs, 489.04 µs] 95.554 µs (25.7%)
tracing 445.396 µs [424.59 µs, 466.202 µs] 72.987 µs (19.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/DEBUG-2952
git_commit_date 1728056864 1728067589
git_commit_sha fd84e8c addfed4
release_version 1.41.0-SNAPSHOT~fd84e8c84a 1.41.0-SNAPSHOT~addfed4906
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1728069499 1728069499
ci_job_id 662344392 662344392
ci_pipeline_id 45871133 45871133
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.071 s) : 15071000, 15071000
.   : milestone, 15071000,
appsec (15.15 s) : 15150000, 15150000
.   : milestone, 15150000,
iast (19.011 s) : 19011000, 19011000
.   : milestone, 19011000,
iast_GLOBAL (17.878 s) : 17878000, 17878000
.   : milestone, 17878000,
profiling (15.567 s) : 15567000, 15567000
.   : milestone, 15567000,
tracing (15.224 s) : 15224000, 15224000
.   : milestone, 15224000,
section candidate
no_agent (15.568 s) : 15568000, 15568000
.   : milestone, 15568000,
appsec (14.875 s) : 14875000, 14875000
.   : milestone, 14875000,
iast (18.982 s) : 18982000, 18982000
.   : milestone, 18982000,
iast_GLOBAL (18.097 s) : 18097000, 18097000
.   : milestone, 18097000,
profiling (15.234 s) : 15234000, 15234000
.   : milestone, 15234000,
tracing (15.212 s) : 15212000, 15212000
.   : milestone, 15212000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.071 s [15.071 s, 15.071 s] -
appsec 15.15 s [15.15 s, 15.15 s] 79.0 ms (0.5%)
iast 19.011 s [19.011 s, 19.011 s] 3.94 s (26.1%)
iast_GLOBAL 17.878 s [17.878 s, 17.878 s] 2.807 s (18.6%)
profiling 15.567 s [15.567 s, 15.567 s] 496.0 ms (3.3%)
tracing 15.224 s [15.224 s, 15.224 s] 153.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.568 s [15.568 s, 15.568 s] -
appsec 14.875 s [14.875 s, 14.875 s] -693.0 ms (-4.5%)
iast 18.982 s [18.982 s, 18.982 s] 3.414 s (21.9%)
iast_GLOBAL 18.097 s [18.097 s, 18.097 s] 2.529 s (16.2%)
profiling 15.234 s [15.234 s, 15.234 s] -334.0 ms (-2.1%)
tracing 15.212 s [15.212 s, 15.212 s] -356.0 ms (-2.3%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~addfed4906, baseline=1.41.0-SNAPSHOT~fd84e8c84a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.465 ms) : 1453, 1476
.   : milestone, 1465,
appsec (2.309 ms) : 2268, 2350
.   : milestone, 2309,
iast (2.067 ms) : 2015, 2119
.   : milestone, 2067,
iast_GLOBAL (2.117 ms) : 2065, 2170
.   : milestone, 2117,
profiling (1.929 ms) : 1888, 1970
.   : milestone, 1929,
tracing (1.9 ms) : 1861, 1938
.   : milestone, 1900,
section candidate
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.324 ms) : 2282, 2365
.   : milestone, 2324,
iast (2.068 ms) : 2016, 2120
.   : milestone, 2068,
iast_GLOBAL (2.108 ms) : 2055, 2160
.   : milestone, 2108,
profiling (1.926 ms) : 1884, 1968
.   : milestone, 1926,
tracing (1.906 ms) : 1867, 1945
.   : milestone, 1906,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.453 ms, 1.476 ms] -
appsec 2.309 ms [2.268 ms, 2.35 ms] 844.571 µs (57.7%)
iast 2.067 ms [2.015 ms, 2.119 ms] 602.417 µs (41.1%)
iast_GLOBAL 2.117 ms [2.065 ms, 2.17 ms] 652.634 µs (44.6%)
profiling 1.929 ms [1.888 ms, 1.97 ms] 464.698 µs (31.7%)
tracing 1.9 ms [1.861 ms, 1.938 ms] 434.877 µs (29.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 2.324 ms [2.282 ms, 2.365 ms] 857.202 µs (58.5%)
iast 2.068 ms [2.016 ms, 2.12 ms] 601.265 µs (41.0%)
iast_GLOBAL 2.108 ms [2.055 ms, 2.16 ms] 641.157 µs (43.7%)
profiling 1.926 ms [1.884 ms, 1.968 ms] 459.725 µs (31.4%)
tracing 1.906 ms [1.867 ms, 1.945 ms] 439.442 µs (30.0%)

@evanchooly evanchooly marked this pull request as ready for review October 7, 2024 13:25
@evanchooly evanchooly requested a review from a team as a code owner October 7, 2024 13:25
@evanchooly evanchooly merged commit 4a82413 into master Oct 7, 2024
107 checks passed
@evanchooly evanchooly deleted the evanchooly/DEBUG-2952 branch October 7, 2024 13:26
@github-actions github-actions bot added this to the 1.41.0 milestone Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: debugger Dynamic Instrumentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants