Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test new build image #7486

Closed
wants to merge 2 commits into from
Closed

Test new build image #7486

wants to merge 2 commits into from

Conversation

PerfectSlayer
Copy link
Contributor

What Does This Do

This PR tests new build image

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer added tag: do not merge Do not merge changes comp: tooling Build & Tooling labels Aug 21, 2024
@PerfectSlayer PerfectSlayer mentioned this pull request Aug 21, 2024
Merged
@pr-commenter
Copy link

pr-commenter bot commented Aug 21, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci-builder
git_commit_date 1724321531 1724329819
git_commit_sha 77c6fbe c5f0d44
release_version 1.39.0-SNAPSHOT~77c6fbe6b9 1.39.0-SNAPSHOT~c5f0d44f41
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724332244 1724332244
ci_job_id 613612752 613612752
ci_pipeline_id 42549263 42549263
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 45 metrics, 17 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:tracing:Remote Config worse
[+13.850µs; +52.798µs] or [+2.099%; +8.002%]		 693.152µs 659.828µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1046077
Total [baseline] (10.332 s) : 0, 10331633
Agent [candidate] (1.046 s) : 0, 1045915
Total [candidate] (10.432 s) : 0, 10432121
section appsec
Agent [baseline] (1.177 s) : 0, 1176638
Total [baseline] (10.509 s) : 0, 10509054
Agent [candidate] (1.174 s) : 0, 1173500
Total [candidate] (10.513 s) : 0, 10513262
section iast
Agent [baseline] (1.171 s) : 0, 1171259
Total [baseline] (10.78 s) : 0, 10779721
Agent [candidate] (1.181 s) : 0, 1181062
Total [candidate] (10.892 s) : 0, 10891957
section profiling
Agent [baseline] (1.241 s) : 0, 1241356
Total [baseline] (10.649 s) : 0, 10648791
Agent [candidate] (1.242 s) : 0, 1241502
Total [candidate] (10.648 s) : 0, 10648015
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.177 s 130.561 ms (12.5%)
Agent iast 1.171 s 125.182 ms (12.0%)
Agent profiling 1.241 s 195.279 ms (18.7%)
Total tracing 10.332 s -
Total appsec 10.509 s 177.422 ms (1.7%)
Total iast 10.78 s 448.088 ms (4.3%)
Total profiling 10.649 s 317.158 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.174 s 127.586 ms (12.2%)
Agent iast 1.181 s 135.147 ms (12.9%)
Agent profiling 1.242 s 195.587 ms (18.7%)
Total tracing 10.432 s -
Total appsec 10.513 s 81.141 ms (0.8%)
Total iast 10.892 s 459.836 ms (4.4%)
Total profiling 10.648 s 215.894 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.04 ms) : 0, 668040
BytebuddyAgent [candidate] (667.303 ms) : 0, 667303
GlobalTracer [baseline] (305.288 ms) : 0, 305288
GlobalTracer [candidate] (306.067 ms) : 0, 306067
AppSec [baseline] (51.182 ms) : 0, 51182
AppSec [candidate] (50.937 ms) : 0, 50937
Remote Config [baseline] (659.828 µs) : 0, 660
Remote Config [candidate] (693.152 µs) : 0, 693
Telemetry [baseline] (7.497 ms) : 0, 7497
Telemetry [candidate] (7.48 ms) : 0, 7480
section appsec
BytebuddyAgent [baseline] (683.997 ms) : 0, 683997
BytebuddyAgent [candidate] (681.296 ms) : 0, 681296
GlobalTracer [baseline] (301.77 ms) : 0, 301770
GlobalTracer [candidate] (300.774 ms) : 0, 300774
AppSec [baseline] (158.044 ms) : 0, 158044
AppSec [candidate] (157.364 ms) : 0, 157364
Remote Config [baseline] (617.458 µs) : 0, 617
Remote Config [candidate] (605.507 µs) : 0, 606
Telemetry [baseline] (9.084 ms) : 0, 9084
Telemetry [candidate] (9.722 ms) : 0, 9722
IAST [baseline] (19.165 ms) : 0, 19165
IAST [candidate] (20.398 ms) : 0, 20398
section iast
BytebuddyAgent [baseline] (777.814 ms) : 0, 777814
BytebuddyAgent [candidate] (785.266 ms) : 0, 785266
GlobalTracer [baseline] (295.364 ms) : 0, 295364
GlobalTracer [candidate] (298.627 ms) : 0, 298627
AppSec [baseline] (50.908 ms) : 0, 50908
AppSec [candidate] (53.396 ms) : 0, 53396
Remote Config [baseline] (598.621 µs) : 0, 599
Remote Config [candidate] (600.565 µs) : 0, 601
Telemetry [baseline] (11.061 ms) : 0, 11061
Telemetry [candidate] (7.161 ms) : 0, 7161
IAST [baseline] (22.036 ms) : 0, 22036
IAST [candidate] (22.488 ms) : 0, 22488
section profiling
BytebuddyAgent [baseline] (662.496 ms) : 0, 662496
BytebuddyAgent [candidate] (662.01 ms) : 0, 662010
GlobalTracer [baseline] (387.988 ms) : 0, 387988
GlobalTracer [candidate] (388.158 ms) : 0, 388158
AppSec [baseline] (52.325 ms) : 0, 52325
AppSec [candidate] (52.076 ms) : 0, 52076
Remote Config [baseline] (670.088 µs) : 0, 670
Remote Config [candidate] (683.212 µs) : 0, 683
Telemetry [baseline] (7.349 ms) : 0, 7349
Telemetry [candidate] (7.315 ms) : 0, 7315
ProfilingAgent [baseline] (93.536 ms) : 0, 93536
ProfilingAgent [candidate] (94.173 ms) : 0, 94173
Profiling [baseline] (93.56 ms) : 0, 93560
Profiling [candidate] (94.198 ms) : 0, 94198
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044917
Total [baseline] (8.523 s) : 0, 8523251
Agent [candidate] (1.055 s) : 0, 1055463
Total [candidate] (8.557 s) : 0, 8557359
section iast
Agent [baseline] (1.17 s) : 0, 1169939
Total [baseline] (8.947 s) : 0, 8947458
Agent [candidate] (1.182 s) : 0, 1182230
Total [candidate] (9.007 s) : 0, 9007398
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1179525
Total [baseline] (8.977 s) : 0, 8976733
Agent [candidate] (1.173 s) : 0, 1172781
Total [candidate] (8.972 s) : 0, 8972212
section iast_TELEMETRY_OFF
Agent [baseline] (1.177 s) : 0, 1176820
Total [baseline] (8.971 s) : 0, 8971252
Agent [candidate] (1.169 s) : 0, 1168601
Total [candidate] (8.974 s) : 0, 8973794
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.17 s 125.022 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 134.608 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.177 s 131.903 ms (12.6%)
Total tracing 8.523 s -
Total iast 8.947 s 424.207 ms (5.0%)
Total iast_HARDCODED_SECRET_DISABLED 8.977 s 453.482 ms (5.3%)
Total iast_TELEMETRY_OFF 8.971 s 448.002 ms (5.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.182 s 126.767 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 117.319 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.169 s 113.138 ms (10.7%)
Total tracing 8.557 s -
Total iast 9.007 s 450.04 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.972 s 414.854 ms (4.8%)
Total iast_TELEMETRY_OFF 8.974 s 416.435 ms (4.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.541 ms) : 0, 666541
BytebuddyAgent [candidate] (672.807 ms) : 0, 672807
GlobalTracer [baseline] (305.334 ms) : 0, 305334
GlobalTracer [candidate] (309.39 ms) : 0, 309390
AppSec [baseline] (51.562 ms) : 0, 51562
AppSec [candidate] (51.451 ms) : 0, 51451
Remote Config [baseline] (658.462 µs) : 0, 658
Remote Config [candidate] (691.284 µs) : 0, 691
Telemetry [baseline] (7.437 ms) : 0, 7437
Telemetry [candidate] (7.566 ms) : 0, 7566
section iast
BytebuddyAgent [baseline] (777.036 ms) : 0, 777036
BytebuddyAgent [candidate] (786.976 ms) : 0, 786976
GlobalTracer [baseline] (295.282 ms) : 0, 295282
GlobalTracer [candidate] (297.854 ms) : 0, 297854
AppSec [baseline] (52.7 ms) : 0, 52700
AppSec [candidate] (54.764 ms) : 0, 54764
IAST [baseline] (23.1 ms) : 0, 23100
IAST [candidate] (21.463 ms) : 0, 21463
Remote Config [baseline] (572.839 µs) : 0, 573
Remote Config [candidate] (556.332 µs) : 0, 556
Telemetry [baseline] (7.803 ms) : 0, 7803
Telemetry [candidate] (7.069 ms) : 0, 7069
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (783.622 ms) : 0, 783622
BytebuddyAgent [candidate] (780.84 ms) : 0, 780840
GlobalTracer [baseline] (297.341 ms) : 0, 297341
GlobalTracer [candidate] (295.975 ms) : 0, 295975
AppSec [baseline] (52.787 ms) : 0, 52787
AppSec [candidate] (48.591 ms) : 0, 48591
IAST [baseline] (23.616 ms) : 0, 23616
IAST [candidate] (23.64 ms) : 0, 23640
Remote Config [baseline] (590.241 µs) : 0, 590
Remote Config [candidate] (612.683 µs) : 0, 613
Telemetry [baseline] (8.033 ms) : 0, 8033
Telemetry [candidate] (9.61 ms) : 0, 9610
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (781.256 ms) : 0, 781256
BytebuddyAgent [candidate] (777.554 ms) : 0, 777554
GlobalTracer [baseline] (298.277 ms) : 0, 298277
GlobalTracer [candidate] (296.037 ms) : 0, 296037
AppSec [baseline] (51.265 ms) : 0, 51265
AppSec [candidate] (50.707 ms) : 0, 50707
IAST [baseline] (23.154 ms) : 0, 23154
IAST [candidate] (22.24 ms) : 0, 22240
Remote Config [baseline] (595.651 µs) : 0, 596
Remote Config [candidate] (635.454 µs) : 0, 635
Telemetry [baseline] (8.723 ms) : 0, 8723
Telemetry [candidate] (7.896 ms) : 0, 7896
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-22T12:41:28 2024-08-22T12:48:17
git_branch master bbujon/ci-builder
git_commit_date 1724321531 1724329819
git_commit_sha 77c6fbe c5f0d44
release_version 1.39.0-SNAPSHOT~77c6fbe6b9 1.39.0-SNAPSHOT~c5f0d44f41
start_time 2024-08-22T12:41:15 2024-08-22T12:48:04
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724331244 1724331244
ci_job_id 613612753 613612753
ci_pipeline_id 42549263 42549263
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.774 µs) : 350, 389
.   : milestone, 370,
iast (483.978 µs) : 462, 506
.   : milestone, 484,
iast_FULL (549.619 µs) : 528, 572
.   : milestone, 550,
iast_GLOBAL (513.874 µs) : 490, 537
.   : milestone, 514,
iast_HARDCODED_SECRET_DISABLED (485.536 µs) : 463, 508
.   : milestone, 486,
iast_INACTIVE (450.552 µs) : 430, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (472.62 µs) : 451, 494
.   : milestone, 473,
tracing (437.469 µs) : 417, 458
.   : milestone, 437,
section candidate
no_agent (368.731 µs) : 349, 388
.   : milestone, 369,
iast (488.995 µs) : 467, 511
.   : milestone, 489,
iast_FULL (552.028 µs) : 530, 575
.   : milestone, 552,
iast_GLOBAL (501.821 µs) : 480, 524
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (484.316 µs) : 463, 505
.   : milestone, 484,
iast_INACTIVE (451.278 µs) : 429, 473
.   : milestone, 451,
iast_TELEMETRY_OFF (480.518 µs) : 458, 503
.   : milestone, 481,
tracing (439.7 µs) : 419, 460
.   : milestone, 440,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.774 µs [350.107 µs, 389.441 µs] -
iast 483.978 µs [461.749 µs, 506.207 µs] 114.204 µs (30.9%)
iast_FULL 549.619 µs [527.67 µs, 571.568 µs] 179.845 µs (48.6%)
iast_GLOBAL 513.874 µs [490.436 µs, 537.312 µs] 144.1 µs (39.0%)
iast_HARDCODED_SECRET_DISABLED 485.536 µs [463.203 µs, 507.868 µs] 115.762 µs (31.3%)
iast_INACTIVE 450.552 µs [429.531 µs, 471.573 µs] 80.778 µs (21.8%)
iast_TELEMETRY_OFF 472.62 µs [451.319 µs, 493.922 µs] 102.846 µs (27.8%)
tracing 437.469 µs [417.343 µs, 457.594 µs] 67.695 µs (18.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.731 µs [349.177 µs, 388.285 µs] -
iast 488.995 µs [467.351 µs, 510.639 µs] 120.264 µs (32.6%)
iast_FULL 552.028 µs [529.519 µs, 574.537 µs] 183.297 µs (49.7%)
iast_GLOBAL 501.821 µs [479.964 µs, 523.678 µs] 133.09 µs (36.1%)
iast_HARDCODED_SECRET_DISABLED 484.316 µs [463.267 µs, 505.365 µs] 115.585 µs (31.3%)
iast_INACTIVE 451.278 µs [429.12 µs, 473.437 µs] 82.547 µs (22.4%)
iast_TELEMETRY_OFF 480.518 µs [457.834 µs, 503.202 µs] 111.787 µs (30.3%)
tracing 439.7 µs [419.22 µs, 460.18 µs] 70.969 µs (19.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1374
.   : milestone, 1354,
appsec (1.709 ms) : 1684, 1733
.   : milestone, 1709,
appsec_no_iast (1.698 ms) : 1673, 1723
.   : milestone, 1698,
iast (1.481 ms) : 1459, 1503
.   : milestone, 1481,
profiling (1.49 ms) : 1465, 1515
.   : milestone, 1490,
tracing (1.472 ms) : 1447, 1496
.   : milestone, 1472,
section candidate
no_agent (1.367 ms) : 1348, 1386
.   : milestone, 1367,
appsec (1.732 ms) : 1708, 1756
.   : milestone, 1732,
appsec_no_iast (1.736 ms) : 1712, 1760
.   : milestone, 1736,
iast (1.469 ms) : 1447, 1492
.   : milestone, 1469,
profiling (1.53 ms) : 1505, 1556
.   : milestone, 1530,
tracing (1.472 ms) : 1448, 1497
.   : milestone, 1472,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.374 ms] -
appsec 1.709 ms [1.684 ms, 1.733 ms] 354.342 µs (26.2%)
appsec_no_iast 1.698 ms [1.673 ms, 1.723 ms] 343.579 µs (25.4%)
iast 1.481 ms [1.459 ms, 1.503 ms] 126.974 µs (9.4%)
profiling 1.49 ms [1.465 ms, 1.515 ms] 135.927 µs (10.0%)
tracing 1.472 ms [1.447 ms, 1.496 ms] 117.303 µs (8.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.348 ms, 1.386 ms] -
appsec 1.732 ms [1.708 ms, 1.756 ms] 365.109 µs (26.7%)
appsec_no_iast 1.736 ms [1.712 ms, 1.76 ms] 369.233 µs (27.0%)
iast 1.469 ms [1.447 ms, 1.492 ms] 102.758 µs (7.5%)
profiling 1.53 ms [1.505 ms, 1.556 ms] 163.765 µs (12.0%)
tracing 1.472 ms [1.448 ms, 1.497 ms] 105.76 µs (7.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci-builder
git_commit_date 1724321531 1724329819
git_commit_sha 77c6fbe c5f0d44
release_version 1.39.0-SNAPSHOT~77c6fbe6b9 1.39.0-SNAPSHOT~c5f0d44f41
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724331735 1724331735
ci_job_id 613612754 613612754
ci_pipeline_id 42549263 42549263
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.461 ms) : 1450, 1473
.   : milestone, 1461,
appsec (2.204 ms) : 2169, 2239
.   : milestone, 2204,
iast (1.967 ms) : 1924, 2010
.   : milestone, 1967,
iast_GLOBAL (2.017 ms) : 1974, 2061
.   : milestone, 2017,
profiling (1.856 ms) : 1821, 1890
.   : milestone, 1856,
tracing (1.833 ms) : 1800, 1866
.   : milestone, 1833,
section candidate
no_agent (1.459 ms) : 1448, 1471
.   : milestone, 1459,
appsec (2.211 ms) : 2176, 2247
.   : milestone, 2211,
iast (1.945 ms) : 1904, 1986
.   : milestone, 1945,
iast_GLOBAL (2.013 ms) : 1970, 2056
.   : milestone, 2013,
profiling (1.841 ms) : 1807, 1874
.   : milestone, 1841,
tracing (1.826 ms) : 1794, 1859
.   : milestone, 1826,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.45 ms, 1.473 ms] -
appsec 2.204 ms [2.169 ms, 2.239 ms] 742.629 µs (50.8%)
iast 1.967 ms [1.924 ms, 2.01 ms] 505.952 µs (34.6%)
iast_GLOBAL 2.017 ms [1.974 ms, 2.061 ms] 555.762 µs (38.0%)
profiling 1.856 ms [1.821 ms, 1.89 ms] 394.024 µs (27.0%)
tracing 1.833 ms [1.8 ms, 1.866 ms] 371.207 µs (25.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.448 ms, 1.471 ms] -
appsec 2.211 ms [2.176 ms, 2.247 ms] 752.424 µs (51.6%)
iast 1.945 ms [1.904 ms, 1.986 ms] 486.147 µs (33.3%)
iast_GLOBAL 2.013 ms [1.97 ms, 2.056 ms] 554.108 µs (38.0%)
profiling 1.841 ms [1.807 ms, 1.874 ms] 381.765 µs (26.2%)
tracing 1.826 ms [1.794 ms, 1.859 ms] 367.394 µs (25.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5f0d44f41, baseline=1.39.0-SNAPSHOT~77c6fbe6b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.442 s) : 15442000, 15442000
.   : milestone, 15442000,
appsec (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
iast (18.589 s) : 18589000, 18589000
.   : milestone, 18589000,
iast_GLOBAL (17.807 s) : 17807000, 17807000
.   : milestone, 17807000,
profiling (15.78 s) : 15780000, 15780000
.   : milestone, 15780000,
tracing (14.804 s) : 14804000, 14804000
.   : milestone, 14804000,
section candidate
no_agent (14.884 s) : 14884000, 14884000
.   : milestone, 14884000,
appsec (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
iast (18.596 s) : 18596000, 18596000
.   : milestone, 18596000,
iast_GLOBAL (17.737 s) : 17737000, 17737000
.   : milestone, 17737000,
profiling (15.944 s) : 15944000, 15944000
.   : milestone, 15944000,
tracing (15.096 s) : 15096000, 15096000
.   : milestone, 15096000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.442 s [15.442 s, 15.442 s] -
appsec 14.974 s [14.974 s, 14.974 s] -468.0 ms (-3.0%)
iast 18.589 s [18.589 s, 18.589 s] 3.147 s (20.4%)
iast_GLOBAL 17.807 s [17.807 s, 17.807 s] 2.365 s (15.3%)
profiling 15.78 s [15.78 s, 15.78 s] 338.0 ms (2.2%)
tracing 14.804 s [14.804 s, 14.804 s] -638.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.884 s [14.884 s, 14.884 s] -
appsec 15.048 s [15.048 s, 15.048 s] 164.0 ms (1.1%)
iast 18.596 s [18.596 s, 18.596 s] 3.712 s (24.9%)
iast_GLOBAL 17.737 s [17.737 s, 17.737 s] 2.853 s (19.2%)
profiling 15.944 s [15.944 s, 15.944 s] 1.06 s (7.1%)
tracing 15.096 s [15.096 s, 15.096 s] 212.0 ms (1.4%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@PerfectSlayer