Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable profiling startForceFirst silently for native image builds #7555

Merged
merged 2 commits into from
Sep 3, 2024

Conversation

MattAlp
Copy link
Contributor

@MattAlp MattAlp commented Sep 3, 2024

What Does This Do

This turns on the dd.profiling.start_force_first config setting silently when the profiler is baked into a Graal native image.

Motivation

Without this flag specified, the profiling integration will fail silently. The flag itself is relevant to older, non-Graal JVMs (for historical reasons). Docs do not mention this requirement at the moment.

Additional Notes

Contributor Checklist

Jira ticket: [PROF-10457]

@MattAlp MattAlp added type: bug comp: profiling Profiling comp: native-image GraalVM native-image labels Sep 3, 2024
@MattAlp MattAlp requested a review from a team as a code owner September 3, 2024 15:07
@jbachorik
Copy link
Contributor

Without this flag specified, the profiling integration will fail silently

Is this even for long running processes? IIRC, the profiler should be started eventually, if the app has been running for a long time.

Copy link
Contributor

@jbachorik jbachorik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Please, add the possibility to enable the profiler delay via this flag to the profiler troubleshooting guide, just in case.

@MattAlp
Copy link
Contributor Author

MattAlp commented Sep 3, 2024

I don't believe so- the ProfilerInstaller explicitly says that the Profiler is to start first. As far as I know, the run never gets called again, so we never get to the code that sets a delayed startup

@jbachorik
Copy link
Contributor

Oh, ok. Hm, should we have a warning if a user overrides the flag when running the native image as well?

@pr-commenter
Copy link

pr-commenter bot commented Sep 3, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/scp-479-fix
git_commit_date 1725372161 1725383113
git_commit_sha 6e276be a293df1
release_version 1.40.0-SNAPSHOT~6e276bef3e 1.40.0-SNAPSHOT~a293df12f3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1725385676 1725385676
ci_job_id 626004338 626004338
ci_pipeline_id 43436402 43436402
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054811
Total [baseline] (10.402 s) : 0, 10401538
Agent [candidate] (1.053 s) : 0, 1053189
Total [candidate] (10.418 s) : 0, 10417838
section appsec
Agent [baseline] (1.185 s) : 0, 1185023
Total [baseline] (10.668 s) : 0, 10668479
Agent [candidate] (1.184 s) : 0, 1183670
Total [candidate] (10.585 s) : 0, 10584837
section iast
Agent [baseline] (1.177 s) : 0, 1176538
Total [baseline] (10.79 s) : 0, 10789847
Agent [candidate] (1.175 s) : 0, 1175218
Total [candidate] (10.862 s) : 0, 10862066
section profiling
Agent [baseline] (1.26 s) : 0, 1259539
Total [baseline] (10.613 s) : 0, 10613317
Agent [candidate] (1.25 s) : 0, 1250387
Total [candidate] (10.62 s) : 0, 10620215
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.185 s 130.212 ms (12.3%)
Agent iast 1.177 s 121.726 ms (11.5%)
Agent profiling 1.26 s 204.728 ms (19.4%)
Total tracing 10.402 s -
Total appsec 10.668 s 266.941 ms (2.6%)
Total iast 10.79 s 388.309 ms (3.7%)
Total profiling 10.613 s 211.779 ms (2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.184 s 130.482 ms (12.4%)
Agent iast 1.175 s 122.029 ms (11.6%)
Agent profiling 1.25 s 197.198 ms (18.7%)
Total tracing 10.418 s -
Total appsec 10.585 s 166.999 ms (1.6%)
Total iast 10.862 s 444.228 ms (4.3%)
Total profiling 10.62 s 202.378 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.943 ms) : 0, 672943
BytebuddyAgent [candidate] (671.728 ms) : 0, 671728
GlobalTracer [baseline] (308.331 ms) : 0, 308331
GlobalTracer [candidate] (307.751 ms) : 0, 307751
AppSec [baseline] (51.634 ms) : 0, 51634
AppSec [candidate] (51.731 ms) : 0, 51731
Remote Config [baseline] (677.84 µs) : 0, 678
Remote Config [candidate] (683.001 µs) : 0, 683
Telemetry [baseline] (7.494 ms) : 0, 7494
Telemetry [candidate] (7.595 ms) : 0, 7595
section appsec
BytebuddyAgent [baseline] (691.401 ms) : 0, 691401
BytebuddyAgent [candidate] (689.408 ms) : 0, 689408
GlobalTracer [baseline] (301.221 ms) : 0, 301221
GlobalTracer [candidate] (301.107 ms) : 0, 301107
AppSec [baseline] (159.551 ms) : 0, 159551
AppSec [candidate] (159.756 ms) : 0, 159756
IAST [baseline] (19.949 ms) : 0, 19949
IAST [candidate] (19.043 ms) : 0, 19043
Remote Config [baseline] (619.047 µs) : 0, 619
Remote Config [candidate] (618.172 µs) : 0, 618
Telemetry [baseline] (8.627 ms) : 0, 8627
Telemetry [candidate] (9.63 ms) : 0, 9630
section iast
BytebuddyAgent [baseline] (782.229 ms) : 0, 782229
BytebuddyAgent [candidate] (781.243 ms) : 0, 781243
GlobalTracer [baseline] (296.54 ms) : 0, 296540
GlobalTracer [candidate] (296.297 ms) : 0, 296297
AppSec [baseline] (51.873 ms) : 0, 51873
AppSec [candidate] (55.216 ms) : 0, 55216
IAST [baseline] (23.534 ms) : 0, 23534
IAST [candidate] (20.971 ms) : 0, 20971
Remote Config [baseline] (589.074 µs) : 0, 589
Remote Config [candidate] (578.199 µs) : 0, 578
Telemetry [baseline] (8.111 ms) : 0, 8111
Telemetry [candidate] (7.276 ms) : 0, 7276
section profiling
BytebuddyAgent [baseline] (671.006 ms) : 0, 671006
BytebuddyAgent [candidate] (665.907 ms) : 0, 665907
GlobalTracer [baseline] (393.105 ms) : 0, 393105
GlobalTracer [candidate] (390.665 ms) : 0, 390665
AppSec [baseline] (52.359 ms) : 0, 52359
AppSec [candidate] (52.134 ms) : 0, 52134
Remote Config [baseline] (693.312 µs) : 0, 693
Remote Config [candidate] (682.014 µs) : 0, 682
Telemetry [baseline] (7.422 ms) : 0, 7422
Telemetry [candidate] (7.343 ms) : 0, 7343
ProfilingAgent [baseline] (96.682 ms) : 0, 96682
ProfilingAgent [candidate] (95.572 ms) : 0, 95572
Profiling [baseline] (96.705 ms) : 0, 96705
Profiling [candidate] (95.596 ms) : 0, 95596
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053939
Total [baseline] (8.511 s) : 0, 8510657
Agent [candidate] (1.052 s) : 0, 1051844
Total [candidate] (8.5 s) : 0, 8499914
section iast
Agent [baseline] (1.191 s) : 0, 1190807
Total [baseline] (8.997 s) : 0, 8997404
Agent [candidate] (1.193 s) : 0, 1193497
Total [candidate] (9.04 s) : 0, 9040165
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.178 s) : 0, 1178043
Total [baseline] (8.954 s) : 0, 8954083
Agent [candidate] (1.175 s) : 0, 1174988
Total [candidate] (8.963 s) : 0, 8962908
section iast_TELEMETRY_OFF
Agent [baseline] (1.191 s) : 0, 1191219
Total [baseline] (9.042 s) : 0, 9042060
Agent [candidate] (1.18 s) : 0, 1179551
Total [candidate] (9.008 s) : 0, 9008488
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.191 s 136.868 ms (13.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 124.104 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.191 s 137.28 ms (13.0%)
Total tracing 8.511 s -
Total iast 8.997 s 486.747 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 8.954 s 443.425 ms (5.2%)
Total iast_TELEMETRY_OFF 9.042 s 531.403 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.193 s 141.654 ms (13.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 123.144 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.18 s 127.707 ms (12.1%)
Total tracing 8.5 s -
Total iast 9.04 s 540.252 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 8.963 s 462.994 ms (5.4%)
Total iast_TELEMETRY_OFF 9.008 s 508.574 ms (6.0%)
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.601 ms) : 0, 672601
BytebuddyAgent [candidate] (670.814 ms) : 0, 670814
GlobalTracer [baseline] (307.581 ms) : 0, 307581
GlobalTracer [candidate] (307.528 ms) : 0, 307528
AppSec [baseline] (51.782 ms) : 0, 51782
AppSec [candidate] (51.647 ms) : 0, 51647
Remote Config [baseline] (679.487 µs) : 0, 679
Remote Config [candidate] (685.684 µs) : 0, 686
Telemetry [baseline] (7.584 ms) : 0, 7584
Telemetry [candidate] (7.481 ms) : 0, 7481
section iast
BytebuddyAgent [baseline] (792.344 ms) : 0, 792344
BytebuddyAgent [candidate] (794.203 ms) : 0, 794203
GlobalTracer [baseline] (300.138 ms) : 0, 300138
GlobalTracer [candidate] (301.201 ms) : 0, 301201
AppSec [baseline] (52.383 ms) : 0, 52383
AppSec [candidate] (55.127 ms) : 0, 55127
IAST [baseline] (23.512 ms) : 0, 23512
IAST [candidate] (21.18 ms) : 0, 21180
Remote Config [baseline] (579.314 µs) : 0, 579
Remote Config [candidate] (586.86 µs) : 0, 587
Telemetry [baseline] (8.026 ms) : 0, 8026
Telemetry [candidate] (7.322 ms) : 0, 7322
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (783.116 ms) : 0, 783116
BytebuddyAgent [candidate] (781.239 ms) : 0, 781239
GlobalTracer [baseline] (297.216 ms) : 0, 297216
GlobalTracer [candidate] (296.883 ms) : 0, 296883
AppSec [baseline] (51.866 ms) : 0, 51866
AppSec [candidate] (51.734 ms) : 0, 51734
IAST [baseline] (24.282 ms) : 0, 24282
IAST [candidate] (23.505 ms) : 0, 23505
Remote Config [baseline] (570.216 µs) : 0, 570
Remote Config [candidate] (591.72 µs) : 0, 592
Telemetry [baseline] (7.291 ms) : 0, 7291
Telemetry [candidate] (7.34 ms) : 0, 7340
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (791.05 ms) : 0, 791050
BytebuddyAgent [candidate] (781.858 ms) : 0, 781858
GlobalTracer [baseline] (301.736 ms) : 0, 301736
GlobalTracer [candidate] (299.658 ms) : 0, 299658
AppSec [baseline] (53.072 ms) : 0, 53072
AppSec [candidate] (49.251 ms) : 0, 49251
IAST [baseline] (21.172 ms) : 0, 21172
IAST [candidate] (26.315 ms) : 0, 26315
Remote Config [baseline] (599.089 µs) : 0, 599
Remote Config [candidate] (598.21 µs) : 0, 598
Telemetry [baseline] (9.715 ms) : 0, 9715
Telemetry [candidate] (8.094 ms) : 0, 8094
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-03T17:18:31 2024-09-03T17:25:20
git_branch master mattalp/scp-479-fix
git_commit_date 1725372161 1725383113
git_commit_sha 6e276be a293df1
release_version 1.40.0-SNAPSHOT~6e276bef3e 1.40.0-SNAPSHOT~a293df12f3
start_time 2024-09-03T17:18:18 2024-09-03T17:25:06
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1725384664 1725384664
ci_job_id 626004339 626004339
ci_pipeline_id 43436402 43436402
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.335 ms) : 1315, 1354
.   : milestone, 1335,
appsec (1.732 ms) : 1709, 1755
.   : milestone, 1732,
appsec_no_iast (1.727 ms) : 1703, 1751
.   : milestone, 1727,
iast (1.471 ms) : 1449, 1494
.   : milestone, 1471,
profiling (1.509 ms) : 1484, 1533
.   : milestone, 1509,
tracing (1.487 ms) : 1463, 1511
.   : milestone, 1487,
section candidate
no_agent (1.329 ms) : 1310, 1348
.   : milestone, 1329,
appsec (1.724 ms) : 1700, 1749
.   : milestone, 1724,
appsec_no_iast (1.725 ms) : 1701, 1749
.   : milestone, 1725,
iast (1.489 ms) : 1466, 1511
.   : milestone, 1489,
profiling (1.468 ms) : 1445, 1492
.   : milestone, 1468,
tracing (1.478 ms) : 1454, 1502
.   : milestone, 1478,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.335 ms [1.315 ms, 1.354 ms] -
appsec 1.732 ms [1.709 ms, 1.755 ms] 397.376 µs (29.8%)
appsec_no_iast 1.727 ms [1.703 ms, 1.751 ms] 392.202 µs (29.4%)
iast 1.471 ms [1.449 ms, 1.494 ms] 136.567 µs (10.2%)
profiling 1.509 ms [1.484 ms, 1.533 ms] 173.834 µs (13.0%)
tracing 1.487 ms [1.463 ms, 1.511 ms] 152.0 µs (11.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.329 ms [1.31 ms, 1.348 ms] -
appsec 1.724 ms [1.7 ms, 1.749 ms] 395.224 µs (29.7%)
appsec_no_iast 1.725 ms [1.701 ms, 1.749 ms] 395.695 µs (29.8%)
iast 1.489 ms [1.466 ms, 1.511 ms] 159.787 µs (12.0%)
profiling 1.468 ms [1.445 ms, 1.492 ms] 139.498 µs (10.5%)
tracing 1.478 ms [1.454 ms, 1.502 ms] 149.135 µs (11.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (364.706 µs) : 345, 384
.   : milestone, 365,
iast (482.078 µs) : 460, 504
.   : milestone, 482,
iast_FULL (549.272 µs) : 528, 570
.   : milestone, 549,
iast_GLOBAL (504.322 µs) : 483, 526
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (481.763 µs) : 460, 503
.   : milestone, 482,
iast_INACTIVE (444.182 µs) : 423, 465
.   : milestone, 444,
iast_TELEMETRY_OFF (470.227 µs) : 448, 493
.   : milestone, 470,
tracing (436.134 µs) : 416, 456
.   : milestone, 436,
section candidate
no_agent (366.487 µs) : 346, 387
.   : milestone, 366,
iast (487.338 µs) : 465, 509
.   : milestone, 487,
iast_FULL (549.955 µs) : 529, 571
.   : milestone, 550,
iast_GLOBAL (510.206 µs) : 487, 533
.   : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (479.016 µs) : 457, 501
.   : milestone, 479,
iast_INACTIVE (439.358 µs) : 419, 460
.   : milestone, 439,
iast_TELEMETRY_OFF (469.715 µs) : 447, 492
.   : milestone, 470,
tracing (440.819 µs) : 420, 462
.   : milestone, 441,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.706 µs [345.103 µs, 384.31 µs] -
iast 482.078 µs [459.995 µs, 504.16 µs] 117.371 µs (32.2%)
iast_FULL 549.272 µs [528.101 µs, 570.442 µs] 184.565 µs (50.6%)
iast_GLOBAL 504.322 µs [482.599 µs, 526.045 µs] 139.616 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED 481.763 µs [460.201 µs, 503.325 µs] 117.057 µs (32.1%)
iast_INACTIVE 444.182 µs [423.433 µs, 464.93 µs] 79.476 µs (21.8%)
iast_TELEMETRY_OFF 470.227 µs [447.736 µs, 492.717 µs] 105.52 µs (28.9%)
tracing 436.134 µs [415.895 µs, 456.374 µs] 71.428 µs (19.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.487 µs [346.397 µs, 386.577 µs] -
iast 487.338 µs [465.22 µs, 509.456 µs] 120.851 µs (33.0%)
iast_FULL 549.955 µs [528.868 µs, 571.041 µs] 183.468 µs (50.1%)
iast_GLOBAL 510.206 µs [487.391 µs, 533.021 µs] 143.719 µs (39.2%)
iast_HARDCODED_SECRET_DISABLED 479.016 µs [457.436 µs, 500.596 µs] 112.529 µs (30.7%)
iast_INACTIVE 439.358 µs [419.044 µs, 459.673 µs] 72.871 µs (19.9%)
iast_TELEMETRY_OFF 469.715 µs [447.389 µs, 492.042 µs] 103.228 µs (28.2%)
tracing 440.819 µs [419.951 µs, 461.688 µs] 74.332 µs (20.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/scp-479-fix
git_commit_date 1725372161 1725383113
git_commit_sha 6e276be a293df1
release_version 1.40.0-SNAPSHOT~6e276bef3e 1.40.0-SNAPSHOT~a293df12f3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1725385181 1725385181
ci_job_id 626004340 626004340
ci_pipeline_id 43436402 43436402
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.457 ms) : 1445, 1469
.   : milestone, 1457,
appsec (2.227 ms) : 2191, 2262
.   : milestone, 2227,
iast (1.996 ms) : 1952, 2040
.   : milestone, 1996,
iast_GLOBAL (2.024 ms) : 1980, 2068
.   : milestone, 2024,
profiling (1.866 ms) : 1831, 1900
.   : milestone, 1866,
tracing (1.83 ms) : 1798, 1863
.   : milestone, 1830,
section candidate
no_agent (1.459 ms) : 1447, 1470
.   : milestone, 1459,
appsec (2.217 ms) : 2182, 2253
.   : milestone, 2217,
iast (1.986 ms) : 1942, 2031
.   : milestone, 1986,
iast_GLOBAL (2.03 ms) : 1986, 2074
.   : milestone, 2030,
profiling (1.847 ms) : 1812, 1882
.   : milestone, 1847,
tracing (1.834 ms) : 1801, 1867
.   : milestone, 1834,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.457 ms [1.445 ms, 1.469 ms] -
appsec 2.227 ms [2.191 ms, 2.262 ms] 769.659 µs (52.8%)
iast 1.996 ms [1.952 ms, 2.04 ms] 539.066 µs (37.0%)
iast_GLOBAL 2.024 ms [1.98 ms, 2.068 ms] 566.735 µs (38.9%)
profiling 1.866 ms [1.831 ms, 1.9 ms] 408.806 µs (28.1%)
tracing 1.83 ms [1.798 ms, 1.863 ms] 373.255 µs (25.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.447 ms, 1.47 ms] -
appsec 2.217 ms [2.182 ms, 2.253 ms] 758.619 µs (52.0%)
iast 1.986 ms [1.942 ms, 2.031 ms] 527.37 µs (36.2%)
iast_GLOBAL 2.03 ms [1.986 ms, 2.074 ms] 570.997 µs (39.1%)
profiling 1.847 ms [1.812 ms, 1.882 ms] 388.342 µs (26.6%)
tracing 1.834 ms [1.801 ms, 1.867 ms] 374.965 µs (25.7%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.903 s) : 14903000, 14903000
.   : milestone, 14903000,
appsec (14.854 s) : 14854000, 14854000
.   : milestone, 14854000,
iast (18.797 s) : 18797000, 18797000
.   : milestone, 18797000,
iast_GLOBAL (18.003 s) : 18003000, 18003000
.   : milestone, 18003000,
profiling (15.827 s) : 15827000, 15827000
.   : milestone, 15827000,
tracing (14.804 s) : 14804000, 14804000
.   : milestone, 14804000,
section candidate
no_agent (15.475 s) : 15475000, 15475000
.   : milestone, 15475000,
appsec (15.281 s) : 15281000, 15281000
.   : milestone, 15281000,
iast (18.628 s) : 18628000, 18628000
.   : milestone, 18628000,
iast_GLOBAL (17.955 s) : 17955000, 17955000
.   : milestone, 17955000,
profiling (15.378 s) : 15378000, 15378000
.   : milestone, 15378000,
tracing (14.861 s) : 14861000, 14861000
.   : milestone, 14861000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.903 s [14.903 s, 14.903 s] -
appsec 14.854 s [14.854 s, 14.854 s] -49.0 ms (-0.3%)
iast 18.797 s [18.797 s, 18.797 s] 3.894 s (26.1%)
iast_GLOBAL 18.003 s [18.003 s, 18.003 s] 3.1 s (20.8%)
profiling 15.827 s [15.827 s, 15.827 s] 924.0 ms (6.2%)
tracing 14.804 s [14.804 s, 14.804 s] -99.0 ms (-0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.475 s [15.475 s, 15.475 s] -
appsec 15.281 s [15.281 s, 15.281 s] -194.0 ms (-1.3%)
iast 18.628 s [18.628 s, 18.628 s] 3.153 s (20.4%)
iast_GLOBAL 17.955 s [17.955 s, 17.955 s] 2.48 s (16.0%)
profiling 15.378 s [15.378 s, 15.378 s] -97.0 ms (-0.6%)
tracing 14.861 s [14.861 s, 14.861 s] -614.0 ms (-4.0%)

@MattAlp MattAlp merged commit 51d3cee into master Sep 3, 2024
98 checks passed
@MattAlp MattAlp deleted the mattalp/scp-479-fix branch September 3, 2024 17:53
@github-actions github-actions bot added this to the 1.40.0 milestone Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants