Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[🍒 7793] Throw exception when using repo index to resolve source path for classes with identical names #7806

Merged
merged 1 commit into from
Oct 18, 2024
Merged

[🍒 7793] Throw exception when using repo index to resolve source path for classes with identical names #7806

merged 1 commit into from
Oct 18, 2024

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

Cherry-pick #7793

What Does This Do

Updates repo indexing logic: the logic now stores the list of classes whose path relative to source root is the same (e.g. src/java/main/my/package/MyClass.java and src/java9/main/my/package/MyClass.java).

When a source path lookup is performed with the repo index, if the class if one of those "duplicates", an exception will be thrown to indicate that we cannot reliably detect the source path for this class.

Motivation

The motivation is to skip code coverage report creation and submission for test cases that cover such classes.
The idea is that since we cannot reliably detect all the source paths, we do not want ITR to skip these test cases, which is why we will not be submitting code coverage reports for them.

Contributor Checklist

Jira ticket: SDTEST-1130

@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: bug comp: ci visibility Continuous Integration Visibility labels Oct 18, 2024
@nikita-tkachenko-datadog nikita-tkachenko-datadog added this to the 1.41.1 milestone Oct 18, 2024
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review October 18, 2024 13:38
@pr-commenter
Copy link

pr-commenter bot commented Oct 18, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7793
git_commit_date 1729257196 1729254380
git_commit_sha 00856e0 e5f5e07
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~e5f5e07d41
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729259823 1729259823
ci_job_id 676840424 676840424
ci_pipeline_id 46913195 46913195
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 51 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+4.513ms; +9.738ms] or [+4.986%; +10.759%]		 97.636ms 90.511ms
scenario:startup:petclinic:profiling:Profiling worse
[+4.515ms; +9.741ms] or [+4.987%; +10.759%]		 97.662ms 90.534ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1092676
Total [baseline] (8.625 s) : 0, 8624503
Agent [candidate] (1.081 s) : 0, 1081086
Total [candidate] (8.626 s) : 0, 8625813
section iast
Agent [baseline] (1.218 s) : 0, 1217908
Total [baseline] (9.159 s) : 0, 9158776
Agent [candidate] (1.202 s) : 0, 1202419
Total [candidate] (9.118 s) : 0, 9117646
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.205 s) : 0, 1205084
Total [baseline] (9.117 s) : 0, 9117165
Agent [candidate] (1.203 s) : 0, 1203209
Total [candidate] (9.088 s) : 0, 9087590
section iast_TELEMETRY_OFF
Agent [baseline] (1.208 s) : 0, 1207519
Total [baseline] (9.143 s) : 0, 9143273
Agent [candidate] (1.198 s) : 0, 1197641
Total [candidate] (9.115 s) : 0, 9115448
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent iast 1.218 s 125.232 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.205 s 112.407 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.208 s 114.843 ms (10.5%)
Total tracing 8.625 s -
Total iast 9.159 s 534.272 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.117 s 492.662 ms (5.7%)
Total iast_TELEMETRY_OFF 9.143 s 518.77 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.202 s 121.333 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.203 s 122.123 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.198 s 116.555 ms (10.8%)
Total tracing 8.626 s -
Total iast 9.118 s 491.833 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.088 s 461.777 ms (5.4%)
Total iast_TELEMETRY_OFF 9.115 s 489.635 ms (5.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.946 ms) : 0, 696946
BytebuddyAgent [candidate] (689.282 ms) : 0, 689282
GlobalTracer [baseline] (316.968 ms) : 0, 316968
GlobalTracer [candidate] (315.256 ms) : 0, 315256
AppSec [baseline] (54.457 ms) : 0, 54457
AppSec [candidate] (54.437 ms) : 0, 54437
Remote Config [baseline] (679.131 µs) : 0, 679
Remote Config [candidate] (671.1 µs) : 0, 671
Telemetry [baseline] (9.668 ms) : 0, 9668
Telemetry [candidate] (7.562 ms) : 0, 7562
section iast
BytebuddyAgent [baseline] (813.014 ms) : 0, 813014
BytebuddyAgent [candidate] (799.956 ms) : 0, 799956
GlobalTracer [baseline] (304.476 ms) : 0, 304476
GlobalTracer [candidate] (302.516 ms) : 0, 302516
AppSec [baseline] (57.436 ms) : 0, 57436
AppSec [candidate] (56.214 ms) : 0, 56214
IAST [baseline] (21.27 ms) : 0, 21270
IAST [candidate] (22.194 ms) : 0, 22194
Remote Config [baseline] (632.999 µs) : 0, 633
Remote Config [candidate] (613.821 µs) : 0, 614
Telemetry [baseline] (7.142 ms) : 0, 7142
Telemetry [candidate] (7.109 ms) : 0, 7109
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.401 ms) : 0, 801401
BytebuddyAgent [candidate] (799.754 ms) : 0, 799754
GlobalTracer [baseline] (302.734 ms) : 0, 302734
GlobalTracer [candidate] (303.452 ms) : 0, 303452
AppSec [baseline] (58.538 ms) : 0, 58538
AppSec [candidate] (56.438 ms) : 0, 56438
IAST [baseline] (20.777 ms) : 0, 20777
IAST [candidate] (22.033 ms) : 0, 22033
Remote Config [baseline] (618.843 µs) : 0, 619
Remote Config [candidate] (609.61 µs) : 0, 610
Telemetry [baseline] (7.233 ms) : 0, 7233
Telemetry [candidate] (7.101 ms) : 0, 7101
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (804.051 ms) : 0, 804051
BytebuddyAgent [candidate] (795.515 ms) : 0, 795515
GlobalTracer [baseline] (304.019 ms) : 0, 304019
GlobalTracer [candidate] (302.334 ms) : 0, 302334
AppSec [baseline] (58.044 ms) : 0, 58044
AppSec [candidate] (55.811 ms) : 0, 55811
IAST [baseline] (19.955 ms) : 0, 19955
IAST [candidate] (22.603 ms) : 0, 22603
Remote Config [baseline] (607.349 µs) : 0, 607
Remote Config [candidate] (611.785 µs) : 0, 612
Telemetry [baseline] (6.997 ms) : 0, 6997
Telemetry [candidate] (6.977 ms) : 0, 6977
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081012
Total [baseline] (10.378 s) : 0, 10377599
Agent [candidate] (1.082 s) : 0, 1081843
Total [candidate] (10.457 s) : 0, 10457101
section appsec
Agent [baseline] (1.216 s) : 0, 1215776
Total [baseline] (10.619 s) : 0, 10619213
Agent [candidate] (1.21 s) : 0, 1210318
Total [candidate] (10.65 s) : 0, 10649682
section iast
Agent [baseline] (1.205 s) : 0, 1204992
Total [baseline] (10.891 s) : 0, 10890792
Agent [candidate] (1.208 s) : 0, 1207806
Total [candidate] (10.894 s) : 0, 10894359
section profiling
Agent [baseline] (1.276 s) : 0, 1276129
Total [baseline] (10.754 s) : 0, 10754099
Agent [candidate] (1.279 s) : 0, 1278780
Total [candidate] (10.717 s) : 0, 10717087
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.216 s 134.764 ms (12.5%)
Agent iast 1.205 s 123.981 ms (11.5%)
Agent profiling 1.276 s 195.117 ms (18.0%)
Total tracing 10.378 s -
Total appsec 10.619 s 241.614 ms (2.3%)
Total iast 10.891 s 513.193 ms (4.9%)
Total profiling 10.754 s 376.5 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.21 s 128.475 ms (11.9%)
Agent iast 1.208 s 125.963 ms (11.6%)
Agent profiling 1.279 s 196.937 ms (18.2%)
Total tracing 10.457 s -
Total appsec 10.65 s 192.581 ms (1.8%)
Total iast 10.894 s 437.258 ms (4.2%)
Total profiling 10.717 s 259.986 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.192 ms) : 0, 687192
BytebuddyAgent [candidate] (689.091 ms) : 0, 689091
GlobalTracer [baseline] (314.41 ms) : 0, 314410
GlobalTracer [candidate] (316.271 ms) : 0, 316271
AppSec [baseline] (54.022 ms) : 0, 54022
AppSec [candidate] (54.424 ms) : 0, 54424
Remote Config [baseline] (664.363 µs) : 0, 664
Remote Config [candidate] (678.232 µs) : 0, 678
Telemetry [baseline] (10.975 ms) : 0, 10975
Telemetry [candidate] (7.503 ms) : 0, 7503
section appsec
BytebuddyAgent [baseline] (705.744 ms) : 0, 705744
BytebuddyAgent [candidate] (701.7 ms) : 0, 701700
GlobalTracer [baseline] (311.315 ms) : 0, 311315
GlobalTracer [candidate] (310.667 ms) : 0, 310667
AppSec [baseline] (166.469 ms) : 0, 166469
AppSec [candidate] (162.809 ms) : 0, 162809
Remote Config [baseline] (628.022 µs) : 0, 628
Remote Config [candidate] (638.299 µs) : 0, 638
Telemetry [baseline] (7.428 ms) : 0, 7428
Telemetry [candidate] (10.315 ms) : 0, 10315
IAST [baseline] (20.809 ms) : 0, 20809
IAST [candidate] (20.819 ms) : 0, 20819
section iast
BytebuddyAgent [baseline] (802.245 ms) : 0, 802245
BytebuddyAgent [candidate] (804.836 ms) : 0, 804836
GlobalTracer [baseline] (303.096 ms) : 0, 303096
GlobalTracer [candidate] (302.871 ms) : 0, 302871
AppSec [baseline] (57.057 ms) : 0, 57057
AppSec [candidate] (56.267 ms) : 0, 56267
Remote Config [baseline] (595.204 µs) : 0, 595
Remote Config [candidate] (602.916 µs) : 0, 603
Telemetry [baseline] (7.913 ms) : 0, 7913
Telemetry [candidate] (7.069 ms) : 0, 7069
IAST [baseline] (20.313 ms) : 0, 20313
IAST [candidate] (22.234 ms) : 0, 22234
section profiling
BytebuddyAgent [baseline] (680.725 ms) : 0, 680725
BytebuddyAgent [candidate] (678.72 ms) : 0, 678720
GlobalTracer [baseline] (397.864 ms) : 0, 397864
GlobalTracer [candidate] (400.389 ms) : 0, 400389
AppSec [baseline] (54.591 ms) : 0, 54591
AppSec [candidate] (54.961 ms) : 0, 54961
Remote Config [baseline] (653.928 µs) : 0, 654
Remote Config [candidate] (657.562 µs) : 0, 658
Telemetry [baseline] (12.949 ms) : 0, 12949
Telemetry [candidate] (7.524 ms) : 0, 7524
ProfilingAgent [baseline] (90.511 ms) : 0, 90511
ProfilingAgent [candidate] (97.636 ms) : 0, 97636
Profiling [baseline] (90.534 ms) : 0, 90534
Profiling [candidate] (97.662 ms) : 0, 97662
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-18T13:27:27 2024-10-18T13:34:20
git_branch master nikita-tkachenko/backport-pr-7793
git_commit_date 1729257196 1729254380
git_commit_sha 00856e0 e5f5e07
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~e5f5e07d41
start_time 2024-10-18T13:27:14 2024-10-18T13:34:07
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729258809 1729258809
ci_job_id 676840425 676840425
ci_pipeline_id 46913195 46913195
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (367.351 µs) : 348, 387
.   : milestone, 367,
iast (480.957 µs) : 460, 502
.   : milestone, 481,
iast_FULL (553.535 µs) : 532, 575
.   : milestone, 554,
iast_GLOBAL (504.025 µs) : 483, 525
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (485.08 µs) : 464, 507
.   : milestone, 485,
iast_INACTIVE (450.187 µs) : 429, 471
.   : milestone, 450,
iast_TELEMETRY_OFF (475.535 µs) : 454, 497
.   : milestone, 476,
tracing (450.413 µs) : 430, 471
.   : milestone, 450,
section candidate
no_agent (375.052 µs) : 354, 396
.   : milestone, 375,
iast (488.334 µs) : 467, 510
.   : milestone, 488,
iast_FULL (553.309 µs) : 532, 575
.   : milestone, 553,
iast_GLOBAL (510.959 µs) : 489, 533
.   : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (500.37 µs) : 477, 524
.   : milestone, 500,
iast_INACTIVE (448.75 µs) : 428, 469
.   : milestone, 449,
iast_TELEMETRY_OFF (473.043 µs) : 452, 494
.   : milestone, 473,
tracing (451.122 µs) : 430, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 367.351 µs [347.883 µs, 386.819 µs] -
iast 480.957 µs [459.726 µs, 502.189 µs] 113.606 µs (30.9%)
iast_FULL 553.535 µs [532.102 µs, 574.968 µs] 186.184 µs (50.7%)
iast_GLOBAL 504.025 µs [482.768 µs, 525.283 µs] 136.674 µs (37.2%)
iast_HARDCODED_SECRET_DISABLED 485.08 µs [463.647 µs, 506.512 µs] 117.729 µs (32.0%)
iast_INACTIVE 450.187 µs [429.094 µs, 471.28 µs] 82.836 µs (22.5%)
iast_TELEMETRY_OFF 475.535 µs [453.637 µs, 497.432 µs] 108.184 µs (29.4%)
tracing 450.413 µs [429.928 µs, 470.898 µs] 83.062 µs (22.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.052 µs [353.944 µs, 396.16 µs] -
iast 488.334 µs [466.655 µs, 510.013 µs] 113.282 µs (30.2%)
iast_FULL 553.309 µs [532.042 µs, 574.575 µs] 178.257 µs (47.5%)
iast_GLOBAL 510.959 µs [489.346 µs, 532.572 µs] 135.907 µs (36.2%)
iast_HARDCODED_SECRET_DISABLED 500.37 µs [477.048 µs, 523.691 µs] 125.318 µs (33.4%)
iast_INACTIVE 448.75 µs [428.105 µs, 469.395 µs] 73.698 µs (19.7%)
iast_TELEMETRY_OFF 473.043 µs [451.98 µs, 494.105 µs] 97.991 µs (26.1%)
tracing 451.122 µs [429.919 µs, 472.325 µs] 76.07 µs (20.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1332, 1371
.   : milestone, 1352,
appsec (1.742 ms) : 1718, 1767
.   : milestone, 1742,
appsec_no_iast (1.72 ms) : 1696, 1744
.   : milestone, 1720,
iast (1.482 ms) : 1459, 1505
.   : milestone, 1482,
profiling (1.493 ms) : 1470, 1515
.   : milestone, 1493,
tracing (1.461 ms) : 1437, 1485
.   : milestone, 1461,
section candidate
no_agent (1.35 ms) : 1331, 1370
.   : milestone, 1350,
appsec (1.746 ms) : 1722, 1770
.   : milestone, 1746,
appsec_no_iast (1.731 ms) : 1707, 1755
.   : milestone, 1731,
iast (1.489 ms) : 1466, 1511
.   : milestone, 1489,
profiling (1.489 ms) : 1465, 1514
.   : milestone, 1489,
tracing (1.462 ms) : 1437, 1487
.   : milestone, 1462,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.332 ms, 1.371 ms] -
appsec 1.742 ms [1.718 ms, 1.767 ms] 390.608 µs (28.9%)
appsec_no_iast 1.72 ms [1.696 ms, 1.744 ms] 367.912 µs (27.2%)
iast 1.482 ms [1.459 ms, 1.505 ms] 130.491 µs (9.7%)
profiling 1.493 ms [1.47 ms, 1.515 ms] 140.976 µs (10.4%)
tracing 1.461 ms [1.437 ms, 1.485 ms] 109.318 µs (8.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.331 ms, 1.37 ms] -
appsec 1.746 ms [1.722 ms, 1.77 ms] 395.891 µs (29.3%)
appsec_no_iast 1.731 ms [1.707 ms, 1.755 ms] 380.897 µs (28.2%)
iast 1.489 ms [1.466 ms, 1.511 ms] 138.57 µs (10.3%)
profiling 1.489 ms [1.465 ms, 1.514 ms] 139.132 µs (10.3%)
tracing 1.462 ms [1.437 ms, 1.487 ms] 111.62 µs (8.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7793
git_commit_date 1729257196 1729254380
git_commit_sha 00856e0 e5f5e07
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~e5f5e07d41
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1729259207 1729259207
ci_job_id 676840427 676840427
ci_pipeline_id 46913195 46913195
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (2.349 ms) : 2307, 2390
.   : milestone, 2349,
iast (2.064 ms) : 2013, 2115
.   : milestone, 2064,
iast_GLOBAL (2.13 ms) : 2077, 2183
.   : milestone, 2130,
profiling (1.936 ms) : 1895, 1977
.   : milestone, 1936,
tracing (1.917 ms) : 1878, 1956
.   : milestone, 1917,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.356 ms) : 2315, 2398
.   : milestone, 2356,
iast (2.097 ms) : 2045, 2150
.   : milestone, 2097,
iast_GLOBAL (2.135 ms) : 2082, 2188
.   : milestone, 2135,
profiling (1.971 ms) : 1928, 2014
.   : milestone, 1971,
tracing (1.919 ms) : 1879, 1958
.   : milestone, 1919,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 2.349 ms [2.307 ms, 2.39 ms] 873.197 µs (59.2%)
iast 2.064 ms [2.013 ms, 2.115 ms] 588.987 µs (39.9%)
iast_GLOBAL 2.13 ms [2.077 ms, 2.183 ms] 654.548 µs (44.4%)
profiling 1.936 ms [1.895 ms, 1.977 ms] 460.614 µs (31.2%)
tracing 1.917 ms [1.878 ms, 1.956 ms] 441.206 µs (29.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 2.356 ms [2.315 ms, 2.398 ms] 876.754 µs (59.3%)
iast 2.097 ms [2.045 ms, 2.15 ms] 617.704 µs (41.7%)
iast_GLOBAL 2.135 ms [2.082 ms, 2.188 ms] 655.169 µs (44.3%)
profiling 1.971 ms [1.928 ms, 2.014 ms] 491.257 µs (33.2%)
tracing 1.919 ms [1.879 ms, 1.958 ms] 438.937 µs (29.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~00856e02d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.427 s) : 15427000, 15427000
.   : milestone, 15427000,
appsec (15.293 s) : 15293000, 15293000
.   : milestone, 15293000,
iast (19.096 s) : 19096000, 19096000
.   : milestone, 19096000,
iast_GLOBAL (18.123 s) : 18123000, 18123000
.   : milestone, 18123000,
profiling (15.116 s) : 15116000, 15116000
.   : milestone, 15116000,
tracing (15.321 s) : 15321000, 15321000
.   : milestone, 15321000,
section candidate
no_agent (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
appsec (15.135 s) : 15135000, 15135000
.   : milestone, 15135000,
iast (19.097 s) : 19097000, 19097000
.   : milestone, 19097000,
iast_GLOBAL (17.928 s) : 17928000, 17928000
.   : milestone, 17928000,
profiling (15.156 s) : 15156000, 15156000
.   : milestone, 15156000,
tracing (14.718 s) : 14718000, 14718000
.   : milestone, 14718000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.427 s [15.427 s, 15.427 s] -
appsec 15.293 s [15.293 s, 15.293 s] -134.0 ms (-0.9%)
iast 19.096 s [19.096 s, 19.096 s] 3.669 s (23.8%)
iast_GLOBAL 18.123 s [18.123 s, 18.123 s] 2.696 s (17.5%)
profiling 15.116 s [15.116 s, 15.116 s] -311.0 ms (-2.0%)
tracing 15.321 s [15.321 s, 15.321 s] -106.0 ms (-0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.079 s [15.079 s, 15.079 s] -
appsec 15.135 s [15.135 s, 15.135 s] 56.0 ms (0.4%)
iast 19.097 s [19.097 s, 19.097 s] 4.018 s (26.6%)
iast_GLOBAL 17.928 s [17.928 s, 17.928 s] 2.849 s (18.9%)
profiling 15.156 s [15.156 s, 15.156 s] 77.0 ms (0.5%)
tracing 14.718 s [14.718 s, 14.718 s] -361.0 ms (-2.4%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 67e94a0 into release/v1.41.x Oct 18, 2024
109 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/backport-pr-7793 branch October 18, 2024 14:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@juan-fernandez juan-fernandez juan-fernandez approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility type: bug
Projects
None yet
Milestone
1.41.1
Development

Successfully merging this pull request may close these issues.
2 participants
@nikita-tkachenko-datadog @juan-fernandez