Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Decouple test JDK and gradle JDK in testng latestDepTest #8235

Merged
merged 1 commit into from
Jan 17, 2025
Merged

Decouple test JDK and gradle JDK in testng latestDepTest #8235

merged 1 commit into from
Jan 17, 2025
+8 −7

Conversation

smola
Copy link
Member

@smola smola commented Jan 16, 2025

What Does This Do

Similar to #8234 but for testng. Effectively enabled tests for testng 7.6.0+ in CI.

Motivation

Part of fixes to decouple the JDK used for compile/test from the one used by gradle.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jan 16, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jan 16, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/testng-latest-jdk
git_commit_date 1737044223 1737063485
git_commit_sha f1d359b d03d201
release_version 1.46.0-SNAPSHOT~f1d359b93f 1.46.0-SNAPSHOT~d03d201b9b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737065979 1737065979
ci_job_id 769919177 769919177
ci_pipeline_id 53249248 53249248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053780
Total [baseline] (8.638 s) : 0, 8638419
Agent [candidate] (1.055 s) : 0, 1055462
Total [candidate] (8.626 s) : 0, 8626346
section iast
Agent [baseline] (1.184 s) : 0, 1184065
Total [baseline] (9.214 s) : 0, 9214460
Agent [candidate] (1.196 s) : 0, 1196443
Total [candidate] (9.244 s) : 0, 9243665
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.193 s) : 0, 1192585
Total [baseline] (9.198 s) : 0, 9197654
Agent [candidate] (1.192 s) : 0, 1191721
Total [candidate] (9.221 s) : 0, 9220836
section iast_TELEMETRY_OFF
Agent [baseline] (1.185 s) : 0, 1185221
Total [baseline] (9.208 s) : 0, 9207596
Agent [candidate] (1.179 s) : 0, 1179014
Total [candidate] (9.201 s) : 0, 9200676
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.184 s 130.286 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.193 s 138.805 ms (13.2%)
Agent iast_TELEMETRY_OFF 1.185 s 131.442 ms (12.5%)
Total tracing 8.638 s -
Total iast 9.214 s 576.041 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.198 s 559.235 ms (6.5%)
Total iast_TELEMETRY_OFF 9.208 s 569.176 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.196 s 140.981 ms (13.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.192 s 136.259 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.179 s 123.552 ms (11.7%)
Total tracing 8.626 s -
Total iast 9.244 s 617.319 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.221 s 594.49 ms (6.9%)
Total iast_TELEMETRY_OFF 9.201 s 574.33 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (712.177 ms) : 0, 712177
BytebuddyAgent [candidate] (713.299 ms) : 0, 713299
GlobalTracer [baseline] (255.059 ms) : 0, 255059
GlobalTracer [candidate] (255.817 ms) : 0, 255817
AppSec [baseline] (57.183 ms) : 0, 57183
AppSec [candidate] (55.462 ms) : 0, 55462
Remote Config [baseline] (710.047 µs) : 0, 710
Remote Config [candidate] (717.77 µs) : 0, 718
Telemetry [baseline] (13.77 ms) : 0, 13770
Telemetry [candidate] (15.143 ms) : 0, 15143
section iast
BytebuddyAgent [baseline] (833.03 ms) : 0, 833030
BytebuddyAgent [candidate] (843.183 ms) : 0, 843183
GlobalTracer [baseline] (247.057 ms) : 0, 247057
GlobalTracer [candidate] (248.35 ms) : 0, 248350
AppSec [baseline] (57.983 ms) : 0, 57983
AppSec [candidate] (58.294 ms) : 0, 58294
IAST [baseline] (21.653 ms) : 0, 21653
IAST [candidate] (21.838 ms) : 0, 21838
Remote Config [baseline] (665.567 µs) : 0, 666
Remote Config [candidate] (682.053 µs) : 0, 682
Telemetry [baseline] (8.737 ms) : 0, 8737
Telemetry [candidate] (8.955 ms) : 0, 8955
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (838.878 ms) : 0, 838878
BytebuddyAgent [candidate] (838.288 ms) : 0, 838288
GlobalTracer [baseline] (248.697 ms) : 0, 248697
GlobalTracer [candidate] (248.482 ms) : 0, 248482
AppSec [baseline] (58.475 ms) : 0, 58475
AppSec [candidate] (58.613 ms) : 0, 58613
IAST [baseline] (21.776 ms) : 0, 21776
IAST [candidate] (21.574 ms) : 0, 21574
Remote Config [baseline] (682.493 µs) : 0, 682
Remote Config [candidate] (690.047 µs) : 0, 690
Telemetry [baseline] (8.937 ms) : 0, 8937
Telemetry [candidate] (8.948 ms) : 0, 8948
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.926 ms) : 0, 833926
BytebuddyAgent [candidate] (828.946 ms) : 0, 828946
GlobalTracer [baseline] (247.591 ms) : 0, 247591
GlobalTracer [candidate] (247.108 ms) : 0, 247108
AppSec [baseline] (58.092 ms) : 0, 58092
AppSec [candidate] (57.824 ms) : 0, 57824
IAST [baseline] (21.118 ms) : 0, 21118
IAST [candidate] (20.792 ms) : 0, 20792
Remote Config [baseline] (678.603 µs) : 0, 679
Remote Config [candidate] (661.177 µs) : 0, 661
Telemetry [baseline] (8.79 ms) : 0, 8790
Telemetry [candidate] (8.649 ms) : 0, 8649
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058612
Total [baseline] (10.461 s) : 0, 10460917
Agent [candidate] (1.06 s) : 0, 1059535
Total [candidate] (10.51 s) : 0, 10509630
section appsec
Agent [baseline] (1.187 s) : 0, 1186997
Total [baseline] (10.716 s) : 0, 10716417
Agent [candidate] (1.187 s) : 0, 1186727
Total [candidate] (10.731 s) : 0, 10730814
section iast
Agent [baseline] (1.183 s) : 0, 1182620
Total [baseline] (10.977 s) : 0, 10977475
Agent [candidate] (1.181 s) : 0, 1180969
Total [candidate] (11.1 s) : 0, 11100484
section profiling
Agent [baseline] (1.253 s) : 0, 1252539
Total [baseline] (10.787 s) : 0, 10786877
Agent [candidate] (1.268 s) : 0, 1268076
Total [candidate] (10.884 s) : 0, 10883650
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.187 s 128.385 ms (12.1%)
Agent iast 1.183 s 124.008 ms (11.7%)
Agent profiling 1.253 s 193.927 ms (18.3%)
Total tracing 10.461 s -
Total appsec 10.716 s 255.5 ms (2.4%)
Total iast 10.977 s 516.558 ms (4.9%)
Total profiling 10.787 s 325.961 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.187 s 127.192 ms (12.0%)
Agent iast 1.181 s 121.433 ms (11.5%)
Agent profiling 1.268 s 208.54 ms (19.7%)
Total tracing 10.51 s -
Total appsec 10.731 s 221.184 ms (2.1%)
Total iast 11.1 s 590.853 ms (5.6%)
Total profiling 10.884 s 374.02 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.619 ms) : 0, 716619
BytebuddyAgent [candidate] (716.747 ms) : 0, 716747
GlobalTracer [baseline] (256.581 ms) : 0, 256581
GlobalTracer [candidate] (256.314 ms) : 0, 256314
AppSec [baseline] (56.139 ms) : 0, 56139
AppSec [candidate] (55.34 ms) : 0, 55340
Remote Config [baseline] (723.949 µs) : 0, 724
Remote Config [candidate] (715.915 µs) : 0, 716
Telemetry [baseline] (13.561 ms) : 0, 13561
Telemetry [candidate] (15.407 ms) : 0, 15407
section appsec
BytebuddyAgent [baseline] (730.0 ms) : 0, 730000
BytebuddyAgent [candidate] (729.919 ms) : 0, 729919
GlobalTracer [baseline] (252.741 ms) : 0, 252741
GlobalTracer [candidate] (252.503 ms) : 0, 252503
AppSec [baseline] (170.789 ms) : 0, 170789
AppSec [candidate] (170.771 ms) : 0, 170771
IAST [baseline] (19.438 ms) : 0, 19438
IAST [candidate] (19.358 ms) : 0, 19358
Remote Config [baseline] (660.056 µs) : 0, 660
Remote Config [candidate] (664.13 µs) : 0, 664
Telemetry [baseline] (8.172 ms) : 0, 8172
Telemetry [candidate] (8.245 ms) : 0, 8245
section iast
BytebuddyAgent [baseline] (831.653 ms) : 0, 831653
BytebuddyAgent [candidate] (830.821 ms) : 0, 830821
GlobalTracer [baseline] (246.897 ms) : 0, 246897
GlobalTracer [candidate] (246.131 ms) : 0, 246131
AppSec [baseline] (58.115 ms) : 0, 58115
AppSec [candidate] (58.032 ms) : 0, 58032
IAST [baseline] (21.558 ms) : 0, 21558
IAST [candidate] (21.649 ms) : 0, 21649
Remote Config [baseline] (673.754 µs) : 0, 674
Remote Config [candidate] (672.701 µs) : 0, 673
Telemetry [baseline] (8.831 ms) : 0, 8831
Telemetry [candidate] (8.727 ms) : 0, 8727
section profiling
BytebuddyAgent [baseline] (702.22 ms) : 0, 702220
BytebuddyAgent [candidate] (711.557 ms) : 0, 711557
GlobalTracer [baseline] (348.335 ms) : 0, 348335
GlobalTracer [candidate] (354.239 ms) : 0, 354239
AppSec [baseline] (54.863 ms) : 0, 54863
AppSec [candidate] (54.47 ms) : 0, 54470
Remote Config [baseline] (664.548 µs) : 0, 665
Remote Config [candidate] (656.413 µs) : 0, 656
Telemetry [baseline] (8.786 ms) : 0, 8786
Telemetry [candidate] (8.92 ms) : 0, 8920
ProfilingAgent [baseline] (95.843 ms) : 0, 95843
ProfilingAgent [candidate] (96.113 ms) : 0, 96113
Profiling [baseline] (95.867 ms) : 0, 95867
Profiling [candidate] (96.137 ms) : 0, 96137
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-16T21:49:37 2025-01-16T21:56:40
git_branch master smola/testng-latest-jdk
git_commit_date 1737044223 1737063485
git_commit_sha f1d359b d03d201
release_version 1.46.0-SNAPSHOT~f1d359b93f 1.46.0-SNAPSHOT~d03d201b9b
start_time 2025-01-16T21:49:23 2025-01-16T21:56:26
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737064957 1737064957
ci_job_id 769919178 769919178
ci_pipeline_id 53249248 53249248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (377.743 µs) : 357, 398
.   : milestone, 378,
iast (511.032 µs) : 489, 533
.   : milestone, 511,
iast_FULL (742.309 µs) : 721, 764
.   : milestone, 742,
iast_GLOBAL (554.47 µs) : 533, 576
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (518.429 µs) : 495, 542
.   : milestone, 518,
iast_INACTIVE (460.565 µs) : 439, 482
.   : milestone, 461,
iast_TELEMETRY_OFF (491.331 µs) : 470, 513
.   : milestone, 491,
tracing (452.798 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (374.775 µs) : 355, 395
.   : milestone, 375,
iast (507.735 µs) : 486, 529
.   : milestone, 508,
iast_FULL (743.871 µs) : 722, 766
.   : milestone, 744,
iast_GLOBAL (558.089 µs) : 536, 581
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (506.171 µs) : 484, 528
.   : milestone, 506,
iast_INACTIVE (458.205 µs) : 437, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (489.765 µs) : 468, 511
.   : milestone, 490,
tracing (450.952 µs) : 430, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.743 µs [357.497 µs, 397.988 µs] -
iast 511.032 µs [488.682 µs, 533.382 µs] 133.289 µs (35.3%)
iast_FULL 742.309 µs [720.66 µs, 763.958 µs] 364.567 µs (96.5%)
iast_GLOBAL 554.47 µs [532.528 µs, 576.413 µs] 176.728 µs (46.8%)
iast_HARDCODED_SECRET_DISABLED 518.429 µs [495.105 µs, 541.753 µs] 140.686 µs (37.2%)
iast_INACTIVE 460.565 µs [439.053 µs, 482.077 µs] 82.822 µs (21.9%)
iast_TELEMETRY_OFF 491.331 µs [469.878 µs, 512.784 µs] 113.588 µs (30.1%)
tracing 452.798 µs [431.524 µs, 474.071 µs] 75.055 µs (19.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.775 µs [354.923 µs, 394.627 µs] -
iast 507.735 µs [485.995 µs, 529.476 µs] 132.96 µs (35.5%)
iast_FULL 743.871 µs [721.964 µs, 765.779 µs] 369.097 µs (98.5%)
iast_GLOBAL 558.089 µs [535.66 µs, 580.519 µs] 183.315 µs (48.9%)
iast_HARDCODED_SECRET_DISABLED 506.171 µs [483.974 µs, 528.368 µs] 131.396 µs (35.1%)
iast_INACTIVE 458.205 µs [436.782 µs, 479.628 µs] 83.43 µs (22.3%)
iast_TELEMETRY_OFF 489.765 µs [468.21 µs, 511.321 µs] 114.99 µs (30.7%)
tracing 450.952 µs [430.328 µs, 471.577 µs] 76.178 µs (20.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1374
.   : milestone, 1354,
appsec (1.755 ms) : 1732, 1778
.   : milestone, 1755,
appsec_no_iast (1.727 ms) : 1702, 1752
.   : milestone, 1727,
iast (1.507 ms) : 1483, 1532
.   : milestone, 1507,
profiling (1.517 ms) : 1494, 1540
.   : milestone, 1517,
tracing (1.494 ms) : 1470, 1519
.   : milestone, 1494,
section candidate
no_agent (1.366 ms) : 1347, 1386
.   : milestone, 1366,
appsec (1.734 ms) : 1710, 1758
.   : milestone, 1734,
appsec_no_iast (1.754 ms) : 1731, 1777
.   : milestone, 1754,
iast (1.509 ms) : 1484, 1533
.   : milestone, 1509,
profiling (1.501 ms) : 1477, 1525
.   : milestone, 1501,
tracing (1.491 ms) : 1466, 1517
.   : milestone, 1491,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.374 ms] -
appsec 1.755 ms [1.732 ms, 1.778 ms] 401.046 µs (29.6%)
appsec_no_iast 1.727 ms [1.702 ms, 1.752 ms] 372.912 µs (27.5%)
iast 1.507 ms [1.483 ms, 1.532 ms] 153.363 µs (11.3%)
profiling 1.517 ms [1.494 ms, 1.54 ms] 162.914 µs (12.0%)
tracing 1.494 ms [1.47 ms, 1.519 ms] 140.4 µs (10.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.347 ms, 1.386 ms] -
appsec 1.734 ms [1.71 ms, 1.758 ms] 367.744 µs (26.9%)
appsec_no_iast 1.754 ms [1.731 ms, 1.777 ms] 387.463 µs (28.4%)
iast 1.509 ms [1.484 ms, 1.533 ms] 142.395 µs (10.4%)
profiling 1.501 ms [1.477 ms, 1.525 ms] 134.565 µs (9.8%)
tracing 1.491 ms [1.466 ms, 1.517 ms] 124.932 µs (9.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/testng-latest-jdk
git_commit_date 1737044223 1737063485
git_commit_sha f1d359b d03d201
release_version 1.46.0-SNAPSHOT~f1d359b93f 1.46.0-SNAPSHOT~d03d201b9b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737065521 1737065521
ci_job_id 769919179 769919179
ci_pipeline_id 53249248 53249248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.461 s) : 15461000, 15461000
.   : milestone, 15461000,
appsec (15.16 s) : 15160000, 15160000
.   : milestone, 15160000,
iast (18.819 s) : 18819000, 18819000
.   : milestone, 18819000,
iast_GLOBAL (17.764 s) : 17764000, 17764000
.   : milestone, 17764000,
profiling (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
tracing (15.137 s) : 15137000, 15137000
.   : milestone, 15137000,
section candidate
no_agent (14.797 s) : 14797000, 14797000
.   : milestone, 14797000,
appsec (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
iast (18.997 s) : 18997000, 18997000
.   : milestone, 18997000,
iast_GLOBAL (18.138 s) : 18138000, 18138000
.   : milestone, 18138000,
profiling (15.116 s) : 15116000, 15116000
.   : milestone, 15116000,
tracing (14.986 s) : 14986000, 14986000
.   : milestone, 14986000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.461 s [15.461 s, 15.461 s] -
appsec 15.16 s [15.16 s, 15.16 s] -301.0 ms (-1.9%)
iast 18.819 s [18.819 s, 18.819 s] 3.358 s (21.7%)
iast_GLOBAL 17.764 s [17.764 s, 17.764 s] 2.303 s (14.9%)
profiling 15.028 s [15.028 s, 15.028 s] -433.0 ms (-2.8%)
tracing 15.137 s [15.137 s, 15.137 s] -324.0 ms (-2.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.797 s [14.797 s, 14.797 s] -
appsec 15.059 s [15.059 s, 15.059 s] 262.0 ms (1.8%)
iast 18.997 s [18.997 s, 18.997 s] 4.2 s (28.4%)
iast_GLOBAL 18.138 s [18.138 s, 18.138 s] 3.341 s (22.6%)
profiling 15.116 s [15.116 s, 15.116 s] 319.0 ms (2.2%)
tracing 14.986 s [14.986 s, 14.986 s] 189.0 ms (1.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~d03d201b9b, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1451, 1473
.   : milestone, 1462,
appsec (2.36 ms) : 2316, 2404
.   : milestone, 2360,
iast (2.102 ms) : 2047, 2156
.   : milestone, 2102,
iast_GLOBAL (2.15 ms) : 2095, 2206
.   : milestone, 2150,
profiling (1.963 ms) : 1919, 2007
.   : milestone, 1963,
tracing (1.944 ms) : 1902, 1986
.   : milestone, 1944,
section candidate
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.341 ms) : 2297, 2384
.   : milestone, 2341,
iast (2.103 ms) : 2048, 2158
.   : milestone, 2103,
iast_GLOBAL (2.139 ms) : 2084, 2194
.   : milestone, 2139,
profiling (1.957 ms) : 1913, 2001
.   : milestone, 1957,
tracing (1.947 ms) : 1904, 1989
.   : milestone, 1947,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.473 ms] -
appsec 2.36 ms [2.316 ms, 2.404 ms] 897.79 µs (61.4%)
iast 2.102 ms [2.047 ms, 2.156 ms] 639.381 µs (43.7%)
iast_GLOBAL 2.15 ms [2.095 ms, 2.206 ms] 688.177 µs (47.1%)
profiling 1.963 ms [1.919 ms, 2.007 ms] 500.944 µs (34.3%)
tracing 1.944 ms [1.902 ms, 1.986 ms] 481.72 µs (32.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.341 ms [2.297 ms, 2.384 ms] 876.509 µs (59.9%)
iast 2.103 ms [2.048 ms, 2.158 ms] 638.521 µs (43.6%)
iast_GLOBAL 2.139 ms [2.084 ms, 2.194 ms] 674.583 µs (46.1%)
profiling 1.957 ms [1.913 ms, 2.001 ms] 492.598 µs (33.6%)
tracing 1.947 ms [1.904 ms, 1.989 ms] 482.398 µs (32.9%)

@smola smola marked this pull request as ready for review January 17, 2025 07:21
@smola smola requested a review from a team as a code owner January 17, 2025 07:21
@smola smola requested a review from tonyredondo January 17, 2025 07:21
@smola smola merged commit 14822bf into master Jan 17, 2025
169 of 175 checks passed
@smola smola deleted the smola/testng-latest-jdk branch January 17, 2025 11:07
@github-actions github-actions bot added this to the 1.46.0 milestone Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@datadog-datadog-prod-us1 datadog-datadog-prod-us1[bot] datadog-datadog-prod-us1[bot] left review comments

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@tonyredondo tonyredondo Awaiting requested review from tonyredondo tonyredondo is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.46.0
Development

Successfully merging this pull request may close these issues.
2 participants
@smola @PerfectSlayer