-
Notifications
You must be signed in to change notification settings - Fork 292
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revert HTTP client sharing in CI Vis components #7734
Merged
nikita-tkachenko-datadog
merged 1 commit into
master
from
nikita-tkachenko/revert-http-client-sharing
Oct 7, 2024
Merged
Revert HTTP client sharing in CI Vis components #7734
nikita-tkachenko-datadog
merged 1 commit into
master
from
nikita-tkachenko/revert-http-client-sharing
Oct 7, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nikita-tkachenko-datadog
added
the
comp: ci visibility
Continuous Integration Visibility
label
Oct 4, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080998
Total [baseline] (8.622 s) : 0, 8622192
Agent [candidate] (1.065 s) : 0, 1065058
Total [candidate] (8.533 s) : 0, 8533322
section iast
Agent [baseline] (1.203 s) : 0, 1203282
Total [baseline] (9.079 s) : 0, 9079056
Agent [candidate] (1.197 s) : 0, 1197182
Total [candidate] (9.108 s) : 0, 9107524
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.196 s) : 0, 1196038
Total [baseline] (9.052 s) : 0, 9051792
Agent [candidate] (1.213 s) : 0, 1213237
Total [candidate] (9.089 s) : 0, 9088617
section iast_TELEMETRY_OFF
Agent [baseline] (1.209 s) : 0, 1209499
Total [baseline] (9.073 s) : 0, 9072992
Agent [candidate] (1.192 s) : 0, 1192492
Total [candidate] (9.06 s) : 0, 9060069
gantt
title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.596 ms) : 0, 690596
BytebuddyAgent [candidate] (679.621 ms) : 0, 679621
GlobalTracer [baseline] (314.064 ms) : 0, 314064
GlobalTracer [candidate] (310.205 ms) : 0, 310205
AppSec [baseline] (54.158 ms) : 0, 54158
AppSec [candidate] (53.269 ms) : 0, 53269
Remote Config [baseline] (671.038 µs) : 0, 671
Remote Config [candidate] (667.783 µs) : 0, 668
Telemetry [baseline] (7.67 ms) : 0, 7670
Telemetry [candidate] (7.653 ms) : 0, 7653
section iast
BytebuddyAgent [baseline] (802.048 ms) : 0, 802048
BytebuddyAgent [candidate] (797.589 ms) : 0, 797589
GlobalTracer [baseline] (301.23 ms) : 0, 301230
GlobalTracer [candidate] (300.144 ms) : 0, 300144
AppSec [baseline] (55.517 ms) : 0, 55517
AppSec [candidate] (56.02 ms) : 0, 56020
IAST [baseline] (22.898 ms) : 0, 22898
IAST [candidate] (21.91 ms) : 0, 21910
Remote Config [baseline] (624.924 µs) : 0, 625
Remote Config [candidate] (628.469 µs) : 0, 628
Telemetry [baseline] (7.157 ms) : 0, 7157
Telemetry [candidate] (7.13 ms) : 0, 7130
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (796.164 ms) : 0, 796164
BytebuddyAgent [candidate] (808.058 ms) : 0, 808058
GlobalTracer [baseline] (300.476 ms) : 0, 300476
GlobalTracer [candidate] (304.469 ms) : 0, 304469
AppSec [baseline] (57.656 ms) : 0, 57656
AppSec [candidate] (55.737 ms) : 0, 55737
IAST [baseline] (20.241 ms) : 0, 20241
IAST [candidate] (23.188 ms) : 0, 23188
Remote Config [baseline] (617.13 µs) : 0, 617
Remote Config [candidate] (622.018 µs) : 0, 622
Telemetry [baseline] (7.113 ms) : 0, 7113
Telemetry [candidate] (7.215 ms) : 0, 7215
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (804.916 ms) : 0, 804916
BytebuddyAgent [candidate] (793.041 ms) : 0, 793041
GlobalTracer [baseline] (303.985 ms) : 0, 303985
GlobalTracer [candidate] (300.233 ms) : 0, 300233
AppSec [baseline] (56.277 ms) : 0, 56277
AppSec [candidate] (53.048 ms) : 0, 53048
IAST [baseline] (22.755 ms) : 0, 22755
IAST [candidate] (24.96 ms) : 0, 24960
Remote Config [baseline] (619.684 µs) : 0, 620
Remote Config [candidate] (585.851 µs) : 0, 586
Telemetry [baseline] (7.03 ms) : 0, 7030
Telemetry [candidate] (6.876 ms) : 0, 6876
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1069493
Total [baseline] (10.408 s) : 0, 10407752
Agent [candidate] (1.071 s) : 0, 1070904
Total [candidate] (10.366 s) : 0, 10365523
section appsec
Agent [baseline] (1.203 s) : 0, 1202661
Total [baseline] (10.555 s) : 0, 10555387
Agent [candidate] (1.207 s) : 0, 1207170
Total [candidate] (10.595 s) : 0, 10594985
section iast
Agent [baseline] (1.204 s) : 0, 1204105
Total [baseline] (10.875 s) : 0, 10875057
Agent [candidate] (1.204 s) : 0, 1203724
Total [candidate] (10.862 s) : 0, 10861932
section profiling
Agent [baseline] (1.274 s) : 0, 1273863
Total [baseline] (10.619 s) : 0, 10619315
Agent [candidate] (1.273 s) : 0, 1273223
Total [candidate] (10.584 s) : 0, 10584368
gantt
title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.941 ms) : 0, 681941
BytebuddyAgent [candidate] (682.887 ms) : 0, 682887
GlobalTracer [baseline] (311.206 ms) : 0, 311206
GlobalTracer [candidate] (312.249 ms) : 0, 312249
AppSec [baseline] (53.819 ms) : 0, 53819
AppSec [candidate] (53.713 ms) : 0, 53713
Remote Config [baseline] (1.245 ms) : 0, 1245
Remote Config [candidate] (662.982 µs) : 0, 663
Telemetry [baseline] (7.634 ms) : 0, 7634
Telemetry [candidate] (7.668 ms) : 0, 7668
section appsec
BytebuddyAgent [baseline] (698.304 ms) : 0, 698304
BytebuddyAgent [candidate] (701.141 ms) : 0, 701141
GlobalTracer [baseline] (307.667 ms) : 0, 307667
GlobalTracer [candidate] (309.318 ms) : 0, 309318
AppSec [baseline] (163.118 ms) : 0, 163118
AppSec [candidate] (164.019 ms) : 0, 164019
Remote Config [baseline] (638.457 µs) : 0, 638
Remote Config [candidate] (651.787 µs) : 0, 652
Telemetry [baseline] (9.211 ms) : 0, 9211
Telemetry [candidate] (7.85 ms) : 0, 7850
IAST [baseline] (20.103 ms) : 0, 20103
IAST [candidate] (20.971 ms) : 0, 20971
section iast
BytebuddyAgent [baseline] (802.561 ms) : 0, 802561
BytebuddyAgent [candidate] (801.684 ms) : 0, 801684
GlobalTracer [baseline] (301.581 ms) : 0, 301581
GlobalTracer [candidate] (301.792 ms) : 0, 301792
AppSec [baseline] (53.943 ms) : 0, 53943
AppSec [candidate] (54.944 ms) : 0, 54944
Remote Config [baseline] (617.254 µs) : 0, 617
Remote Config [candidate] (620.911 µs) : 0, 621
Telemetry [baseline] (7.098 ms) : 0, 7098
Telemetry [candidate] (7.136 ms) : 0, 7136
IAST [baseline] (24.506 ms) : 0, 24506
IAST [candidate] (23.763 ms) : 0, 23763
section profiling
ProfilingAgent [baseline] (97.113 ms) : 0, 97113
ProfilingAgent [candidate] (97.085 ms) : 0, 97085
BytebuddyAgent [baseline] (679.288 ms) : 0, 679288
BytebuddyAgent [candidate] (678.865 ms) : 0, 678865
GlobalTracer [baseline] (395.275 ms) : 0, 395275
GlobalTracer [candidate] (395.488 ms) : 0, 395488
AppSec [baseline] (55.003 ms) : 0, 55003
AppSec [candidate] (54.761 ms) : 0, 54761
Remote Config [baseline] (657.97 µs) : 0, 658
Remote Config [candidate] (661.072 µs) : 0, 661
Telemetry [baseline] (7.567 ms) : 0, 7567
Telemetry [candidate] (7.471 ms) : 0, 7471
Profiling [baseline] (97.137 ms) : 0, 97137
Profiling [candidate] (97.109 ms) : 0, 97109
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section baseline
no_agent (1.365 ms) : 1345, 1385
. : milestone, 1365,
appsec (1.757 ms) : 1733, 1781
. : milestone, 1757,
appsec_no_iast (1.72 ms) : 1695, 1745
. : milestone, 1720,
iast (1.485 ms) : 1463, 1508
. : milestone, 1485,
profiling (1.489 ms) : 1465, 1514
. : milestone, 1489,
tracing (1.471 ms) : 1446, 1495
. : milestone, 1471,
section candidate
no_agent (1.355 ms) : 1336, 1375
. : milestone, 1355,
appsec (1.724 ms) : 1701, 1747
. : milestone, 1724,
appsec_no_iast (1.735 ms) : 1710, 1760
. : milestone, 1735,
iast (1.468 ms) : 1445, 1490
. : milestone, 1468,
profiling (1.48 ms) : 1456, 1505
. : milestone, 1480,
tracing (1.473 ms) : 1448, 1498
. : milestone, 1473,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section baseline
no_agent (382.452 µs) : 353, 412
. : milestone, 382,
iast (486.632 µs) : 466, 508
. : milestone, 487,
iast_FULL (564.939 µs) : 544, 586
. : milestone, 565,
iast_GLOBAL (521.721 µs) : 499, 544
. : milestone, 522,
iast_HARDCODED_SECRET_DISABLED (493.731 µs) : 473, 515
. : milestone, 494,
iast_INACTIVE (454.458 µs) : 434, 475
. : milestone, 454,
iast_TELEMETRY_OFF (475.412 µs) : 454, 497
. : milestone, 475,
tracing (452.206 µs) : 431, 473
. : milestone, 452,
section candidate
no_agent (377.894 µs) : 358, 398
. : milestone, 378,
iast (497.679 µs) : 476, 519
. : milestone, 498,
iast_FULL (561.522 µs) : 540, 583
. : milestone, 562,
iast_GLOBAL (515.511 µs) : 493, 538
. : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (485.659 µs) : 464, 507
. : milestone, 486,
iast_INACTIVE (454.196 µs) : 433, 475
. : milestone, 454,
iast_TELEMETRY_OFF (485.556 µs) : 464, 507
. : milestone, 486,
tracing (449.102 µs) : 428, 470
. : milestone, 449,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section baseline
no_agent (15.445 s) : 15445000, 15445000
. : milestone, 15445000,
appsec (15.389 s) : 15389000, 15389000
. : milestone, 15389000,
iast (18.936 s) : 18936000, 18936000
. : milestone, 18936000,
iast_GLOBAL (18.001 s) : 18001000, 18001000
. : milestone, 18001000,
profiling (15.015 s) : 15015000, 15015000
. : milestone, 15015000,
tracing (15.197 s) : 15197000, 15197000
. : milestone, 15197000,
section candidate
no_agent (14.88 s) : 14880000, 14880000
. : milestone, 14880000,
appsec (15.332 s) : 15332000, 15332000
. : milestone, 15332000,
iast (18.722 s) : 18722000, 18722000
. : milestone, 18722000,
iast_GLOBAL (18.059 s) : 18059000, 18059000
. : milestone, 18059000,
profiling (15.112 s) : 15112000, 15112000
. : milestone, 15112000,
tracing (15.293 s) : 15293000, 15293000
. : milestone, 15293000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~a8c16d0184, baseline=1.41.0-SNAPSHOT~e5e542705f
dateFormat X
axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.333 ms) : 2293, 2374
. : milestone, 2333,
iast (2.083 ms) : 2031, 2135
. : milestone, 2083,
iast_GLOBAL (2.127 ms) : 2075, 2179
. : milestone, 2127,
profiling (1.953 ms) : 1912, 1994
. : milestone, 1953,
tracing (1.917 ms) : 1878, 1956
. : milestone, 1917,
section candidate
no_agent (1.476 ms) : 1465, 1488
. : milestone, 1476,
appsec (2.33 ms) : 2290, 2370
. : milestone, 2330,
iast (2.094 ms) : 2042, 2145
. : milestone, 2094,
iast_GLOBAL (2.125 ms) : 2073, 2176
. : milestone, 2125,
profiling (1.956 ms) : 1916, 1997
. : milestone, 1956,
tracing (1.923 ms) : 1884, 1962
. : milestone, 1923,
|
anmarchenko
approved these changes
Oct 7, 2024
nikita-tkachenko-datadog
deleted the
nikita-tkachenko/revert-http-client-sharing
branch
October 7, 2024 15:24
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Partially reverts the changes done in #7689
Shared HTTP client is replaced with dedicated HTTP clients for events intake, coverage intake, and backend API - the way it was before the changes.
Motivation
Sharing HTTP client results in performance regression in the Java test environment.
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: SDTEST-999