-
Notifications
You must be signed in to change notification settings - Fork 0
/
report_2024-05-01T12:41:32.522884_jfr_nmt_vs_plain.txt
116 lines (107 loc) · 8.83 KB
/
report_2024-05-01T12:41:32.522884_jfr_nmt_vs_plain.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
MODE: work
ITERATIONS: 10
JAVA_HOME: /home/rtoyonag/JDKs/labsjdk-ce-22+22-jvmci-b01-linux-amd64/labsjdk-ce-22-jvmci-b01
GRAALVM_HOME: /home/rtoyonag/IdeaProjects/graal/vm/latest_graalvm_home
HYPERFOIL_HOME: /home/rtoyonag/tools/hyperfoil-0.24.1
Image size with NMT: 50938336
Image size without NMT: 47290272
------------------------------------------------
Average Performance Difference:
These values are averages calculated using the results in the 'Performance Difference' section.
mean (NI): 0.40847277472320176
mean (JAVA): 0.3540198926828063
startup (NI): 0.4006713849172947
startup (JAVA): 0.4600732444547231
p90 (NI): 0.44232086566888207
p90 (JAVA): 0.6355550311038513
p50 (NI): 0.3781534969516218
p50 (JAVA): 0.11495594865090915
p99 (NI): 0.33004371507312324
p99 (JAVA): 2.1453610947557595
rss (NI): 0.3837149989991111
rss (JAVA): 0.27916224638210707
max (NI): 0.1086674321215289
max (JAVA): 2.2312192030842377
------------------------------------------------
Average Measurments:
These values are averages calculated using the results in the 'Raw Measurements' section.
mean (Without NMT in build): 3594.3429
mean (With NMT): 5038.891999999999
mean (Java mode without NMT): 4451.9844
mean (Java mode with NMT): 5990.823899999999
startup (Without NMT in build): 0.13813204765319823
startup (With NMT): 0.1935462713241577
startup (Java mode without NMT): 1.3151977777481079
startup (Java mode with NMT): 1.920451021194458
p90 (Without NMT in build): 4662.8854
p90 (With NMT): 6704.3318
p90 (Java mode without NMT): 5826.149399999999
p90 (Java mode with NMT): 9525.6566
p50 (Without NMT in build): 3548.7734
p50 (With NMT): 4882.431
p50 (Java mode without NMT): 4325.375000000001
p50 (Java mode with NMT): 4793.957399999999
p99 (Without NMT in build): 9591.1926
p99 (With NMT): 12320.767000000002
p99 (Java mode without NMT): 10623.384600000001
p99 (Java mode with NMT): 30644.632599999997
rss (Without NMT in build): 52388.0
rss (With NMT): 72366.8
rss (Java mode without NMT): 149756.0
rss (Java mode with NMT): 191504.00000000003
max (Without NMT in build): 17327.717399999998
max (With NMT): 18219.007
max (Java mode without NMT): 14666.9558
max (Java mode with NMT): 44210.5846
------------------------------------------------
Performance Difference:
These values are calculated pair-wise for each iteration. They are percentages calcluated using (With NMT - Without NMT) / Without NMT.
mean (NI): [0.22895677543628612, 0.5427275624850594, 0.2792487019390915, 0.5967265220639086, 0.44056394462533316, 0.39717291134004384, 0.3579671569918361, 0.47888873879465393, 0.4322085981366419, 0.3302668354191628]
mean (JAVA): [0.34559435640437386, 0.5326119615297584, 0.14130084376264446, 0.22043041672648409, 0.24891383106341067, 0.6257571787040532, 0.43585317701037857, 0.288725218958153, 0.4399439705162515, 0.26106797215255484]
startup (NI): [0.36454251810057053, 0.3581256597022076, 0.41212147745029365, 0.41424537472803863, 0.4252522439462318, 0.38494768118688577, 0.4618251755041966, 0.3809406299656355, 0.38846706656333535, 0.4162460220255513]
startup (JAVA): [0.4474501258871954, 0.4459784463729626, 0.46196744454967564, 0.44561002166939834, 0.4356100558193067, 0.5068398022610262, 0.4029955757644919, 0.5041532523721837, 0.4920692847458834, 0.45805843510510685]
p90 (NI): [0.21232881150521296, 0.4320001054687757, 0.34640529785261936, 0.8045114627950484, 0.4246576230104259, 0.4295775571103286, 0.333333399820445, 0.46896561594272274, 0.47857153289174387, 0.49285725029149746]
p90 (JAVA): [0.7142858340564492, 0.9418606322285199, 0.41666673289406037, 0.3687151466608564, 0.5459460360051397, 0.7444445706591409, 0.7252748468880869, 0.6263737314033477, 0.45695373473590273, 0.8150290455070089]
p50 (NI): [0.2719298973565079, 0.41708555505970873, 0.2956522523703539, 0.35159827150618916, 0.25471705446554344, 0.5294119109173698, 0.357466162072412, 0.4900001495361783, 0.5794394175989503, 0.23423429863300468]
p50 (JAVA): [0.08695654096886243, 0.12121214923561531, 0.007042255034595556, 0.0735294282642653, 0.0647482156543792, 0.1659193279233727, 0.11851854531036261, 0.07042255034595538, 0.3456222170281384, 0.09558825674354468]
p99 (NI): [0.26973686918327633, 0.23004698131679222, -0.2594339809370207, 1.018348766410725, 0.5645161984986581, 0.4555555941734819, 0.3511450790690739, 0.39393943947756666, 0.03267974182126335, 0.24390246171741597]
p99 (JAVA): [3.993103868482274, 3.62650646856303, 0.17733991480784397, 0.7073171389805063, 0.9271256206219779, 6.521368371864822, 2.2031873849321575, 2.0075190273105967, 1.2290077767417587, 0.061135375252627855]
rss (NI): [0.5569894196857967, 0.34053386823021137, 0.2756768371293511, 0.46039336675665254, 0.3822639707053017, 0.24116822774540894, 0.3403877565513813, 0.39390537289494787, 0.4008334001121885, 0.44499777017987213]
rss (JAVA): [0.34298613522827454, 0.2847768671549541, 0.33741573335481967, 0.3654604374831218, 0.2311517443215664, 0.3002431436115977, 0.3115863490972534, 0.21486883639925983, 0.09847646159523434, 0.30465675557498906]
max (NI): [0.02542373045735304, 0.2390244080352342, 0.03759398711894259, 0.5428571823016346, 0.5195531169148125, -0.266666676354787, -0.24418605734297544, 0.1219512270765369, 0.03759398711894259, 0.07352941588959488]
max (JAVA): [4.2705886186118285, 4.833333772326313, 0.44075832571297785, 2.9788362193303364, 0.36945815584967523, 3.9180331135761794, 2.941606003231188, 1.7948718826524728, 0.7647059395514049, 0.0]
------------------------------------------------
Raw Measurements:
These are individual measurements for each iteration. rss is in kB, startup time is s, all others are in us.
Without NMT in build:
mean: [3783.011, 3011.92, 3965.723, 3464.572, 3428.138, 3834.121, 3827.664, 3286.824, 3608.968, 3732.488]
startup: [0.13234448432922363, 0.1273946762084961, 0.14159393310546875, 0.13906073570251465, 0.1378324031829834, 0.14090347290039062, 0.13995718955993652, 0.1429908275604248, 0.13966989517211914, 0.1395728588104248]
p90: [4784.127, 4095.999, 5013.503, 4358.143, 4784.127, 4653.055, 5013.503, 4751.359, 4587.519, 4587.519]
p50: [3735.551, 3260.415, 3768.319, 3588.095, 3473.407, 3620.863, 3620.863, 3276.799, 3506.175, 3637.247]
p99: [9961.471, 6979.583, 13893.631, 7143.423, 8126.463, 11796.479, 8585.215, 8650.751, 10027.007, 10747.903]
rss: [49904, 51848, 55848, 51860, 50248, 54236, 56324, 49880, 49916, 53816]
max: [15466.495, 13434.879, 17432.575, 13762.559, 11730.943, 27525.119, 22544.383, 16121.855, 17432.575, 17825.791]
With NMT:
mean: [4649.157, 4646.572, 5073.146, 5531.974, 4938.452, 5356.93, 5197.842, 4860.847, 5168.795, 4965.205]
startup: [0.1805896759033203, 0.1730179786682129, 0.19994783401489258, 0.19666600227355957, 0.19644594192504883, 0.1951439380645752, 0.20459294319152832, 0.19746184349060059, 0.19392704963684082, 0.19766950607299805]
p90: [5799.935, 5865.471, 6750.207, 7864.319, 6815.743, 6651.903, 6684.671, 6979.583, 6782.975, 6848.511]
p50: [4751.359, 4620.287, 4882.431, 4849.663, 4358.143, 5537.791, 4915.199, 4882.431, 5537.791, 4489.215]
p99: [12648.447, 8585.215, 10289.151, 14417.919, 12713.983, 17170.431, 11599.871, 12058.623, 10354.687, 13369.343]
rss: [77700, 69504, 71244, 75736, 69456, 67316, 75496, 69528, 69924, 77764]
max: [15859.711, 16646.143, 18087.935, 21233.663, 17825.791, 20185.087, 17039.359, 18087.935, 18087.935, 19136.511]
Java mode without NMT:
mean: [4625.987, 4260.124, 4668.493, 4625.192, 4652.361, 3846.516, 4714.684, 4763.924, 3705.906, 4656.657]
startup: [1.1542413234710693, 1.162733793258667, 1.344294548034668, 1.3529832363128662, 1.3829474449157715, 1.342067003250122, 1.3768155574798584, 1.3273820877075195, 1.3595397472381592, 1.348973035812378]
p90: [5963.775, 5636.095, 6291.455, 5865.471, 6062.079, 5898.239, 5963.775, 5963.775, 4947.967, 5668.863]
p50: [4521.983, 4325.375, 4653.055, 4456.447, 4554.751, 3653.631, 4423.679, 4653.055, 3555.327, 4456.447]
p99: [9502.719, 8159.231, 13303.807, 10747.903, 8093.695, 7667.711, 16449.535, 8716.287, 8585.215, 15007.743]
rss: [149732, 146908, 148932, 148120, 154444, 152996, 151316, 146992, 151752, 146368]
max: [11141.119, 11010.047, 13828.095, 12386.303, 13303.807, 11993.087, 17956.863, 20447.231, 13369.343, 21233.663]
Java mode with NMT:
mean: [6224.702, 6529.117, 5328.155, 5644.725, 5810.398, 6253.501, 6769.594, 6139.389, 5336.297, 5872.361]
startup: [1.6707067489624023, 1.6812880039215088, 1.9653148651123047, 1.9558861255645752, 1.9853732585906982, 2.022279977798462, 1.9316661357879639, 1.9965860843658447, 2.0285274982452393, 1.966881513595581]
p90: [10223.615, 10944.511, 8912.895, 8028.159, 9371.647, 10289.151, 10289.151, 9699.327, 7208.959, 10289.151]
p50: [4915.199, 4849.663, 4685.823, 4784.127, 4849.663, 4259.839, 4947.967, 4980.735, 4784.127, 4882.431]
p99: [47448.063, 37748.735, 15663.103, 18350.079, 15597.567, 57671.679, 52690.943, 26214.399, 19136.511, 15925.247]
rss: [201088, 188744, 199184, 202252, 190144, 198932, 198464, 178576, 166696, 190960]
max: [58720.255, 64225.279, 19922.943, 49283.071, 18219.007, 58982.399, 70778.879, 57147.391, 23592.959, 21233.663]