[Perf] Linux/arm64: 4 Regressions on 1/15/2023 10:11:50 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	2eca2d319bf8d1247edf38facfdd501e0e2f0030
Compare	51a8dd5323721b363e61069575511f783e7ea6d3
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterInt64 - Duration of single invocation	12.25 ns	20.24 ns	1.65	0.04	False
FormatterInt64 - Duration of single invocation	51.09 ns	63.03 ns	1.23	0.01	False
FormatterInt32 - Duration of single invocation	12.32 ns	20.29 ns	1.65	0.05	False
FormatterInt32 - Duration of single invocation	24.67 ns	35.31 ns	1.43	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 12345)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.241473391874 > 12.900434722258819.
IsChangePoint: Marked as a change because one of 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -116.69506682409677 (T) = (0 -20.314258914404636) / Math.Sqrt((0.037386634854496344 / (30)) + (0.0383593902855049 / (11))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (11) - 2, .025) and -0.653496239395623 = (12.285639622518763 - 20.314258914404636) / 12.285639622518763 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.033498985474395 > 53.85590932789411.
IsChangePoint: Marked as a change because one of 10/7/2022 4:12:34 PM, 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -71.5076373481325 (T) = (0 -62.91391313172238) / Math.Sqrt((0.5006134271469336 / (30)) + (0.11776938785214766 / (12))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (12) - 2, .025) and -0.22703684890856013 = (51.27304301226473 - 62.91391313172238) / 51.27304301226473 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.28702077881384 > 12.938107452093789.
IsChangePoint: Marked as a change because one of 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -136.92178152625198 (T) = (0 -20.335700138793968) / Math.Sqrt((0.058972566023469244 / (30)) + (0.018189690500740895 / (12))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (12) - 2, .025) and -0.6591543635555609 = (12.256665555346308 - 20.335700138793968) / 12.256665555346308 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.30611241930713 > 25.920722220958154.
IsChangePoint: Marked as a change because one of 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -132.5276293005593 (T) = (0 -35.37381388028373) / Math.Sqrt((0.1395463818629127 / (30)) + (0.021561052242548246 / (12))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (12) - 2, .025) and -0.43030420399848535 = (24.731671613209624 - 35.37381388028373) / 24.731671613209624 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[cincuranet]

dotnet/runtime#80745