[Perf] Changes at 4/14/2022 4:58:13 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	1a296c06fff8750b4658f6f7d901347e006744d0
Compare	276f2d2107f264e9a0c8d92f01a0daf27e8d77b5
Diff	Diff

Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterInt32 - Duration of single invocation	19.64 ns	11.94 ns	0.61	0.65	False
FormatterInt32 - Duration of single invocation	4.62 ns	1.16 ns	0.25	0.82	False
FormatterInt64 - Duration of single invocation	19.64 ns	18.60 ns	0.95	0.62	False
FormatterInt32 - Duration of single invocation	28.13 ns	20.79 ns	0.74	0.58	False
FormatterInt32 - Duration of single invocation	27.73 ns	18.10 ns	0.65	0.66	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 12345)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.93678832727333 < 18.65750942217879.
IsChangePoint: Marked as a change because one of 4/14/2022 9:05:43 AM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 13.229210854495886 (T) = (0 -13.499408107902328) / Math.Sqrt((4.97884539504073 / (299)) + (6.0581465032855135 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.3812392371003437 = (21.816845729908557 - 13.499408107902328) / 21.816845729908557 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.155119877250097 < 4.938804545567359.
IsChangePoint: Marked as a change because one of 4/14/2022 3:36:10 AM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 6.443857924871652 (T) = (0 -3.26669916427079) / Math.Sqrt((3.979630313934193 / (299)) + (3.067190070540458 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.46473602943900183 = (6.102968523823929 - 3.26669916427079) / 6.102968523823929 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.601856085906896 < 23.050768058959466.
IsChangePoint: Marked as a change because one of 4/14/2022 9:05:43 AM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 10.665001341923098 (T) = (0 -14.255719285566201) / Math.Sqrt((5.177851070723027 / (299)) + (7.229460010329126 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.3388108358843218 = (21.5607273368323 - 14.255719285566201) / 21.5607273368323 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.794741654253666 < 27.531677904448923.
IsChangePoint: Marked as a change because one of 1/22/2022 7:56:14 AM, 4/14/2022 9:05:43 AM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 24.647200495415223 (T) = (0 -20.5456548749211) / Math.Sqrt((6.160267234316387 / (299)) + (2.522968504493327 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.33622504172201767 = (30.952741766911892 - 20.5456548749211) / 30.952741766911892 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.09845811666128 < 22.865443581195603.
IsChangePoint: Marked as a change because one of 4/14/2022 4:58:13 PM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 16.705979758425354 (T) = (0 -16.720712737184037) / Math.Sqrt((6.546646381456363 / (299)) + (4.893723109344009 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.3708780078323316 = (26.577854446912692 - 16.720712737184037) / 26.577854446912692 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Improvements from: dotnet/runtime#67902