[Perf] Windows/arm64: 5 Improvements on 11/7/2022 8:57:30 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.25094
Baseline	bfa4812aec806f09f1e2927939ba98118e5e5bf7
Compare	2aebbf75167b3aa21cae23e6fd702688dd724663
Diff	Diff

Improvements in System.IO.Tests.StreamReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadLine - Duration of single invocation	39.57 μs	13.80 μs	0.35	0.55	False
ReadLine - Duration of single invocation	43.53 μs	14.16 μs	0.33	0.58	False
ReadLine - Duration of single invocation	50.65 μs	15.14 μs	0.30	0.58	False
ReadLine - Duration of single invocation	57.56 μs	46.38 μs	0.81	0.57	False
ReadLine - Duration of single invocation	49.31 μs	21.83 μs	0.44	0.55	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

Related Issues

Regressions

• [Perf] Windows/arm64: 1 Regression on 11/7/2022 8:57:30 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024])

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.80136596958175 < 41.958699701318444.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 65.95500048825585 (T) = (0 -13834.610003406791) / Math.Sqrt((8546873.889663717 / (299)) + (1203323.5098501043 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.6809843978493509 = (43366.56235663879 - 13834.610003406791) / 43366.56235663879 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [   0, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.157511976744185 < 41.77659850767296.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 83.58889460409634 (T) = (0 -13291.898867222513) / Math.Sqrt((7519252.257957592 / (299)) + (721061.9008611278 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.6924302709095511 = (43215.887683516754 - 13291.898867222513) / 43215.887683516754 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.137922845691385 < 45.07923367165876.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 83.57681160842189 (T) = (0 -14085.612729065137) / Math.Sqrt((12480087.280047791 / (299)) + (734493.7902230732 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.6944097995873105 = (46093.142744901445 - 14085.612729065137) / 46093.142744901445 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [   9,   32])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 46.38491604477611 < 62.28481693279347.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 17.045812102824712 (T) = (0 -44970.7112777283) / Math.Sqrt((20832602.589264795 / (299)) + (9462891.905442135 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.31125792825745385 = (65293.98031973061 - 44970.7112777283) / 65293.98031973061 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [  33,  128])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.827997863247862 < 43.80401422747017.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 51.19968453771315 (T) = (0 -20558.37452666308) / Math.Sqrt((9328380.24684689 / (299)) + (1369940.596201246 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.5426093359835911 = (44947.07947498803 - 20558.37452666308) / 44947.07947498803 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[kunalspathak]

dotnet/runtime#69888