[Perf] Linux/x64: 1 Regression on 10/20/2022 5:12:08 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	10d342cecc5cbfc57419f8a92af4787f29d76c08
Compare	be7d6f557b80c211d10f29b57fa43dc55e8d66cf
Diff	Diff

Regressions in System.Buffers.Binary.Tests.BinaryReadAndWriteTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadStructFieldByFieldLE - Duration of single invocation	12.59 ns	22.35 ns	1.77	0.75	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'

Related Issues

Regressions

• [Perf] Windows/x64: 5 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Linux/x64: 44 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Windows/x64: 3 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Alpine/x64: 33 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Windows/x86: 20 Regressions on 10/20/2022 5:12:08 PM

Improvements

• [Perf] Linux/x64: 13 Improvements on 10/20/2022 5:12:08 PM
• [Perf] Alpine/x64: 10 Improvements on 10/20/2022 5:12:08 PM
• [Perf] Windows/x86: 7 Improvements on 10/20/2022 5:12:08 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 22.34927671692927 > 13.257321816632778.
IsChangePoint: Marked as a change because one of 10/19/2022 7:27:15 PM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -3.363492279713482 (T) = (0 -15.382083565838139) / Math.Sqrt((1.1715224483062163 / (24)) + (6.8101284182585555 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.1717659769546881 = (13.127265911760604 - 15.382083565838139) / 13.127265911760604 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

Looks like noise