[Perf] Windows/x64: 3 Improvements on 10/20/2022 5:12:08 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	10d342cecc5cbfc57419f8a92af4787f29d76c08
Compare	be7d6f557b80c211d10f29b57fa43dc55e8d66cf
Diff	Diff

Improvements in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SortedList - Duration of single invocation	22.45 μs	19.72 μs	0.88	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse<Int32, Int32>*'

Related Issues

Regressions

• [Perf] Windows/x64: 5 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Linux/x64: 44 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Windows/x64: 3 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Alpine/x64: 33 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Windows/x86: 20 Regressions on 10/20/2022 5:12:08 PM

Improvements

• [Perf] Linux/x64: 13 Improvements on 10/20/2022 5:12:08 PM
• [Perf] Alpine/x64: 10 Improvements on 10/20/2022 5:12:08 PM
• [Perf] Windows/x86: 7 Improvements on 10/20/2022 5:12:08 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.ContainsKeyFalse<Int32, Int32>.SortedList(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 19.718780910735827 < 21.34106364701807.
IsChangePoint: Marked as a change because one of 8/18/2022 3:00:51 AM, 9/1/2022 8:04:48 PM, 9/3/2022 11:44:47 AM, 9/9/2022 3:12:19 AM, 9/13/2022 12:23:36 PM, 10/10/2022 3:36:43 PM, 10/19/2022 7:27:15 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 17.69328499610716 (T) = (0 -19052.127904230634) / Math.Sqrt((1319840.5109617303 / (299)) + (76469.06753287821 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.08060526744727578 = (20722.467977744323 - 19052.127904230634) / 20722.467977744323 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	10d342cecc5cbfc57419f8a92af4787f29d76c08
Compare	be7d6f557b80c211d10f29b57fa43dc55e8d66cf
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Uri_IsNotMatch - Duration of single invocation	104.96 ns	94.75 ns	0.90	0.07	False
Uri_IsNotMatch - Duration of single invocation	111.58 ns	95.03 ns	0.85	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Related Issues

Regressions

• [Perf] Windows/x64: 5 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Linux/x64: 44 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Windows/x64: 3 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Alpine/x64: 33 Regressions on 10/20/2022 5:12:08 PM
• [Perf] Windows/x86: 20 Regressions on 10/20/2022 5:12:08 PM

Improvements

• [Perf] Linux/x64: 13 Improvements on 10/20/2022 5:12:08 PM
• [Perf] Alpine/x64: 10 Improvements on 10/20/2022 5:12:08 PM
• [Perf] Windows/x86: 7 Improvements on 10/20/2022 5:12:08 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: Compiled)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 94.75230276790307 < 99.06111969276441.
IsChangePoint: Marked as a change because one of 8/24/2022 2:39:26 AM, 9/9/2022 3:12:19 AM, 10/19/2022 7:27:15 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 29.97272101883127 (T) = (0 -95.57687947317072) / Math.Sqrt((16.723031157261186 / (299)) + (0.7230848093608188 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.08958814849132721 = (104.98202469002045 - 95.57687947317072) / 104.98202469002045 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 95.02785758914162 < 106.4387625641093.
IsChangePoint: Marked as a change because one of 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 10/14/2022 3:33:41 AM, 10/18/2022 1:35:00 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 9.796939799539965 (T) = (0 -98.51145581113562) / Math.Sqrt((18.603624882780444 / (299)) + (8.164553613647964 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.057493779252682356 = (104.5207486620358 - 98.51145581113562) / 104.5207486620358 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository