[Perf] Changes at 4/6/2022 7:22:46 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	alpine 3.12
Baseline	22870c2e31ae3c028cece52babd3cae57b560713
Compare	afb1c64a8dd8933d7b4aab99ab0eade72d6e2dab
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IsMatch - Duration of single invocation	103.69 ns	97.91 ns	0.94	0.06	False
IsMatch - Duration of single invocation	103.04 ns	96.71 ns	0.94	0.06	False
IsMatch - Duration of single invocation	102.04 ns	95.65 ns	0.94	0.04	False
IsMatch - Duration of single invocation	86.83 ns	77.66 ns	0.89	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple.IsMatch(Id: 6, Options: None)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 97.91162936838079 < 98.36204349719328.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 4/6/2022 1:01:14 PM, 4/12/2022 4:54:37 AM falls between 4/3/2022 1:52:36 PM and 4/12/2022 4:54:37 AM.
IsImprovementStdDev: Marked as improvement because 12.681656875272301 (T) = (0 -98.70509674754054) / Math.Sqrt((15.865913148269458 / (299)) + (11.933973243790978 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.08168135401921732 = (107.48458302523251 - 98.70509674754054) / 107.48458302523251 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple.IsMatch(Id: 7, Options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.71296322911599 < 98.1003693202693.
IsChangePoint: Marked as a change because one of 3/4/2022 3:52:45 PM, 3/17/2022 3:08:05 PM, 4/6/2022 11:11:30 PM, 4/12/2022 4:54:37 AM falls between 4/3/2022 1:52:36 PM and 4/12/2022 4:54:37 AM.
IsImprovementStdDev: Marked as improvement because 30.97245114844094 (T) = (0 -97.01971221874282) / Math.Sqrt((18.76497484763615 / (299)) + (0.8393565279045899 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.08959957674933856 = (106.56817565212214 - 97.01971221874282) / 106.56817565212214 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple.IsMatch(Id: 8, Options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 95.64723572381713 < 96.8571803316797.
IsChangePoint: Marked as a change because one of 3/4/2022 3:52:45 PM, 3/17/2022 6:54:53 PM, 4/6/2022 11:11:30 PM, 4/12/2022 4:54:37 AM falls between 4/3/2022 1:52:36 PM and 4/12/2022 4:54:37 AM.
IsImprovementStdDev: Marked as improvement because 29.235039584524944 (T) = (0 -96.31446365753816) / Math.Sqrt((21.827842072124607 / (299)) + (1.0298494862781704 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.09244400178172105 = (106.12509183634229 - 96.31446365753816) / 106.12509183634229 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple.IsMatch(Id: 11, Options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 77.66375991531513 < 81.71550346474666.
IsChangePoint: Marked as a change because one of 3/4/2022 3:52:45 PM, 3/16/2022 5:02:20 PM, 4/6/2022 12:51:22 AM, 4/12/2022 4:54:37 AM falls between 4/3/2022 1:52:36 PM and 4/12/2022 4:54:37 AM.
IsImprovementStdDev: Marked as improvement because 42.43696197317775 (T) = (0 -77.92918851938465) / Math.Sqrt((9.88250902718341 / (299)) + (0.5596538965358628 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.1101841075484582 = (87.57900278076745 - 77.92918851938465) / 87.57900278076745 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Looks like dotnet/runtime#67184

[performanceautofiler]

Closing because it's stale.