Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add OperationsPerSecondAttribute #2468

Merged
merged 4 commits into from
Nov 22, 2023

Apply suggestions from code review

40502c7
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Add OperationsPerSecondAttribute #2468

Apply suggestions from code review
40502c7
Select commit
Loading
Failed to load commit list.
GitHub Actions / report succeeded Nov 22, 2023 in 0s

report ✅

Tests passed successfully

Report Passed Failed Skipped Time
test-linux-trx/TestResults/linux-integration-net8.0.trx 216✅ 17⚪ 22m 49s 995ms
test-linux-trx/TestResults/linux-unit-net8.0.trx 903✅ 8⚪ 4s 172ms
test-macos-trx/TestResults/macos-integration-net8.0.trx 219✅ 16⚪ 28m 03s 077ms
test-macos-trx/TestResults/macos-unit-net8.0.trx 903✅ 8⚪ 5s 432ms
test-windows-core-trx/TestResults/windows-integration-net8.0.trx 226✅ 8⚪ 21m 09s 957ms
test-windows-full-trx/TestResults/windows-integration-net462.trx 248✅ 12⚪ 13m 46s 165ms

✅ test-linux-trx/TestResults/linux-integration-net8.0.trx

233 tests were completed in 22m 49s 995ms with 216 passed, 0 failed and 17 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 3m 44s 699ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 12✅ 3⚪ 3m 00s 039ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 58s 989ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 27s 228ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 26s 119ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 4✅ 1m 20s 169ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 54s 748ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 51s 370ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 6✅ 48s 045ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 45s 717ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 38s 498ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 32s 287ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 24s 726ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 23s 367ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 20s 976ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 19s 630ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 16s 147ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 16s 142ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 15s 643ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 15s 248ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 12s 408ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 11s 346ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 11s 166ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 9s 028ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 1✅ 8s 981ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 8s 929ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 8s 524ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 8s 290ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 8s 201ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 8s 085ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 8s 029ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 7s 968ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 962ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 7s 892ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 7s 837ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 7s 778ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 7s 747ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 7s 635ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 5s 200ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 960ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 092ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 166ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 134ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 21ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 9ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 2ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-linux-trx/TestResults/linux-unit-net8.0.trx

911 tests were completed in 4s 172ms with 903 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 2s 971ms
BenchmarkDotNet.Tests.Validators.ConfigCompatibilityValidatorTests 6✅ 475ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 383ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 348ms
BenchmarkDotNet.Tests.ConfigParserTests 81✅ 3⚪ 265ms
BenchmarkDotNet.Tests.Portability.Cpu.CpuInfoFormatterTests 1✅ 185ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 118ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 14✅ 115ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 108ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 93ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 24✅ 88ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 69ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 68ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 60ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 58ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 45ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 44ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 44ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 43ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 10✅ 37ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 35ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 35ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 27✅ 2⚪ 33ms
BenchmarkDotNet.Tests.Configs.JobTests 12✅ 29ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 25ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests 10✅ 23ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 22ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 20ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 18ms
BenchmarkDotNet.Tests.Environments.ProcessorBrandStringTests 24✅ 18ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 15ms
BenchmarkDotNet.Tests.TimeUnitTests 2✅ 15ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 15ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 14ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 14ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 13ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 10✅ 13ms
BenchmarkDotNet.Tests.Portability.Cpu.ProcCpuInfoParserTests 9✅ 12ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 12ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 11ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 11ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 11ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 10ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 9ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 9ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 32✅ 9ms
BenchmarkDotNet.Tests.Environments.OsBrandStringTests 29✅ 8ms
BenchmarkDotNet.Tests.SizeUnitTests 16✅ 8ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 8ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 8ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests 12✅ 7ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 7ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 7ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 6ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 6ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 6ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 6ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 5ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 5ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 5ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 5ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 5ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 5ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 5ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 4ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 4ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 4ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 4ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 3ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 3ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 3ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 3ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 2ms
BenchmarkDotNet.Tests.Portability.Cpu.WmicCpuInfoParserTests 5✅ 2ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 2ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.Portability.Cpu.SysctlCpuInfoParserTests 3✅ 1ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 1ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 1ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 1ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 1ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 1ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-macos-trx/TestResults/macos-integration-net8.0.trx

235 tests were completed in 28m 03s 077ms with 219 passed, 0 failed and 16 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 5m 53s 768ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 12✅ 3⚪ 2m 53s 447ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 2m 37s 030ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 2m 04s 211ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 54s 155ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 6✅ 1m 14s 453ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 1m 12s 040ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 1m 01s 925ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 45s 734ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 43s 186ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 43s 024ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 34s 661ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 32s 492ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 29s 895ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 21s 381ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 19s 926ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 19s 799ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 19s 582ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 16s 322ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 15s 758ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 14s 629ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 13s 183ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 12s 970ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 12s 856ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 12s 306ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 1✅ 12s 117ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 11s 464ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 11s 431ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 11s 334ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 11s 168ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 11s 145ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 10s 634ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 10s 391ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 10s 162ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 10s 076ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 10s 033ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 10s 011ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 6s 589ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 6s 374ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 297ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 181ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 29ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 5ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 8✅ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-macos-trx/TestResults/macos-unit-net8.0.trx

911 tests were completed in 5s 432ms with 903 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 696ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 1s 073ms
BenchmarkDotNet.Tests.Portability.Cpu.CpuInfoFormatterTests 1✅ 789ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 24✅ 318ms
BenchmarkDotNet.Tests.ConfigParserTests 81✅ 3⚪ 317ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 312ms
BenchmarkDotNet.Tests.Validators.ConfigCompatibilityValidatorTests 6✅ 251ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 174ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 27✅ 2⚪ 139ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 122ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 121ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 118ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 97ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 78ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 77ms
BenchmarkDotNet.Tests.Configs.JobTests 12✅ 74ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 66ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 61ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 54ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 51ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 42ms
BenchmarkDotNet.Tests.Portability.Cpu.ProcCpuInfoParserTests 9✅ 40ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 39ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 37ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 34ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 10✅ 32ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 28ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 10✅ 26ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 24ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 22ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 19ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 18ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 17ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 17ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 16ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 16ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 14✅ 15ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests 10✅ 15ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests 12✅ 14ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 14ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 12ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 12ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 11ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 10ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 10ms
BenchmarkDotNet.Tests.Environments.OsBrandStringTests 29✅ 10ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 9ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 8ms
BenchmarkDotNet.Tests.SizeUnitTests 16✅ 8ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 32✅ 7ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 7ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 7ms
BenchmarkDotNet.Tests.Environments.ProcessorBrandStringTests 24✅ 7ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 6ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 6ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 6ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 6ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 5ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 5ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 5ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 5ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 5ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 4ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 4ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 4ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 3ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 3ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 3ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 3ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 3ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 3ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 3ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 2ms
BenchmarkDotNet.Tests.Portability.Cpu.SysctlCpuInfoParserTests 3✅ 2ms
BenchmarkDotNet.Tests.Portability.Cpu.WmicCpuInfoParserTests 5✅ 2ms
BenchmarkDotNet.Tests.TimeUnitTests 2✅ 2ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 2ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 1ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 1ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 1ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-windows-core-trx/TestResults/windows-integration-net8.0.trx

234 tests were completed in 21m 09s 957ms with 226 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 12✅ 3⚪ 3m 19s 018ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 3m 14s 028ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 50s 722ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 13s 688ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 12s 945ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 48s 846ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 47s 207ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 42s 695ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 39s 449ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 38s 033ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 5✅ 1⚪ 34s 557ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 28s 220ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 27s 789ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 22s 579ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 21s 069ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 19s 803ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 15s 941ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 13s 352ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 13s 203ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 13s 195ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 13s 188ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 12s 226ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 11s 489ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 11s 424ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 9s 572ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 9s 559ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 9s 170ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 7s 963ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 1✅ 7s 861ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 7s 790ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 276ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 7s 190ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 7s 153ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 067ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 6s 795ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 6s 704ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 6s 689ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 6s 612ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 6s 598ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 6s 589ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 6s 537ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 6s 532ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 522ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 463ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 235ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 382ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 251ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 33ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 22ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 9ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-windows-full-trx/TestResults/windows-integration-net462.trx

260 tests were completed in 13m 46s 165ms with 248 passed, 0 failed and 12 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 12✅ 4m 38s 200ms
BenchmarkDotNet.IntegrationTests.TailCallDiagnoserTests 4✅ 1m 29s 270ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 1m 24s 643ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 55s 292ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 19✅ 2⚪ 45s 037ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 10✅ 5⚪ 43s 778ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 9✅ 37s 259ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 25s 932ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 2✅ 25s 891ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 21s 690ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 21s 346ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 53✅ 1⚪ 20s 928ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 10s 421ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 5✅ 1⚪ 10s 407ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 9s 227ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 7s 009ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 5s 432ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 3s 506ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 2s 387ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 4✅ 2s 280ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 2s 130ms
BenchmarkDotNet.IntegrationTests.GcModeTests 7✅ 1s 968ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 1s 708ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 1✅ 1s 692ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 415ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 4✅ 1s 175ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 1s 014ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 967ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 897ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 3✅ 850ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 835ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 830ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 801ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 579ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 578ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 556ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 509ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 315ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 301ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 294ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 293ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1✅ 285ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 284ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 279ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 272ms
BenchmarkDotNet.IntegrationTests.CopyToOutputTests 1✅ 270ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 252ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 138ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 91ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 37ms
BenchmarkDotNet.IntegrationTests.Diagnosers.ProcessMetricsTests 3✅ 27ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 12ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 8ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 7ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 6ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.MonoTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1⚪ 1ms