After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 02f461f.

Benchmarks with performance regressions

There were 0 possible performance regressions, according to the lookback z-score method.

All benchmark runs analyzed:

• Commit Run on test-mac-arm at 2024-06-14 16:57:34Z
• Commit Run on ec2-t3-xlarge-us-east-2 at 2024-06-15 10:27:28Z
• Commit Run on ec2-m5-4xlarge-us-east-2 at 2024-06-14 03:41:45Z
• Commit Run on ursa-thinkcentre-m75q at 2024-06-14 05:42:22Z
• Commit Run on arm64-t4g-linux-compute at 2024-06-14 05:24:58Z
• Commit Run on arm64-m6g-linux-compute at 2024-06-14 05:01:50Z

Unstable benchmarks with performance regressions

The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.

• Commit Run on test-mac-arm at 2024-06-14 16:57:34Z
  • FilterOverhead (C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000/null_prob:75/bool_true_prob:100/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • ScanOnlyBench (C++) with params=num_batches:1000/batch_size:10/scan_alg:1/real_time, source=cpp-micro, suite=arrow-dataset-scanner-benchmark
  • BM_DeltaBitPackingEncode_Int32_Narrow (C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmark
  • BM_ByteStreamSplitDecode_Double_Neon (C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmark
  • BM_DeltaBitPackingEncode_Int64_Narrow (C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmark
  • FilterOverhead (C++) with params=simple_expression/batch_size:10000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • BM_ExecSpanIterator (C++) with params=1024, source=cpp-micro, suite=arrow-compute-function-benchmark
  • MinimalEndToEndBench (C++) with params=num_batches:1000/batch_size:1000/scan_alg:0/real_time, source=cpp-micro, suite=arrow-dataset-scanner-benchmark
  • FilterOverheadIsolated (C++) with params=ref_only_expression/batch_size:10000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=complex_expression/batch_size:10000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • ListSliceInt64ListViewWithStepAndStop (C++) with params=65536/100, source=cpp-micro, suite=arrow-compute-scalar-list-benchmark
  • BM_DeltaBitPackingDecode_Int32_Narrow (C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmark
  • FilterOverhead (C++) with params=selectivity_benchmark/batch_size:100000/null_prob:75/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=selectivity_benchmark/batch_size:10000/null_prob:75/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • ListSliceInt64ListViewWithStepAndStop (C++) with params=65536/10000, source=cpp-micro, suite=arrow-compute-scalar-list-benchmark
  • ListSliceStringListViewWithStop (C++) with params=65536/2, source=cpp-micro, suite=arrow-compute-scalar-list-benchmark