conbench-apache-arrow / Conbench performance report
succeeded
Sep 10, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit f3dd298.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
test-mac-arm
at 2024-09-10 06:22:28Z - Commit Run on
arm64-t4g-2xlarge-linux
at 2024-09-10 04:30:03Z - Commit Run on
amd64-c6a-4xlarge-linux
at 2024-09-10 01:25:04Z - Commit Run on
amd64-m5-4xlarge-linux
at 2024-09-10 01:37:23Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
test-mac-arm
at 2024-09-10 06:22:28ZCopyShortVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<Divide, DoubleType>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkMoveEmptyVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, Int8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Divide, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Divide, Int64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkMoveShortVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector
(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkArrayScalarKernel
(C++) with params=<DivideChecked, UInt64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBitmapReader
(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkArrayScalarKernel
(C++) with params=<Divide, Int16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBitRunReader
(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmarkArrayScalarKernel
(C++) with params=<DivideChecked, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkMoveEmptyVector
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector
(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkShortVectorInsertAtEnd
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector
(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, UInt64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkCopyShortVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyShortVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, Int8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkmemory_latency
(C++) with params=4096/repeats:1, source=cpp-micro, suite=arrow-machine-benchmarkArrayScalarKernel
(C++) with params=<DivideChecked, UInt32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkMoveShortVector
(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkConstructFromShortStdVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<Divide, UInt32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkMoveShortVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorPushBack
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, Int8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkConstructFromShortStdVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkVisitBits
(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkInlinedTrieLookupFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, Int16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkShortVectorPushBack
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkCopyEmptyVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Divide, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBenchmarkBitmapAnd
(C++) with params=32768/2, source=cpp-micro, suite=arrow-bit-util-benchmarkReadMmapCachedFile
(C++) with params=num_cols:1/is_partial:1/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkMoveEmptyVector
(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<Divide, Int32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBenchmarkBitmapVisitBitsetAnd
(C++) with params=32768/1, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveShortVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, Int16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, Int16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkCopyShortVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkLongVectorInsertAtEnd
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkArraySortIndicesBool
(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkConstructFromEmptyStdVector
(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkTrieLookupFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkMoveEmptyVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector
(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyBitmapWithOffsetBoth
(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkBenchmarkBitmapAnd
(C++) with params=32768/1, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveShortVector
(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkConstructFromShortStdVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector
(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkArrayScalarKernel
(C++) with params=<DivideChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkCastUInt32ToInt32Safe
(C++) with params=4194304/1000, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkCopyEmptyVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitBlockCounterBench
(C++) with params=1031168, source=cpp-micro, suite=arrow-bitmap-reader-benchmarkUniqueUInt8
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkReadCachedFile
(C++) with params=num_cols:512/is_partial:1/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkBitmapEqualsWithOffset
(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkShortVectorInsert
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmark
-
Commit Run on
arm64-t4g-2xlarge-linux
at 2024-09-10 04:30:03ZBenchmarkTemporalBinary
(C++) with params=<MonthsBetween, non_zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<QuartersBetween, date64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<Quarter, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkInt8ColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBitmapReaderSum
(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkErrorSchemeException
(C++) with source=cpp-micro, suite=arrow-type-benchmarkInlinedTrieLookupFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkErrorSchemeExceptionNoInline
(C++) with source=cpp-micro, suite=arrow-type-benchmarkBenchmarkTemporalBinary
(C++) with params=<YearsBetween, date32_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<MonthsBetween, date32_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkInlinedTrieLookupNotFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkBenchmarkTemporal
(C++) with params=<Nanosecond, zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<Quarter, non_zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkErrorSchemeStatus
(C++) with source=cpp-micro, suite=arrow-type-benchmark
-
Commit Run on
amd64-c6a-4xlarge-linux
at 2024-09-10 01:25:04ZapproxEqualsBenchmark
(Java) with source=java-micro, suite=arrow.vector.FloatingPointBenchmarksTouchArea
(C++) with params=size:1048576/real_time/threads:8, source=cpp-micro, suite=arrow-memory-pool-benchmarkBenchmarkTemporalBinary
(C++) with params=<WeeksBetween, zoned>/524288/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkRoundBinaryArrayBenchmark
(C++) with params=<RoundBinary, Int64Type, RoundMode::HALF_TO_ODD>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmark
-
Commit Run on
amd64-m5-4xlarge-linux
at 2024-09-10 01:37:23ZRoundDerivativesArrayBenchmark
(C++) with params=<Ceil, FloatType>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_10_month>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_FindExistingHash
(C++) with source=cpp-micro, suite=parquet-bloom-filter-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading