MINOR: [Release] Update versions for 13.0.0
conbench-apache-arrow / Conbench performance report
succeeded
Aug 2, 2023 in 0s
Found 0 regressions
Thanks for your patience. Conbench analyzed the 6 benchmarking runs that have been run so far on PR commit c604084.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Pull Request Run on
ec2-m5-4xlarge-us-east-2at 2023-08-02 07:01:39Z - Pull Request Run on
ec2-t3-xlarge-us-east-2at 2023-08-02 07:52:35Z - Pull Request Run on
arm64-t4g-linux-computeat 2023-08-02 08:22:51Z - Pull Request Run on
arm64-m6g-linux-computeat 2023-08-02 07:50:47Z - Pull Request Run on
ursa-thinkcentre-m75qat 2023-08-02 12:15:04Z - Pull Request Run on
ursa-i9-9960xat 2023-08-02 11:52:54Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Pull Request Run on
arm64-t4g-linux-computeat 2023-08-02 08:22:51ZCopyShortVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkVisitBits(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveShortVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyShortVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkProjectionOverhead(C++) with params=complex_expression/batch_size:10000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkFilterFSLInt64FilterNoNulls(C++) with params=1048576/2, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkThreadedTaskGroup(C++) with params=threads:4/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmark
-
Pull Request Run on
arm64-m6g-linux-computeat 2023-08-02 07:50:47ZFilterFSLInt64FilterNoNulls(C++) with params=1048576/5, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporal(C++) with params=<USYear, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal(C++) with params=<DayOfYear, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkRoundArrayBenchmark(C++) with params=<Round, UInt8Type, RoundMode::HALF_TOWARDS_ZERO>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundArrayBenchmark(C++) with params=<Round, Int32Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkCopyEmptyVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporalBinary(C++) with params=<HoursBetween, time64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkHashMediumStrings(C++) with source=cpp-micro, suite=arrow-hashing-benchmarkLongVectorInsertAtEnd(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkFilterFSLInt64FilterWithNulls(C++) with params=1048576/3, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkMemoizeLruCachedThreadUnsafe(C++) with params=8/1024, source=cpp-micro, suite=arrow-cache-benchmarkRoundArrayBenchmark(C++) with params=<Round, UInt32Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkCopyShortVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporal(C++) with params=<USWeek, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFirstTimeBitmapWriter(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkRoundBinaryArrayBenchmark(C++) with params=<RoundBinary, Int32Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundArrayBenchmark(C++) with params=<Round, Int8Type, RoundMode::HALF_TO_ODD>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkThreadedTaskGroup(C++) with params=threads:8/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkRoundArrayBenchmark(C++) with params=<Round, UInt8Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkFilterFSLInt64FilterWithNulls(C++) with params=1048576/0, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkRoundArrayBenchmark(C++) with params=<Round, Int16Type, RoundMode::HALF_TO_ODD>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkThreadedTaskGroup(C++) with params=threads:2/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBenchmarkTemporal(C++) with params=<ISOWeek, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkRoundArrayBenchmark(C++) with params=<Round, UInt8Type, RoundMode::HALF_TO_ODD>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkErrorSchemeException(C++) with source=cpp-micro, suite=arrow-type-benchmarkFilterFSLInt64FilterWithNulls(C++) with params=1048576/6, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkVisitBits(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkShortVectorInsert(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMemoizeLruCachedThreadUnsafe(C++) with params=64/16, source=cpp-micro, suite=arrow-cache-benchmarkMoveShortVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkSerialTaskGroup(C++) with params=task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkErrorSchemeExceptionNoInline(C++) with source=cpp-micro, suite=arrow-type-benchmarkBenchmarkTemporal(C++) with params=<IsLeapYear, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkRoundBinaryArrayBenchmark(C++) with params=<RoundBinary, UInt64Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkMoveShortVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyShortVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_BatchComputeHash(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkConstructFromEmptyStdVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkRoundBinaryArrayBenchmark(C++) with params=<RoundBinary, UInt32Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkConstructFromEmptyStdVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkRoundArrayBenchmark(C++) with params=<Round, UInt16Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkConstructFromShortStdVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkThreadedTaskGroup(C++) with params=threads:1/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkWriteCsvStringWithQuote(C++) with params=1, source=cpp-micro, suite=arrow-csv-writer-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkRoundArrayBenchmark(C++) with params=<Round, UInt16Type, RoundMode::HALF_TOWARDS_ZERO>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundArrayBenchmark(C++) with params=<Round, Int16Type, RoundMode::HALF_TOWARDS_ZERO>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkCopyEmptyVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkThreadedTaskGroup(C++) with params=threads:1/task_cost:10000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkMemoizeLruCachedThreadUnsafe(C++) with params=8/16, source=cpp-micro, suite=arrow-cache-benchmarkLruCacheLookup(C++) with params=64/1024, source=cpp-micro, suite=arrow-cache-benchmarkMemoizeLruCachedThreadUnsafe(C++) with params=64/1024, source=cpp-micro, suite=arrow-cache-benchmarkLruCacheLookup(C++) with params=64/16, source=cpp-micro, suite=arrow-cache-benchmarkBitmapReaderSumWithOffset(C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkRoundArrayBenchmark(C++) with params=<Round, Int16Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkFilterFSLInt64FilterNoNulls(C++) with params=1048576/2, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkSerialTaskGroup(C++) with params=task_cost:10000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkThreadedTaskGroup(C++) with params=threads:4/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkRoundArrayBenchmark(C++) with params=<Round, Int8Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkBitRunReaderLinear(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmarkBenchmarkTemporalBinary(C++) with params=<HoursBetween, non_zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkShortVectorInsertAtEnd(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitmapReaderSumWithOffset(C++) with params=4096, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmark
-
Pull Request Run on
ursa-thinkcentre-m75qat 2023-08-02 12:15:04Z
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading