feat(tpcds-benchmarking): Add basic tpcds benchmarking for local testing

[raunakab]

Overview

This PR enables TPC-DS benchmarking on your local computer.

If the TPC-DS parquet data does not exist, it will be created for you (inside of benchmarking/tpcds/data). You can configure the location of this output via the --tpcds-gen-folder argument provided by the script.

Usage

For running with the native runner, run:

DAFT_RUNNER=native python -m benchmarking.tpcds --questions "3"

For executing with the ray runner, run:

DAFT_RUNNER=ray python -m benchmarking.tpcds --questions "3"

You can also specify different scale-factors (e.g., --scale-factor 0.5) and dry-run modes (e.g., --dry-run).

[codspeed-hq]

CodSpeed Performance Report

Merging #3509 will degrade performances by 57.41%

_{Comparing feat/tpcds (7f44c02) with main (6390afa)}

Summary

❌ 1 regressions
✅ 16 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

	Benchmark	main	feat/tpcds	Change
❌	test_iter_rows_first_row[100 Small Files]	127.5 ms	299.4 ms	-57.41%

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.54%. Comparing base (092c354) to head (7f44c02).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3509      +/-   ##
==========================================
- Coverage   77.55%   77.54%   -0.01%     
==========================================
  Files         709      709              
  Lines       86288    86286       -2     
==========================================
- Hits        66917    66911       -6     
- Misses      19371    19375       +4     

see 4 files with indirect coverage changes

[universalmind303]

Usage

python -m benchmarking.tpcds \
  --scale-factor 1
  --tpcds-gen-folder data/tpcds

The --scale-factor and --tpcds-gen-folder variables are not needed (default to 0.01 and data/tpcds, respectively).

not necessary, but IMO it'd be nice to add this to the Makefile similar to our dsdgen make command: make dsdgen SCALE_FACTOR=1 OUTPUT_DIR=data/tpcds

something like:

make bench_tpcds SF=1 TPCDS_DIR=data/tpcds