v0.3.9

[jaychia]

Changes

✨ New Features

• [FEAT]: sql IN operator @universalmind303 ([FEAT]: sql IN operator #3086)
• [FEAT] Enable explode for swordfish @colin-ho ([FEAT] Enable explode for swordfish #3077)
• [FEAT]: add sql DISTINCT @universalmind303 ([FEAT]: add sql DISTINCT #3087)
• [FEAT] Enable concat for swordfish @colin-ho ([FEAT] Enable concat for swordfish #2976)
• [FEAT] Enable unpivot for swordfish @colin-ho ([FEAT] Enable unpivot for swordfish #3078)
• [FEAT] Outer joins for native executor @colin-ho ([FEAT] Outer joins for native executor #2860)
• [FEAT] Enable pivot for swordfish @colin-ho ([FEAT] Enable pivot for swordfish #3081)
• [FEAT] Enable sample for swordfish @colin-ho ([FEAT] Enable sample for swordfish #3079)
• [FEAT] Add stateful actor context and set CUDA_VISIBLE_DEVICES @kevinzwang ([FEAT] Add stateful actor context and set CUDA_VISIBLE_DEVICES #3002)
• [FEAT]: sql tbl alias, and compount ident for joins @universalmind303 ([FEAT]: sql tbl alias, and compount ident for joins #3066)
• [FEAT]: sql between @universalmind303 ([FEAT]: sql between #3062)
• [FEAT]: Interval dtype @universalmind303 ([FEAT]: Interval dtype #3018)
• [FEAT] Enable to_json_string for physical plan @colin-ho ([FEAT] Enable to_json_string for physical plan #3023)
• [FEAT]: Daft support for Azure storage for Unity Catalog daft.read_deltalake @anilmenon14 ([FEAT]: Daft support for Azure storage for Unity Catalog daft.read_deltalake #3025)
• [FEAT] Iceberg MOR for streaming parquet @colin-ho ([FEAT] Iceberg MOR for streaming parquet #2975)
• [FEAT] Include file paths as column from read_parquet/csv/json @colin-ho ([FEAT] Include file paths as column from read_parquet/csv/json #2953)

🚀 Performance Improvements

• [PERF] Remove stateful actor child materialization limit @kevinzwang ([PERF] Remove stateful actor child materialization limit #3099)

👾 Bug Fixes

• [BUG] Bump up max_header_size @raunakab ([BUG] Bump up max_header_size #3068)
• [BUG] Autodetect AWS region during deltalake scan @kevinzwang ([BUG] Autodetect AWS region during deltalake scan #3104)
• [BUG] Add over clause in read_sql percentile reads @colin-ho ([BUG] Add over clause in read_sql percentile reads #3094)
• [BUG] Disable Linux SSL CERT override @samster25 ([BUG] Disable Linux SSL CERT override #3098)
• [BUG] Fix into_partitions to use a more naive approach without materialization @jaychia ([BUG] Fix into_partitions to use a more naive approach without materialization #3080)
• [BUG] Fix actor pool initialization in ray client mode @kevinzwang ([BUG] Fix actor pool initialization in ray client mode #3028)
• [BUG]: joins with duplicate column names and qualified table expansion @universalmind303 ([BUG]: joins with duplicate column names and qualified table expansion #3074)
• [BUG]: sql functions case sensitivit @universalmind303 ([BUG]: sql functions case sensitivit #3063)
• [BUG] Fix write_deltalake add action file path prefix @kevinzwang ([BUG] Fix write_deltalake add action file path prefix #3053)
• [BUG] Fix intersection checking when unioning schemas @desmondcheongzx ([BUG] Fix intersection checking when unioning schemas #3039)
• [BUG] Sampling without replacement not working @colin-ho ([BUG] Sampling without replacement not working #3035)

🧰 Maintenance

• [CHORE]: replace the .venv value with global variable VENV @mohamedrezk122 ([CHORE]: replace the .venv value with global variable VENV #3084)
• [CHORE] Enable lancedb reads for native executor @colin-ho ([CHORE] Enable lancedb reads for native executor #2925)
• [CHORE] Auto attach LLDB debugger to python [CHORE] Auto attach LLDB debugger to python #2940 @sagiahrac ([CHORE] Auto attach LLDB debugger to python #2940 #3020)
• [CHORE] Rename config.yaml to config.yml @samster25 ([CHORE] Rename config.yaml to config.yml #3045)
• [CHORE] add config.yaml for issues @samster25 ([CHORE] add config.yaml for issues #3044)
• [CHORE] validation on dropdown @samster25 ([CHORE] validation on dropdown #3043)
• [CHORE] preserve quotes in yaml @samster25 ([CHORE] preserve quotes in yaml #3042)
• [CHORE] Checkbox for contribution @samster25 ([CHORE] Checkbox for contribution #3041)
• [CHORE] update feature request @samster25 ([CHORE] update feature request #3040)

---

This discussion was created from the release v0.3.9.