v0.2.30

Changes

✨ New Features

• [FEAT] Decouple pipeline building and running from new executor @colin-ho (#2522)
• [FEAT] Add concat to new execution model + buffered intermediate ops @colin-ho (#2519)
• [FEAT] Math Ops for FixedSizeList / FixedShapeTensor / Embedding Type @samster25 (#2507)
• [FEAT] adding transform functionality @otacilio-psf (#2498)
• [FEAT] List chunk expression @desmondcheongzx (#2491)
• [FEAT] Refactors and agg improvements for new local execution model @colin-ho (#2497)
• [FEAT]: dyn function registry @universalmind303 (#2466)
• [FEAT] New Local Execution Model @colin-ho (#2437)
• [FEAT] Implement hashing and groupby on lists @Vince7778 (#2464)
• [FEAT] Add upload functionality to binary columns @jaychia (#2461)
• [FEAT] List slice expression @desmondcheongzx (#2479)
• [FEAT] add bit shift functions @murex971 (#2453)
• [FEAT] Implements trigonometry expressions: arctanh arccosh arcsinh @fedemagnani (#2476)
• [FEAT] Microsoft Fabric support in AzureConfig @kevinzwang (#2465)

🚀 Performance Improvements

• [PERF]: dont read parquet metadata multiple times @universalmind303 (#2358)
• [PERF] Local Execution Plan @samster25 (#2489)
• [PERF] Optimize string normalization @Vince7778 (#2474)

👾 Bug Fixes

• [BUG] merge conflict for python catalog scan task @samster25 (#2517)
• [BUG] Add retries for write timeout errors @mauriceweber (#2508)
• [BUG] Use Daft s3 credentials chain for deltalake reads @jaychia (#2486)
• [BUG] Support delta-rs version >0.17.4 in deltalake writes @jaychia (#2488)
• [BUG] Fix anti-join on different column names @Vince7778 (#2477)

📖 Documentation

• [FEAT] adding transform functionality @otacilio-psf (#2498)
• [DOCS] Tutorial: FOTW data access @avriiil (#2384)
• [FEAT] List chunk expression @desmondcheongzx (#2491)
• [DOCS] Enhance Dataframe / Expressions examples @sunaysanghani (#2360)
• [FEAT] add bit shift functions @murex971 (#2453)
• [FEAT] Implements trigonometry expressions: arctanh arccosh arcsinh @fedemagnani (#2476)
• [DOCS] Adds RunLLM widget @vsreekanti (#2462)
• [DOCS] Fix broken example URL @kevinzwang (#2467)
• [FEAT] Microsoft Fabric support in AzureConfig @kevinzwang (#2465)
• [DOCS] Remove unsupported map get doc example @kevinzwang (#2452)

🧰 Maintenance

• [CHORE] remove tokio-stream as dep @samster25 (#2521)
• [CHORE] drop unused deps and add machete CI check @samster25 (#2520)
• [CHORE] fix incremental builds with vscode rust analyzer @samster25 (#2515)
• [CHORE] Disable Python as default feature and have maturin enable it by default @samster25 (#2516)
• [CHORE]: remove daft-core from daft-io @universalmind303 (#2513)
• [CHORE]: move uri functions to new "daft-functions" crate @universalmind303 (#2501)
• [CHORE] Add better typing for class UDFs @jaychia (#2388)
• [CHORE] Add a helpful message in build-artifact-s3 workflow @jaychia (#2480)