Skip to content

v3.0.0 [yanked]

Compare
Choose a tag to compare
@richox richox released this 01 Jul 07:46
· 121 commits to master since this release

blaze-v3.0.0 [yanked]

Features

  • Supports using spark.io.compression.codec for shuffle/broadcast compression
  • Supports date type casting
  • Refactor join implementations to support existence joins and BHJ building hash map on driver side

Performance

  • Fixed performance issues when running on spark3 with default configurations
  • Use cached parquet metadata
  • Refactor native broadcast to avoid duplicated broadcast jobs
  • Supports spark333 batch shuffle reading

Bugfix

  • Fix in_list conversion in from_proto.rs