Releases: CoxAutomotiveDataSolutions/spark-distcp
Releases · CoxAutomotiveDataSolutions/spark-distcp
v0.2.5
What's Changed
- Remove Scala dependencies from assembly by @gquintana in #11
- Validate options before starting SparkSession by @gquintana in #12
- Publish assembly jar and formatting by @jamesfielder in #13
New Contributors
- @gquintana made their first contribution in #11
Full Changelog: v0.2.4...v0.2.5
v0.2.4
CI fully setup
v0.2.3
Spark 3 support
v0.2.2 - Bugfix
v0.2.2 - 2019-06-21
Fixed
- Human readable byte representation sometimes trimming too many digits
v0.2.1 - Bugfix
v0.2.1 - 2019-06-21
Fixed
- Files within a partition are now batched in a consistent way using sorting
- Jobs no longer fail if batching keys are incorrect
v0.2 - Operation Statistics and Bugfix
v0.2 - 2019-06-18
Added
- Statistics of the copy/delete operations are now collected during the application and logged on completion
Fixed
- Various various command-line parsing issues and increased coverage of tests to include these cases
v0.1 - Initial Release
v0.1 - 2019-06-12
Added
- Initial release