From f288f0952a5fe3b32c6ea128b6bac81127cb4d57 Mon Sep 17 00:00:00 2001 From: Ian Streeter Date: Mon, 3 Jun 2024 22:11:10 +0100 Subject: [PATCH] Prepare for 0.4.0 release --- CHANGELOG | 15 +++++++++++++++ README.md | 10 +++++----- 2 files changed, 20 insertions(+), 5 deletions(-) diff --git a/CHANGELOG b/CHANGELOG index a2245798..ea3232eb 100644 --- a/CHANGELOG +++ b/CHANGELOG @@ -1,3 +1,18 @@ +Version 0.4.0 (2024-06-03) +-------------------------- +Improve default Iceberg table properties (#62) +Bad rows must not exceed the maximum size allowed by the sink (#62) +Trap SIGTERM and start graceful shutdown (#62) +Improve default Hudi configuration settings (#62) +Enable syncing Hudi metadata to the Glue Catalog (#62) +Turn on metrics logging for Iceberg (#62) +Improve default Delta table properties (#62) +Bump common-streams and iceberg to latest versions (#62) +Fix AWS dependencies (#61) +Optimizations for larger compute instances (#60) +Bump spark and lake libraries to latest versions (#59) +Bump common-streams to 0.6.0 (#58) + Version 0.3.0 (2024-03-20) -------------------------- Add AWS Glue as an Iceberg catalog (#55) diff --git a/README.md b/README.md index a8a717e9..9fa98c41 100644 --- a/README.md +++ b/README.md @@ -8,7 +8,7 @@ This project contains applications required to load Snowplow data into Open Table Formats. -Lake Loader 0.3.0 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats. +Lake Loader 0.4.0 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats. Check out [the example config files](./config) for how to configure your lake loader. @@ -22,7 +22,7 @@ Basic usage: docker run \ -v /path/to/config.hocon:/var/config.hocon \ -v /path/to/iglu.json:/var/iglu.json \ - snowplow/lake-loader-azure:0.3.0 \ + snowplow/lake-loader-azure:0.4.0 \ --config /var/config.hocon \ --iglu-config /var/iglu.json ``` @@ -35,7 +35,7 @@ The GCP lake loader reads the stream of enriched events from Pubsub and writes t docker run \ -v /path/to/config.hocon:/var/config.hocon \ -v /path/to/iglu.json:/var/iglu.json \ - snowplow/lake-loader-gcp:0.3.0 \ + snowplow/lake-loader-gcp:0.4.0 \ --config /var/config.hocon \ --iglu-config /var/iglu.json ``` @@ -48,7 +48,7 @@ The AWS lake loader reads the stream of enriched events from Kinesis and writes docker run \ -v /path/to/config.hocon:/var/config.hocon \ -v /path/to/iglu.json:/var/iglu.json \ - snowplow/lake-loader-aws:0.3.0 \ + snowplow/lake-loader-aws:0.4.0 \ --config /var/config.hocon \ --iglu-config /var/iglu.json ``` @@ -79,7 +79,7 @@ Licensed under the [Snowplow Limited Use License Agreement][license]. _(If you a [build-image]: https://github.com/snowplow-incubator/snowplow-lake-loader/workflows/CI/badge.svg [build]: https://github.com/snowplow-incubator/snowplow-lake-loader/actions/workflows/ci.yml -[release-image]: https://img.shields.io/badge/release-0.3.0-blue.svg?style=flat +[release-image]: https://img.shields.io/badge/release-0.4.0-blue.svg?style=flat [releases]: https://github.com/snowplow-incubator/snowplow-lake-loader/releases [license]: https://docs.snowplow.io/limited-use-license-1.0