Skip to content

Commit

Permalink
Prepare for 0.4.0 release
Browse files Browse the repository at this point in the history
istreeter committed Jun 3, 2024
1 parent fee675f commit f288f09
Showing 2 changed files with 20 additions and 5 deletions.
15 changes: 15 additions & 0 deletions CHANGELOG
Original file line number Diff line number Diff line change
@@ -1,3 +1,18 @@
Version 0.4.0 (2024-06-03)
--------------------------
Improve default Iceberg table properties (#62)
Bad rows must not exceed the maximum size allowed by the sink (#62)
Trap SIGTERM and start graceful shutdown (#62)
Improve default Hudi configuration settings (#62)
Enable syncing Hudi metadata to the Glue Catalog (#62)
Turn on metrics logging for Iceberg (#62)
Improve default Delta table properties (#62)
Bump common-streams and iceberg to latest versions (#62)
Fix AWS dependencies (#61)
Optimizations for larger compute instances (#60)
Bump spark and lake libraries to latest versions (#59)
Bump common-streams to 0.6.0 (#58)

Version 0.3.0 (2024-03-20)
--------------------------
Add AWS Glue as an Iceberg catalog (#55)
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -8,7 +8,7 @@

This project contains applications required to load Snowplow data into Open Table Formats.

Lake Loader 0.3.0 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats.
Lake Loader 0.4.0 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats.

Check out [the example config files](./config) for how to configure your lake loader.

@@ -22,7 +22,7 @@ Basic usage:
docker run \
-v /path/to/config.hocon:/var/config.hocon \
-v /path/to/iglu.json:/var/iglu.json \
snowplow/lake-loader-azure:0.3.0 \
snowplow/lake-loader-azure:0.4.0 \
--config /var/config.hocon \
--iglu-config /var/iglu.json
```
@@ -35,7 +35,7 @@ The GCP lake loader reads the stream of enriched events from Pubsub and writes t
docker run \
-v /path/to/config.hocon:/var/config.hocon \
-v /path/to/iglu.json:/var/iglu.json \
snowplow/lake-loader-gcp:0.3.0 \
snowplow/lake-loader-gcp:0.4.0 \
--config /var/config.hocon \
--iglu-config /var/iglu.json
```
@@ -48,7 +48,7 @@ The AWS lake loader reads the stream of enriched events from Kinesis and writes
docker run \
-v /path/to/config.hocon:/var/config.hocon \
-v /path/to/iglu.json:/var/iglu.json \
snowplow/lake-loader-aws:0.3.0 \
snowplow/lake-loader-aws:0.4.0 \
--config /var/config.hocon \
--iglu-config /var/iglu.json
```
@@ -79,7 +79,7 @@ Licensed under the [Snowplow Limited Use License Agreement][license]. _(If you a
[build-image]: https://github.com/snowplow-incubator/snowplow-lake-loader/workflows/CI/badge.svg
[build]: https://github.com/snowplow-incubator/snowplow-lake-loader/actions/workflows/ci.yml

[release-image]: https://img.shields.io/badge/release-0.3.0-blue.svg?style=flat
[release-image]: https://img.shields.io/badge/release-0.4.0-blue.svg?style=flat
[releases]: https://github.com/snowplow-incubator/snowplow-lake-loader/releases

[license]: https://docs.snowplow.io/limited-use-license-1.0

0 comments on commit f288f09

Please sign in to comment.