Releases: snowplow/snowplow-s3-loader
Version 0.6.0
Renaming the project from Kinesis S3 to S3 Loader since NSQ is introduced as an event source, support for AT_TIMESTAMP as initial position plus some improvements under the hood
New features
Add NSQ as a stream source (#64)
Support AT_TIMESTAMP as initial position (#109)
Rename to Snowplow S3 Loader (#66)
Bug fixes
Add message when requiring that the Kinesis stream exist fails (#113)
Under the Hood
Refactor to change purpose of the S3Emitter class (#110)
Configuration decoding with pureconfig (#105)
Documentation and build
Remove logging section from example config (#115)
Move configuration example to an examples top-level folder (#107)
Stop making the assembly jar executable (#104)
Version 0.5.0
An important bug fix, community-driven improvements, plus the modernization of the project
New features
Bug fixes
- Add a newline at the end of a gzipped tsv file (#49)
- Do not dismiss failures prior to serialization (#101)
- Reduce INFO logging (#50)
Updates
- Bump Scala version to 2.11 (#81)
- Upgrade to Java 8 (#82)
- Bump SBT to 0.13.15 (#83)
- Bump Kinesis Client Library to 1.7.5 (#55)
- Update amazon-kinesis-connectors to 1.3.0 (#17)
- Bump hadoop-common to 2.7.3 (#94)
- Bump elephant-bird to 4.15 (#95)
- Bump hadoop-lzo to 0.4.20 (#93)
- Bump scalaz to 7.0.9 (#86)
- Bump sbt-assembly to 0.14.5 (#84)
- Bump joda-time to 2.9.9 (#96)
- Bump config to 1.3.1 (#97)
- Bump snowplow-scala-tracker to 0.3.0 (#92)
- Bump specs2-core to 3.9.1 (#89)
- Replace argot by scopt (#85)
- Remove scalazon dependency (#88)
- Remove joda-convert dependency (#98)
- Remove scalaz-specs2 dependency (#90)
Documentation and build
Version 0.4.1
Version 0.4.0
Adds gzip support and fixes various bugs
New functionality
- Added support for gzip file format, thanks @kazjote! (#43)
- Added more logging (#31)
- Ensured OutOfMemoryError is logged (#29)
Bug fixes
- Fixed S3 outage causing infinite retry loop (#44)
- Changed sink_write_failed to storage_write_failed (#45)
Documentation, test and build
Version 0.3.0
Various performance improvements, code tidy-up and Snowplow logging.
Performance improvements and tidy-up
- Bumped Kinesis Client Library to 1.4.0 (#35)
- Bumped amazon-kinesis-connectors to 1.1.2 (#34)
- Stopped passing String and Byte[Array] of records around (#32)
- Removed unused variables (#33)
- Removed unused dependencies (#5)
Logging and bad rows
- Unified logger configuration (#19)
- Initialized bad stream eagerly rather than lazily (#18)
- Updated bad rows to include timestamp (#13)
Snowplow tracking
- Sending event to Snowplow on heartbeat (#12)
- Sending event to Snowplow on shutdown (#11)
- Sending event to Snowplow on initialize (#10)
- Sending event to Snowplow if sinking batch to S3 fails (#9)
Documentation and build
- Renamed binary to snowplow-kinesis-s3 (#27)
- Added release and license buttons to README (#38)
- Added CHANGELOG (#15)
- Removed Kinesis LZO S3 Sink labels from CHANGELOG (#26)
- Filled out .gitignore (#7)
- Reduced assembly time by disabling assemblyCacheOutput (#4)
- Added NFS and CORE settings to Vagrantfile to improve performance (#36)
Version 0.2.1
Version 0.2.0
Extending the configuration options and removing "magic" functionality
Functionality changes
- Removed automatic creation of stream (#1529)
- Made DynamoDb region configurable (#1582)
Configuration options
- Changed "connector" to "sink" in config (#1473)
- Added macros to config.hocon.sample (#1472)
- Changed the configuration to use the S3 region instead of the full endpoint URI (#1327)
Version 0.1.0
Initial release