v1.1.0

1.1.0 (2024-03-14)

Features

• autoscale: Dynamic Kinesis Scaling with Thresholds (#144) (079fda9)
• transform: Add Metrics Bytes Transform (#142) (d708580)

v1.0.0

1.0.0 (2024-03-05)

1.0.0 is live. Refer to the CHANGELOG for detailed changes.

v1.0.0-rc.1

⚠ BREAKING CHANGES

• cmd/development/substation refactored into cmd/client/file/substation
• condition.Inspector is no longer in the public API
• condition inspectors refactored into individual functions
  • JSON Schema inspector removed
  • Inspectors no longer directly support negation
• config.Capsule refactored into message package
• config.Channel is no longer in the public API
• process package refactored into transform package
  • Count processor removed
  • Flatten processor removed
  • IP Database processor removed
  • Processors (Transfoms) no longer directly support conditions
• internal/transform package removed
• internal/sink package removed
• proto removed
• Secrets are now explicitly retrieved and put into the Secrets Store using the utility_secret transform
• The enrich_kv_store_set transform had it's object.key and object.set_key behavior flipped (key is now the value put into the KV, set_key is now the key used in the KV)
• The send_http transform is now send_http_post
• All TTLOffset settings are now strings instead of integers (e.g., "15m")
• Removed application metrics, added meta_metric_duration and utility_metric_count in transform package
• Refactored Transforms method in substation package
• Moved cmd/file/client application to examples/cmd/file/client
• Renamed multiple fields based on recommendations from GitHub Copilot
• Sumo Logic support removed (replaced)
• Group processor removed (replaced)

Features

• Added substation package
• Added message package
• Updated applications to use new concurrency and data processing model
• Added Kinesis Data Firehose support to cmd/aws/lambda/substation
• Added meta_negate inspector to condition package
• Added meta_err transform to transform package
• Added meta_switch transform to transform package
• Added string_append transform to transform package
• Added string_uuid transform to transform package
• Added utility_delay transform to transform package
• Added utility_err transform to transform package
• Added support for non-aggregated data to AWS Kinesis Data Stream transform
• Added region and assume role support to all AWS transforms
• Added buffering to several send transforms
• Removed IAM modules in build/terraform/aws/
• Added build/scripts/config/format.sh
• Added build/scripts/terraform/format.sh
• Added shorthand to build/config/substation.libsonnet
• Added build/config/substation_test.jsonnet
• Downgraded go.mod and development containers to Go 1.19
• Upgraded application containers to Go 1.21
• Refactored all examples/
• Added utility_secret transform
• All transform object handling patterns (object.key) return the input message if the retrieved key value does not exist
• Secrets Store AWS Secrets Manager backend supports AWS and retry configuration
• KV Store AWS DynamoDB backend supports AWS and retry configuration
• Added example for summarizing multiple events into a single event
• Added example for using MaxMind with the KV transform
• Added JSON array support to meta_for_each in condition package
• Upgraded go.mod to Go 1.20
• Added multi-region support to Terraform modules
• Added CloudWatch Terraform modules to collect log data
• Added (refactor) Secrets Terraform module
• Added array_zip transform
• IAM roles and policies in Terraform use randomized names

Fixes

• Concurrency bug in internal/aggregate package
• meta_err transform returns input Message if an error occurs

v1.0.0-beta.3

⚠ BREAKING CHANGES

• Renamed multiple fields based on recommendations from GitHub Copilot

Features

• Added multi-region support to Terraform modules
• Added CloudWatch Terraform modules to collect log data
• Added (refactor) Secrets Terraform module

v1.0.0-beta.2

⚠ BREAKING CHANGES

• Removed application metrics, added meta_metric_duration and utility_metric_count in transform package
• Refactored Transforms method in substation package
• Moved cmd/file/client application to examples/cmd/file/client

Features

• Added JSON array support to meta_for_each in condition package
• Upgraded go.mod to Go 1.20

Fixes

• Concurrency bug in internal/aggregate package
• meta_err transform returns input Message if an error occurs

v1.0.0-beta.1

⚠ BREAKING CHANGES

• Secrets are now explicitly retrieved and put into the Secrets Store using the utility_secret transform
• The enrich_kv_store_set transform had it's object.key and object.set_key behavior flipped (key is now the value put into the KV, set_key is now the key used in the KV)
• The send_http transform is now send_http_post
• All TTLOffset settings are now strings instead of integers (e.g., "15m")

Features

• Added utility_secret transform
• All transform object handling patterns (object.key) return the input message if the retrieved key value does not exist
• Secrets Store AWS Secrets Manager backend supports AWS and retry configuration
• KV Store AWS DynamoDB backend supports AWS and retry configuration
• Added example for summarizing multiple events into a single event
• Added example for using MaxMind with the KV transform

v1.0.0-beta

1.0.0-beta (2023-09-26)

⚠ BREAKING CHANGES

• cmd/development/substation refactored into cmd/client/file/substation
• condition.Inspector is no longer in the public API
• condition inspectors refactored into individual functions
  • JSON Schema inspector removed
  • Inspectors no longer directly support negation
• config.Capsule refactored into message package
• config.Channel is no longer in the public API
• process package refactored into transform package
  • Count processor removed
  • Flatten processor removed
  • IP Database processor removed
  • Processors (Transfoms) no longer directly support conditions
• internal/transform package removed
• internal/sink package removed
• proto removed

Features

• Added substation package
• Added message package
• Updated applications to use new concurrency and data processing model
• Added Kinesis Data Firehose support to cmd/aws/lambda/substation
• Added metaNegate inspector to condition package
• Added metaErr transform to transform package
• Added metaSwitch transform to transform package
• Added stringAppend transform to transform package
• Added stringUUID transform to transform package
• Added utilityDelay transform to transform package
• Added utilityErr transform to transform package
• Added support for non-aggregated data to AWS Kinesis Data Stream transform
• Added region and assume role support to all AWS transforms
• Added buffering to several send transforms
• Removed IAM modules in build/terraform/aws/
• Added build/scripts/config/format.sh
• Added build/scripts/terraform/format.sh
• Added shorthand to build/config/substation.libsonnet
• Added build/config/substation_test.jsonnet
• Downgraded go.mod and development containers to Go 1.19
• Upgraded application containers to Go 1.21
• Refactored all examples/

v0.9.2

0.9.2 (2023-08-10)

Features

• add bitmath inspector (#128) (4721ffa)
• Add JSON Lines Support to KV Store (#126) (667ceb3)
• add TTLKey to KV (#121) (9837287)
• Allow Multiple URL Interpolations in the HTTP Processor (#124) (f262f79)

Bug Fixes

• KV Store Processor TTL Key (#123) (0ceffc1)
• use valid path to the for_each inspector settings (#129) (65d838d)

v0.9.1

0.9.1 (2023-05-09)

Features

• Add Benchmark App & No-Op Features (#108) (ddfb7bc)
• Add Stream Transform & Streamer Interface (#106) (8efd82e)
• Add Zstandard & Snappy Readers (#105) (8c69907)
• AWS DynamoDB Ingest (CDC) (#109) (36c60ac)
• AWS SNS Sink (#111) (47e948f)

v0.9.0

0.9.0 (2023-04-19)

⚠ BREAKING CHANGES

• Add AWS AppConfig Lambda Validation app (#92)

Features

• Add AWS AppConfig Lambda Validation app (#92) (f374137)
• add gt, lt (#98) (110253b)
• condition inspector (#86) (e1fcee6)
• Customizable Sink Files (#93) (bee2463)
• JQ Processor (#88) (0adf249)

Bug Fixes

• decode object key (#96) (9e7a6db)