auto-export-to-s3

[Deprecated] Auto Export To S3 (JavaScript)

This sample is deprecated in favor of using the official AWS Data Exchange feature for auto exporting S3 revisions: https://aws.amazon.com/about-aws/whats-new/2021/09/aws-data-exchange-export-third-party-data-updates/

This sample shows how to set up an AWS Lambda function which will automatically export all newly published revisions to S3. All infrastructure is setup using the AWS CDK.

To run the sample, set AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, and optionally AWS_SESSION_TOKEN.

First Time CDK User

$ npm install -g cdk
$ cdk bootstrap

Build and Deploy

$ npm run-script deploy

The CloudFormation will create the following resources:

1. S3 Bucket
2. Lambda Function (with necessary IAM permissions)
3. CloudWatch Rule

Each time a new Revision is published to a Data Set to which your account is subscribed, the new Revision(s) will be automatically exported to S3 as a response to the Amazon EventBridge Event sent by AWS Data Exchange.