Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added MWAA Module #32

Merged
merged 35 commits into from
Apr 13, 2024
Merged
Show file tree
Hide file tree
Changes from 33 commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
1a5a1f9
Added mwaa module
mahesh-balumuri Mar 14, 2024
958c3ca
Updated version
mahesh-balumuri Mar 14, 2024
cb5deac
Updated group
mahesh-balumuri Mar 14, 2024
c5daf55
Fixed yaml syntax issue
mahesh-balumuri Mar 14, 2024
01ea2d2
Comment the modules for testing
mahesh-balumuri Mar 14, 2024
6545756
Revert the prev change
mahesh-balumuri Mar 14, 2024
f01c7b4
Merge branch 'awslabs:main' into main
mahesh-balumuri Mar 14, 2024
814d1ce
Updated DAG Module
mahesh-balumuri Mar 29, 2024
cfc1795
Updated readme
mahesh-balumuri Mar 29, 2024
869d7ca
Added requirements files
mahesh-balumuri Apr 1, 2024
ecadc74
Updated imports
mahesh-balumuri Apr 3, 2024
a5fc3b2
Updated MWAA Dag module
mahesh-balumuri Apr 5, 2024
cc6cd77
Updated ReadME and ChangeLog
mahesh-balumuri Apr 5, 2024
2cc7098
Updated Dag Code
mahesh-balumuri Apr 12, 2024
5cd3c19
Updated Dag Code
mahesh-balumuri Apr 12, 2024
e11010d
Merge branch 'main' into main
mahesh-balumuri Apr 12, 2024
4befa66
updated path
mahesh-balumuri Apr 12, 2024
e179571
updated with the fix.sh
mahesh-balumuri Apr 12, 2024
29b569a
Updated files cleanup
mahesh-balumuri Apr 12, 2024
08e634b
Fixed the mypy lint issue
mahesh-balumuri Apr 12, 2024
a633189
fixed the lint issues
mahesh-balumuri Apr 12, 2024
4bf81aa
fixed the lint
mahesh-balumuri Apr 12, 2024
4c267f7
Updated lint
mahesh-balumuri Apr 12, 2024
b16be5a
Updated cdk version
mahesh-balumuri Apr 12, 2024
7b90079
updated linting
mahesh-balumuri Apr 12, 2024
23138fe
updated linting
mahesh-balumuri Apr 12, 2024
c171fa1
Fixed the versions
mahesh-balumuri Apr 12, 2024
cc124be
Merge branch 'awslabs:main' into main
mahesh-balumuri Apr 12, 2024
9358989
Added test cases
mahesh-balumuri Apr 12, 2024
33818c9
Updated Env variables
mahesh-balumuri Apr 13, 2024
82cf9d0
fixed formating
mahesh-balumuri Apr 13, 2024
4faa83d
Fixed the linting.
mahesh-balumuri Apr 13, 2024
24c16a1
Merge branch 'main' into main
kukushking Apr 13, 2024
4b30050
update dependencies
kukushking Apr 13, 2024
7fa0d94
update dependencies - force attrs
kukushking Apr 13, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
- added `sagemaker-custom-kernel` module
- added batch inference project template to `sagemaker-templates-service-catalog` module
- added EFS removal policy to `mlflow-fargate` module
- added `mwaa` module with example dag which demonstrates the MLOps in Airflow

### **Changed**

Expand Down
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,13 @@ See deployment steps in the [Deployment Guide](DEPLOYMENT.md).
|-----------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------|
| [SageMaker JumpStart Foundation Model Endpoint Module](modules/fmops/sagemaker-jumpstart-fm-endpoint/README.md) | Creates an endpoint for a SageMaker JumpStart Foundation Model. |


### MWAA Modules

| Type | Description |
|-------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [Example DAG for MLOps](modules/examples/airflow-dags/README.md) | Deploys a Sample DAG in MWAA demonstrating MLOPs and it is using MWAA module from IDF |

### Industry Data Framework (IDF) Modules

The modules in this repository are compatible with [Industry Data Framework (IDF) Modules](https://github.com/awslabs/idf-modules) and can be used together within the same deployment. Refer to `examples/manifests` for examples.
Loading
Loading