v1.7.2

What's Changed

• Update MWAA to 2.10.1 by @EthanBunce in #267
• Update MWAA dependencies by @EthanBunce in #269
• fix: pass kubectl handler by @kukushking in #270
• chore: release/1.7.2 by @kukushking in #271

Full Changelog: v1.7.1...v1.7.2

v1.7.1

What's Changed

• feat: Add mlflow-ai-gw-image module and update mlflow to 2.17.0 by @dlpzx in #255
• chore(deps): bump snowflake-connector-python from 3.10.1 to 3.12.3 in /data/mwaa/requirements by @dependabot in #260
• chore(deps): bump mysql-connector-python from 8.4.0 to 9.1.0 in /data/mwaa/requirements by @dependabot in #259
• fix: pull ray-ml image from AWS ECR Public to avoid pull rate limits by @kukushking in #263
• chore: release 1.7.1 by @kukushking in #264
• fix: orchestrator logs by @kukushking in #266

New Contributors

• @dlpzx made their first contribution in #255

Full Changelog: v1.7.0...v1.7.1

v1.7.0

What's Changed

• chore: update idf module versions to 1.12.0 by @kukushking in #247
• chore: update docs by @kukushking in #250
• fix: tj-actions workflow sha reference by @kukushking in #251
• GitHub integration for service catalog deployment template by @acbhatt12 in #238
• feat: add ray orchestrator module by @kukushking in #253
• feat: ray orchestrator - add inference by @kukushking in #257
• chore: updated architecture diagram by @kukushking in #258
• feat: github integration sagemaker templates by @acbhatt12 in #256
• Adding ground truth labeling module by @EthanBunce in #252
• chore: release 1.7.0 by @kukushking in #261

Full Changelog: v1.6.0...v1.7.0

v1.6.0

What's Changed

• fix the project name in the contributor by @JunjieTang-D1 in #237
• feat: update mlflow version to support LLM tracing & update manifests by @kukushking in #239
• Feat/fine tuning 6b by @JunjieTang-D1 in #243
• feat: add head tolerations & node labels for flexible ray cluster pods scheduling by @kukushking in #244
• fix: lowercase fine-tuning-6b deployment name due to CDK resource naming constraints by @kukushking in #245
• chore: release 1.6.0 by @kukushking in #246

New Contributors

• @JunjieTang-D1 made their first contribution in #237

Full Changelog: v1.5.0...v1.6.0

v1.5.0

What's Changed

• chore: update readme for ray-cluster by @kukushking in #215
• docs: add ray on eks README by @kukushking in #216
• chore: fix readme link by @kukushking in #217
• Add network isolation for training and processing jobs & Inter container encryption in sagemaker training and hyper parameter tuning job by @NSUDE-GEORGE in #133
• chore: upd training script in the docs by @kukushking in #219
• Add accelerate as extra for transformers library by @EthanBunce in #221
• Run CI on all changed modules, not just the first one. by @clokep in #223
• chore(deps): bump aiohttp from 3.9.5 to 3.10.2 in /data/mwaa/requirements by @dependabot in #218
• Support other AWS partitions by @clokep in #222
• Limit bucket name length in templates by @EthanBunce in #224
• chore: pin ray-operator, ray-cluster, and ray-image modules versions by @kukushking in #220
• chore: Upgrade seedfarmer to 5.0.x by @LeonLuttenberger in #225
• chore: pin module versions by @kukushking in #226
• chore: Add linter for YAML files by @LeonLuttenberger in #227
• Remove Docker bundling in SageMaker model pkg promote pipeline by @clokep in #228
• chore(deps-dev): bump aws-cdk from 2.147.1 to 2.148.1 in /modules/sagemaker/sagemaker-model-cicd by @dependabot in #230
• Added mlops-stepfunctions module by @mahesh-balumuri in #229
• Update: readme for bedrock finetuning manifest added by @ujnm in #233
• Added a new Readme.Md for mwaa manifest by @rtdurga in #232
• chore: Release 1.5.0 by @kukushking in #234

Full Changelog: v.1.4.0...v1.5.0

v.1.4.0

What's Changed

• fix: missing permissions for cdk bootstrap in 1-click template by @LeonLuttenberger in #191
• fix: bump ecr module version to consume auto-delete images feature by @kukushking in #192
• tests: add integ test for sagemaker-studio module by @LeonLuttenberger in #190
• chore(deps): bump sentry-sdk from 2.4.0 to 2.8.0 in /data/mwaa/requirements by @dependabot in #197
• fix: add service account to kuberay by @kukushking in #201
• chore: update module checks workflow by @malachi-constant in #203
• Update SageMaker service catalog template docs to match code. by @clokep in #204
• Clean-up packaging of service catalog code by @clokep in #206
• refactor ray on eks to ray-operator and ray-cluster modules by @kukushking in #205
• chore: document available manifests in readme by @kukushking in #207
• Add permission for SM studio to describe apps by @EthanBunce in #208
• refactored ray-on-eks module to use latest EKS IDF release by @srinivasreddych in #198

Full Changelog: v1.3.0...v.1.4.0

v1.3.0

What's Changed

• chore: remove explicit module manifest account/region mappings by @malachi-constant in #109
• Encrypt ECR with KMS by @NSUDE-GEORGE in #110
• Adding KMS encryption for all ECR storage modules by @NSUDE-GEORGE in #115
• feat: ray on eks by @kukushking in #80
• chore: Cleanup module-level requirements-dev files by @LeonLuttenberger in #123
• Add a module for data quality monitoring of a SageMaker Endpoint. by @clokep in #117
• Update the SageMaker Monitoring module with model quality monitoring by @clokep in #125
• add KMS encryption for storage by @NSUDE-GEORGE in #113
• chore: Refactor airflow-dags module to use Pydantic by @LeonLuttenberger in #127
• fix: Inputs for bedrock-finetuning module not working by @LeonLuttenberger in #131
• fix: ecr removal policy by @kukushking in #132
• chore: rename mlops to aiops in the 1-click launch template by @LeonLuttenberger in #135
• chore: upgrade urllib3 to resolve vulnerability by @LeonLuttenberger in #136
• Update the SageMaker Model Monitoring module with model bias monitoring. by @clokep in #126
• fix: 1-click launch template referencing old manifest by @LeonLuttenberger in #138
• fix: missing PRIMARY_ACCOUNT env var for 1-click launch template by @LeonLuttenberger in #139
• feat: Add retention parameter to bedrock-finetuning bucket by @LeonLuttenberger in #141
• Update the SageMaker Model Monitoring module with model explainability monitoring. by @clokep in #137
• fix: Downscope permissions in the 1-click launch template by @LeonLuttenberger in #140
• fix: dependency issues in DAGs by @LeonLuttenberger in #142
• Use add_dependency instead of deprecated add_depends_on. by @clokep in #144
• Added a new Personas module. by @rtdurga in #114
• Fix-up some spelling errors. by @clokep in #147
• SageMaker Service Catalog templates clean-ups by @clokep in #148
• chore: adding workflow to check integration tests presence in modules by @malachi-constant in #149
• fix opensearch removal policy by @kukushking in #169
• Fix redeploying SageMaker Model Monitoring module. by @clokep in #168
• Add LLM fine-tuning and evaluation template by @abhay2302 in #170
• Add sagemaker-model-cicd module by @nagyen in #145
• update mwaa to 2.9.2 & update requirements/constraints by @kukushking in #177
• chore: update workflow to only run once a day by @malachi-constant in #183
• limit length of id in model name to prevent model name becoming too long by @EthanBunce in #184
• Add permission for get secret value for hf access token secret by @EthanBunce in #185
• chore: update one-click template by @kukushking in #187
• feat: multi account basic template self mutating pipeline by @acbhatt12 in #69
• tests: add integ test for mlflow-image module by @LeonLuttenberger in #188
• Add domain resource isolation and network isolation for endpoints by @EthanBunce in #189
• chore: release 1.3.0 by @kukushking in #186

Dependencies

• chore(deps): bump tornado from 6.4 to 6.4.1 in /data/mwaa/requirements by @dependabot in #179
• chore(deps): bump requests from 2.31.0 to 2.32.2 in /data/mwaa/requirements by @dependabot in #180
• chore(deps): bump certifi from 2024.6.2 to 2024.7.4 in /data/mwaa/requirements by @dependabot in #182
• chore(deps): bump azure-identity from 1.16.0 to 1.16.1 in /data/mwaa/requirements by @dependabot in #181
• chore(deps): bump transformers from 4.33.0 to 4.38.0 in /modules/sagemaker/sagemaker-templates-service-catalog/templates/finetune_llm_evaluation/seed_code/build_app/source_scripts by @dependabot in #172
• chore(deps): bump sagemaker from 2.194.0 to 2.218.0 in /modules/sagemaker/sagemaker-templates-service-catalog/templates/finetune_llm_evaluation/seed_code/build_app by @dependabot in #173
• chore(deps): bump transformers from 4.33.0 to 4.38.0 in /modules/sagemaker/sagemaker-templates-service-catalog/templates/finetune_llm_evaluation/seed_code/build_app by @dependabot in #175
• chore(deps): bump certifi from 2023.11.17 to 2024.7.4 in /data/mwaa/requirements by @dependabot in #171
• chore(deps): bump zipp from 3.15.0 to 3.19.1 in /modules/eks/ray-on-eks by @dependabot in #176
• chore(deps): bump urllib3 from 1.26.18 to 1.26.19 in /modules/examples/personas by @dependabot in #146
• chore(deps): bump urllib3 from 1.26.18 to 1.26.19 in /modules/mlflow/mlflow-image by @dependabot in #130
• chore(deps-dev): bump braces from 3.0.2 to 3.0.3 in /modules/fmops/sagemaker-jumpstart-fm-endpoint by @dependabot in #129
• chore(deps): bump urllib3 from 1.26.18 to 1.26.19 in /modules/examples/airflow-dags by @dependabot in #134
• chore(deps): bump authlib from 1.3.0 to 1.3.1 in /data/mwaa/requirements by @dependabot in #116
• chore(deps): bump tornado from 6.4 to 6.4.1 in /data/mwaa/requirements by @dependabot in #112
• chore(deps-dev): bump braces from 3.0.2 to 3.0.3 in /modules/fmops/bedrock-finetuning by @dependabot in #118
• chore: add manifestValidationFailOnUnknownFields=true to manifest by @LeonLuttenberger in #119
• chore(deps): bump azure-identity from 1.15.0 to 1.16.1 in /data/mwaa/requirements by @dependabot in #120
• chore(deps): bump msal from 1.26.0 to 1.28.0 in /data/mwaa/requirements by @dependabot in #121
• chore(deps-dev): bump braces from 3.0.2 to 3.0.3 in /modules/fmops/sagemaker-hugging-face-endpoint by @dependabot in #122
• chore(deps): bump sagemaker from 2.207.1 to 2.218.0 in /modules/sagemaker/sagemaker-model-monitoring by @dependabot in #124
• chore(deps): bump urllib3 from 2.0.7 to 2.2.2 in /data/mwaa/requirements by @dependabot in #128
• chore(deps): bump requests from 2.31.0 to 2.32.2 in /data/mwaa/requirements by @dependabot in #143

New Contributors

• @NSUDE-GEORGE made their first contribution in #110
• @clokep made their first contribution in #117
• @abhay2302 made their first contribution in #170
• @nagyen made their first contribution in #145
• @EthanBunce made their first contribution in #184
• @acbhatt12 made their first contribution in #69

Full Changelog: v1.2.0...v1.3.0

v1.2.0

What's Changed

• fix: Model deploy x-acc pipeline permissions & add multi-acc manifest by @kukushking in #83
• fix: multiacc manifest paths by @kukushking in #84
• (sagemaker templates) add bucket and model package group names as stack outputs by @LeonLuttenberger in #85
• build(deps): bump tqdm from 4.66.1 to 4.66.3 in /data/mwaa/requirements by @dependabot in #76
• build(deps): bump sagemaker from 2.214.3 to 2.218.0 in /data/mwaa/requirements by @dependabot in #75
• Bump flask-appbuilder from 4.3.10 to 4.3.11 in /data/mwaa/requirements by @dependabot in #53
• build(deps): bump jinja2 from 3.1.3 to 3.1.4 in /data/mwaa/requirements by @dependabot in #79
• build(deps): bump werkzeug from 2.2.3 to 3.0.3 in /data/mwaa/requirements by @dependabot in #77
• chore: Refactor mlflow inputs to use pydantic by @LeonLuttenberger in #87
• chore: rename seedfarmer project name by @malachi-constant in #88
• chore: Refactor sagemaker-studio inputs to use pydantic by @LeonLuttenberger in #89
• chore: adding some missing auto_delete attributes by @malachi-constant in #90
• build(deps): bump requests from 2.31.0 to 2.32.0 in /modules/sagemaker/sagemaker-endpoint by @dependabot in #92
• chore: create s3 buckets with destroy removal policy by @malachi-constant in #91
• chore: Add auto_delete to mlflow-fargate elb access logs bucket by @malachi-constant in #93
• chore: Upgrade mwaa module by @malachi-constant in #94
• chore: updating storage/ecr module to latest pending v1.8.0 of IDF by @malachi-constant in #95
• Added new seadfarmer module for Question and Answering Gen AI construct by @saikatak in #81
• chore(deps): bump requests from 2.31.0 to 2.32.2 in /modules/mlflow/mlflow-image by @dependabot in #97
• chore(deps): bump urllib3 from 1.26.17 to 1.26.18 in /modules/fmops/qna-rag by @dependabot in #96
• chores: add ecr image scan on push by @kukushking in #98
• chore: Refactor sagemaker-endpoint to use pydantic for inputs by @LeonLuttenberger in #100
• chore: Format airflow-dags example module by @LeonLuttenberger in #99
• chore: Refactor sagemaker-templates to use pydantic for inputs by @LeonLuttenberger in #101
• chore(deps): bump requests from 2.31.0 to 2.32.2 in /modules/mlflow/mlflow-fargate by @dependabot in #102
• Update DEPLOYMENT.md by @kukushking in #105
• Refactor qna-rag module by @LeonLuttenberger in #103
• chore: Clean up unused dev dependencies by @LeonLuttenberger in #104
• Refactor sagemaker-custom-kernel module to use Pydantic by @LeonLuttenberger in #106
• update: new module for bedrock fine tuning added by @ujnm in #86
• fix errors with bedrock-finetuning module deployment by @LeonLuttenberger in #108
• chore: release 1.2.0 by @kukushking in #107

New Contributors

• @malachi-constant made their first contribution in #88
• @saikatak made their first contribution in #81
• @ujnm made their first contribution in #86

Full Changelog: v1.1.0...v1.2.0

v1.1.0

What's Changed

• chore: add deployment guide; improve readmes by @kukushking in #27
• chore: Set up CDK Nag by @LeonLuttenberger in #25
• feat: mlflow-fargate - add efs removal policy by @kukushking in #30
• fix: mlflow manifest by @kukushking in #31
• chore: Remove AmazonSageMakerFullAccess from Sagemaker template by @LeonLuttenberger in #33
• chore: Update RDS instance type by @LeonLuttenberger in #34
• Remove AmazonSageMakerFullAccess from sagemaker-endpoint by @LeonLuttenberger in #36
• fixed the depcreated go1.x runtime by @srinivasreddych in #38
• feat: add batch-inference template to sagemaker-template module by @LeonLuttenberger in #37
• chores: Docs - add batch inference arch diagram & update studio arch diagram by @kukushking in #39
• feat: add sagemaker-custom-kernel module by @kukushking in #40
• feat: Add support for other AWS partitions (cn, us-gov, etc.) by @LeonLuttenberger in #42
• fix: CDK nags for sagemaker custom kernel module by @LeonLuttenberger in #43
• feat: Add VPC/subnets/sg config for multi-account project template to sagemaker-templates-service-catalog module by @rtdurga in #35
• Bump idna from 3.6 to 3.7 in /modules/mlflow/mlflow-fargate by @dependabot in #47
• Bump idna from 3.6 to 3.7 in /modules/mlflow/mlflow-image by @dependabot in #46
• Bump idna from 3.6 to 3.7 in /modules/sagemaker/sagemaker-endpoint by @dependabot in #45
• fix: cfn-lint issue by @kukushking in #48
• Added MWAA Module by @mahesh-balumuri in #32
• feat: split xgboost_abalone and model_deploy project templates by @kukushking in #58
• feat: Create sagemaker-hugging-face-endpoint module by @LeonLuttenberger in #44
• fix: sagemaker-custom-kernel module permissions by @kukushking in #64
• chore: Consolidated mwaa constraints file update by @kukushking in #65
• fix: sagemaker-templates-service-catalog model deploy template by @kukushking in #67
• feat: Add SSO/IAM Identity Center support to SageMaker Studio module by @kukushking in #70
• feat: add managed autoscaling config to sagemaker endpoint module by @kukushking in #72
• Added a new template to import huggingface models by taking access to… by @rtdurga in #71
• feat: add SageMaker model package promote modules by @lccasagrande in #61
• reorganize manifests by @kukushking in #74
• fix: Add access token support to HuggingFace module by @LeonLuttenberger in #78
• chore: cutting 1.1.0 release by @kukushking in #82

New Contributors

• @srinivasreddych made their first contribution in #38
• @rtdurga made their first contribution in #35

Full Changelog: v1.0.0...v1.1.0

v1.0.0

What's Changed

• chore: Init repo structure, add workflows, scripts, etc. by @kukushking in #1
• feat: add SageMaker Endpoint module by @kukushking in #2
• feat: Add SageMaker Studio manifest by @kukushking in #4
• Bump aiohttp from 3.9.1 to 3.9.2 in /modules/sagemaker/sagemaker-endpoint by @dependabot in #3
• feat: add sagemaker-studio module by @kukushking in #6
• feat: add mlflow modules by @kukushking in #5
• feat: MLFlow RDS persistence by @LeonLuttenberger in #9
• docs: Update MLFlow Fargate README with missing parameters by @LeonLuttenberger in #11
• chore: update readmes by @kukushking in #14
• chore: Add PR template by @LeonLuttenberger in #16
• feat: Add SageMaker JumpStart Foundation Model Endpoint module by @kukushking in #13
• chore: modify module-checks to support Typescript modules by @LeonLuttenberger in #15
• Add SageMaker Notebook Instance module by @lccasagrande in #12
• Added one click launch template by @mahesh-balumuri in #17
• chore: Add validation step for one-click template by @LeonLuttenberger in #20
• fix: mlflow-image - bump cdk and ecr deployment version to fix deprecated lambda runtimes issue by @kukushking in #22
• Adding basic multi-account mlops usecase by @fotinosk in #18
• chore: Rename sagemaker-templates module by @LeonLuttenberger in #23
• chore: Move Python formatting and linting checks to ruff by @LeonLuttenberger in #19
• chore: cutting 1.0.0 release by @kukushking in #10

New Contributors

• @kukushking made their first contribution in #1
• @dependabot made their first contribution in #3
• @LeonLuttenberger made their first contribution in #9
• @lccasagrande made their first contribution in #12
• @mahesh-balumuri made their first contribution in #17
• @fotinosk made their first contribution in #18

Full Changelog: https://github.com/awslabs/mlops-modules/commits/v1.0.0