-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add workflows for all endpoints (#2203)
* Add workflows for all endpoints * Fixed online vs batch endpoint workflow command bug * Testing workflows catting endpoint .yml files * Removed all newly generated non-endpoint related workflows that were under endpoint folder * Testing workflows deleting endpoints before creation if exists * Add continue on failure for delete endpoint * Testing replacing endpoint names during action and deleting * Testing extra delete section * Testing -n over -f * Testing new endpoint names * Reduced endpoint names to 32 chars max * Replaced lowercase endpoint_name with uppercase, added quotes * Removed uai create endpoint workflow * Added create deployment sections to workflows if exist * Standardized all usages of conda*.yml to use .yaml ending in cli/endpoints * Standardized all usages of conda*.yml to use .yaml ending in cli/endpoints * Used same modified endpoint name for deployments in workflow * Temporarily removed deployments and endpoints which were failing due to malformed .yml and other transient reasons * Removed extra print statement and comment * Added missing name for deployment * Added 1-sai-create-endpoint to ignore list
- Loading branch information
Showing
57 changed files
with
1,182 additions
and
43 deletions.
There are no files selected for viewing
70 changes: 70 additions & 0 deletions
70
.github/workflows/cli-endpoints-batch-deploy-models-custom-outputs-parquet-endpoint.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,70 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: cli-endpoints-batch-deploy-models-custom-outputs-parquet-endpoint | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "18 11/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - cli/endpoints/batch/deploy-models/custom-outputs-parquet/** | ||
| - infra/** | ||
| - .github/workflows/cli-endpoints-batch-deploy-models-custom-outputs-parquet-endpoint.yml | ||
| - cli/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| bash bootstrap.sh | ||
| working-directory: infra | ||
| continue-on-error: false | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: delete endpoint if existing | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n customoutputsparquetendpoint -y | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: create endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/custom-outputs-parquet/endpoint.yml | ||
| az ml batch-endpoint create -n customoutputsparquetendpoint -f endpoints/batch/deploy-models/custom-outputs-parquet/endpoint.yml | ||
| working-directory: cli | ||
| - name: create deployment | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/custom-outputs-parquet/deployment.yml | ||
| az ml batch-deployment create -e customoutputsparquetendpoint -f endpoints/batch/deploy-models/custom-outputs-parquet/deployment.yml | ||
| working-directory: cli | ||
| - name: cleanup endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n customoutputsparquetendpoint -y | ||
| working-directory: cli |
63 changes: 63 additions & 0 deletions
63
.github/workflows/cli-endpoints-batch-deploy-models-heart-classifier-mlflow-endpoint.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,63 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: cli-endpoints-batch-deploy-models-heart-classifier-mlflow-endpoint | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "18 11/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - cli/endpoints/batch/deploy-models/heart-classifier-mlflow/** | ||
| - infra/** | ||
| - .github/workflows/cli-endpoints-batch-deploy-models-heart-classifier-mlflow-endpoint.yml | ||
| - cli/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| bash bootstrap.sh | ||
| working-directory: infra | ||
| continue-on-error: false | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: delete endpoint if existing | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n heartclassifiermlflowendpoint -y | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: create endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/heart-classifier-mlflow/endpoint.yml | ||
| az ml batch-endpoint create -n heartclassifiermlflowendpoint -f endpoints/batch/deploy-models/heart-classifier-mlflow/endpoint.yml | ||
| working-directory: cli | ||
| - name: cleanup endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n heartclassifiermlflowendpoint -y | ||
| working-directory: cli |
70 changes: 70 additions & 0 deletions
70
...b/workflows/cli-endpoints-batch-deploy-models-huggingface-text-summarization-endpoint.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,70 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: cli-endpoints-batch-deploy-models-huggingface-text-summarization-endpoint | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "18 11/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - cli/endpoints/batch/deploy-models/huggingface-text-summarization/** | ||
| - infra/** | ||
| - .github/workflows/cli-endpoints-batch-deploy-models-huggingface-text-summarization-endpoint.yml | ||
| - cli/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| bash bootstrap.sh | ||
| working-directory: infra | ||
| continue-on-error: false | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: delete endpoint if existing | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n facetextsummarizationendpoint -y | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: create endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/huggingface-text-summarization/endpoint.yml | ||
| az ml batch-endpoint create -n facetextsummarizationendpoint -f endpoints/batch/deploy-models/huggingface-text-summarization/endpoint.yml | ||
| working-directory: cli | ||
| - name: create deployment | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/huggingface-text-summarization/deployment.yml | ||
| az ml batch-deployment create -e facetextsummarizationendpoint -f endpoints/batch/deploy-models/huggingface-text-summarization/deployment.yml | ||
| working-directory: cli | ||
| - name: cleanup endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n facetextsummarizationendpoint -y | ||
| working-directory: cli |
63 changes: 63 additions & 0 deletions
63
.github/workflows/cli-endpoints-batch-deploy-models-imagenet-classifier-endpoint.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,63 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: cli-endpoints-batch-deploy-models-imagenet-classifier-endpoint | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "18 11/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - cli/endpoints/batch/deploy-models/imagenet-classifier/** | ||
| - infra/** | ||
| - .github/workflows/cli-endpoints-batch-deploy-models-imagenet-classifier-endpoint.yml | ||
| - cli/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| bash bootstrap.sh | ||
| working-directory: infra | ||
| continue-on-error: false | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: delete endpoint if existing | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n elsimagenetclassifierendpoint -y | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: create endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/imagenet-classifier/endpoint.yml | ||
| az ml batch-endpoint create -n elsimagenetclassifierendpoint -f endpoints/batch/deploy-models/imagenet-classifier/endpoint.yml | ||
| working-directory: cli | ||
| - name: cleanup endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n elsimagenetclassifierendpoint -y | ||
| working-directory: cli |
63 changes: 63 additions & 0 deletions
63
.github/workflows/cli-endpoints-batch-deploy-models-mnist-classifier-endpoint.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,63 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: cli-endpoints-batch-deploy-models-mnist-classifier-endpoint | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "18 11/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - cli/endpoints/batch/deploy-models/mnist-classifier/** | ||
| - infra/** | ||
| - .github/workflows/cli-endpoints-batch-deploy-models-mnist-classifier-endpoint.yml | ||
| - cli/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| bash bootstrap.sh | ||
| working-directory: infra | ||
| continue-on-error: false | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: delete endpoint if existing | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n modelsmnistclassifierendpoint -y | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: create endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/batch/deploy-models/mnist-classifier/endpoint.yml | ||
| az ml batch-endpoint create -n modelsmnistclassifierendpoint -f endpoints/batch/deploy-models/mnist-classifier/endpoint.yml | ||
| working-directory: cli | ||
| - name: cleanup endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml batch-endpoint delete -n modelsmnistclassifierendpoint -y | ||
| working-directory: cli |
63 changes: 63 additions & 0 deletions
63
.../cli-endpoints-online-custom-container-minimal-multimodel-minimal-multimodel-endpoint.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,63 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: cli-endpoints-online-custom-container-minimal-multimodel-minimal-multimodel-endpoint | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "8 7/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - cli/endpoints/online/custom-container/minimal/multimodel/** | ||
| - infra/** | ||
| - .github/workflows/cli-endpoints-online-custom-container-minimal-multimodel-minimal-multimodel-endpoint.yml | ||
| - cli/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| bash bootstrap.sh | ||
| working-directory: infra | ||
| continue-on-error: false | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: delete endpoint if existing | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml online-endpoint delete -n odelminimalmultimodelendpoint -y | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: create endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| cat endpoints/online/custom-container/minimal/multimodel/minimal-multimodel-endpoint.yml | ||
| az ml online-endpoint create -n odelminimalmultimodelendpoint -f endpoints/online/custom-container/minimal/multimodel/minimal-multimodel-endpoint.yml | ||
| working-directory: cli | ||
| - name: cleanup endpoint | ||
| run: | | ||
| source "${{ github.workspace }}/infra/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/init_environment.sh"; | ||
| az ml online-endpoint delete -n odelminimalmultimodelendpoint -y | ||
| working-directory: cli |
Oops, something went wrong.