-
Notifications
You must be signed in to change notification settings - Fork 23
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge remote-tracking branch 'origin/dev_sagemaker_ground_truth' into…
… dev_sagemaker_ground_truth
- Loading branch information
Showing
74 changed files
with
1,873 additions
and
1,230 deletions.
There are no files selected for viewing
98 changes: 98 additions & 0 deletions
98
.github/workflows/module-checks-dev-requirements-change.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,98 @@ | ||
| name: Module Checks Dev Requirements Change | ||
|
|
||
| on: | ||
| push: | ||
| branches: | ||
| - "main" | ||
| paths: | ||
| - "requirements-dev.txt" | ||
|
|
||
| pull_request: | ||
| branches: | ||
| - "main" | ||
| - "release/*" | ||
| - "stable" | ||
| paths: | ||
| - "requirements-dev.txt" | ||
|
|
||
| jobs: | ||
| get-modules: | ||
| name: Get Modules | ||
| runs-on: ubuntu-latest | ||
| outputs: | ||
| matrix: ${{ steps.get-modules.outputs.matrix }} | ||
| steps: | ||
| - name: Checkout | ||
| uses: actions/checkout@v4 | ||
| with: | ||
| fetch-depth: 0 | ||
| - name: Get modules | ||
| id: get-modules | ||
| run: | | ||
| set -x | ||
| # Get all the modules that have the file "deployspec.yaml" | ||
| MODULES=$(find modules -type f -name "deployspec.yaml" | cut -d/ -f 2-3 | uniq) | ||
| # Create our json structure [{"module_name": "..."}] | ||
| MODULES_JSON=$(echo "$MODULES" | jq -R -s 'split("\n")' | jq '[ .[] | select(length > 0) ]' | jq 'map({"module_name": .})') | ||
| # Export the modules as json to the outputs | ||
| echo 'matrix<<EOF' >> $GITHUB_OUTPUT | ||
| echo $MODULES_JSON >> $GITHUB_OUTPUT | ||
| echo 'EOF' >> $GITHUB_OUTPUT | ||
| test: | ||
| name: Run unit tests for module ${{ matrix.modules.module_name }} | ||
| needs: get-modules | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| modules: ${{ fromJson(needs.get-modules.outputs.matrix) }} | ||
| python-version: [3.9] | ||
| node-version: [18.x] | ||
| runs-on: ubuntu-latest | ||
| env: | ||
| MODULE_PATH: 'modules/${{ matrix.modules.module_name }}' | ||
| steps: | ||
| - name: Checkout | ||
| uses: actions/checkout@v3 | ||
| with: | ||
| fetch-depth: 0 | ||
| - id: determine-language | ||
| name: Determine Language | ||
| run: | | ||
| set -x | ||
| if [ -f $MODULE_PATH/package.json ]; then \ | ||
| echo "language=typescript" >> "$GITHUB_OUTPUT"; \ | ||
| elif [ -f $MODULE_PATH/requirements.txt ]; then \ | ||
| echo "language=python" >> "$GITHUB_OUTPUT"; \ | ||
| elif [ -f $MODULE_PATH/pyproject.toml ]; then \ | ||
| echo "language=python" >> "$GITHUB_OUTPUT"; \ | ||
| fi | ||
| - name: Set up Python ${{ matrix.python-version }} | ||
| uses: actions/setup-python@v4 | ||
| with: | ||
| python-version: ${{ matrix.python-version }} | ||
| - name: Set up Node ${{ matrix.node-version }} | ||
| uses: actions/setup-node@v4 | ||
| with: | ||
| node-version: ${{ matrix.node-version }} | ||
| - name: Install Requirements (Python) | ||
| if: ${{ steps.determine-language.outputs.language == 'python' }} | ||
| run: | | ||
| set -x | ||
| python -m pip install --upgrade pip | ||
| pip install -r requirements-dev.txt | ||
| pip install -r $MODULE_PATH/requirements.txt | ||
| - name: Install Requirements (Typescript) | ||
| if: ${{ steps.determine-language.outputs.language == 'typescript' }} | ||
| run: | | ||
| set -x | ||
| cd $MODULE_PATH | ||
| npm install | ||
| - name: Static checks and linting | ||
| run: scripts/validate.sh --language ${{ steps.determine-language.outputs.language }} --path $MODULE_PATH/ | ||
| - name: Pytest | ||
| if: ${{ steps.determine-language.outputs.language == 'python' }} | ||
| run: cd $MODULE_PATH/ && pytest | ||
| - name: NPM Test | ||
| if: ${{ steps.determine-language.outputs.language == 'typescript' }} | ||
| run: cd $MODULE_PATH/ && npm test |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| 1.3.0 | ||
| 1.4.0 |
Oops, something went wrong.