forked from opensearch-project/opensearch-build
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Change ref to 2.1 for opensearch dahsboards (opensearch-project#2267)
Signed-off-by: Sayali Gaikawad <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> versionincrement.yaml matrix test Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> Add test manifest to check build job (opensearch-project#2273) Signed-off-by: Sayali Gaikawad <[email protected]> Set concurrent build limit for gradle check (opensearch-project#2274) Signed-off-by: Peter Zhu <[email protected]> Add test coverage xml and support 1.x gradle check (opensearch-project#2279) * Add test coverage xml and support 1.x gradle check Signed-off-by: Peter Zhu <[email protected]> * Remove comments Signed-off-by: Peter Zhu <[email protected]> Add java args to 2.2.0 manifest (opensearch-project#2281) Signed-off-by: Sayali Gaikawad <[email protected]> Update downloadFromS3 lib env vars with credentials (opensearch-project#2278) Signed-off-by: Sayali Gaikawad <[email protected]> Update buildUploadManifestSHA lib env vars with credentials (opensearch-project#2277) Signed-off-by: Sayali Gaikawad <[email protected]> Update signArtifacts lib env vars with credentials (opensearch-project#2275) Signed-off-by: Sayali Gaikawad <[email protected]> [OSD][2.1] add functional test repo (opensearch-project#2282) Signed-off-by: Kawika Avilla <[email protected]> Change codecov xml name and move gradle check script to build repo (opensearch-project#2283) * Change codecov xml name and move gradle check script to build repo Signed-off-by: Peter Zhu <[email protected]> * Add tests Signed-off-by: Peter Zhu <[email protected]> * Tweak tokens Signed-off-by: Peter Zhu <[email protected]> * Tweak jenkins codeCoverage.xml Signed-off-by: Peter Zhu <[email protected]> * Add codeCoverage.xml Signed-off-by: Peter Zhu <[email protected]> Add gradle cleanup before the checks (opensearch-project#2285) Signed-off-by: Peter Zhu <[email protected]> Update promoteArtifactsLib lib env vars with credentials (opensearch-project#2284) * Resolve merge conflicts Signed-off-by: Sayali Gaikawad <[email protected]> Update remaining env vars with credentials in jenkins libraries (opensearch-project#2286) * Update getManifestSHA lib env vars with credentials Signed-off-by: Sayali Gaikawad <[email protected]> Remove 2.1.0 from cron for building release candidates (opensearch-project#2287) Signed-off-by: Sayali Gaikawad <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> Version increment automation Signed-off-by: pgodithi <[email protected]> Version increment automation Signed-off-by: pgodithi <[email protected]> Version increment automation Signed-off-by: pgodithi <[email protected]> Version increment automation Signed-off-by: pgodithi <[email protected]> Version increment automation Signed-off-by: pgodithi <[email protected]> Version increment automation Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test versionmatrixtest.yaml Signed-off-by: pgodithi <[email protected]> test version increment automation Signed-off-by: pgodithi <[email protected]> test version increment automation Signed-off-by: pgodithi <[email protected]> Staging version increment automation Signed-off-by: pgodithi <[email protected]> Staging version increment automation Signed-off-by: pgodithi <[email protected]> Staging version increment automation Signed-off-by: pgodithi <[email protected]> version increment automation Signed-off-by: pgodithi <[email protected]>
- Loading branch information
1 parent
3d7637a
commit 8d90ae6
Showing
42 changed files
with
1,045 additions
and
656 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,75 @@ | ||
| --- | ||
| name: Version Increment | ||
| on: | ||
| workflow_dispatch: | ||
| inputs: | ||
| logLevel: | ||
| description: Log level | ||
| required: true | ||
| default: warning | ||
| type: choice | ||
| options: | ||
| - info | ||
| - warning | ||
| - debug | ||
|
|
||
| jobs: | ||
| plugin-version-increment-sync: | ||
| runs-on: ubuntu-latest | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| repo: [common-utils, job-scheduler, ml-commons, performance-analyzer, security, alerting, index-management, sql, observability, asynchronous-search, k-NN, anomaly-detection, cross-cluster-replication, dashboards-reports] | ||
| branch: [{opensearch_branch: 1.3, plugin_branch: 1.3}] | ||
| # exclude: | ||
| # - {repo: notifications, branch: {opensearch_branch: "1.x", plugin_branch: "1.x"}} | ||
| # - {repo: notifications, branch: {opensearch_branch: "1.3", plugin_branch: "1.3"}} | ||
| env: | ||
| GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} | ||
| steps: | ||
| - name: Check out OpenSearch repo | ||
| uses: actions/checkout@v3 | ||
| with: | ||
| repository: opensearch-project/OpenSearch | ||
| ref: ${{ matrix.branch.opensearch_branch }} | ||
| - name: Fetch OpenSearch version | ||
| run: | | ||
| OPENSEARCH_VERSION=$(cat buildSrc/version.properties | grep opensearch | cut -d= -f2 | grep -oE '[0-9.]+') | ||
| OPENSEARCH_VERSION=$OPENSEARCH_VERSION-SNAPSHOT | ||
| echo "OPENSEARCH_VERSION=$OPENSEARCH_VERSION" >> $GITHUB_ENV | ||
| echo "OPENSEARCH_VERSION_NUMBER=$OPENSEARCH_VERSION" | cut -f1 -d"-" >> $GITHUB_ENV | ||
| - name: Check out plugin repo | ||
| uses: actions/checkout@v3 | ||
| with: | ||
| repository: prudhvigodithi/${{ matrix.repo }} | ||
| ref: ${{ matrix.branch.plugin_branch }} | ||
| - name: version comparision | ||
| run: | | ||
| OPENSEARCH_EXISTING_VERSION=$(grep opensearch.version gradle.properties | cut -d'=' -f 2-) | ||
| echo "OPENSEARCH_EXISTING_VERSION=$OPENSEARCH_EXISTING_VERSION" >> $GITHUB_ENV | ||
| echo "OPENSEARCH_EXISTING_VERSION_NUMBER=$OPENSEARCH_EXISTING_VERSION" | cut -f1 -d"-" >> $GITHUB_ENV | ||
| - name: Version Increment plugin repo | ||
| if: env.OPENSEARCH_EXISTING_VERSION_NUMBER != env.OPENSEARCH_VERSION_NUMBER | ||
| run: | | ||
| echo "OpenSearch Core repo version on branch ${{ matrix.branch.opensearch_branch }} is ${{ env.OPENSEARCH_VERSION_NUMBER }}" | ||
| echo "OpenSearch version for ${{ matrix.repo }} on branch ${{ matrix.branch.plugin_branch }} is ${{ env.OPENSEARCH_EXISTING_VERSION_NUMBER }}" | ||
| ./gradlew setVersion -PnewVersion=${{ env.OPENSEARCH_VERSION }} | ||
| - name: Create Pull Request | ||
| uses: peter-evans/create-pull-request@v4 | ||
| if: env.OPENSEARCH_EXISTING_VERSION_NUMBER != env.OPENSEARCH_VERSION_NUMBER | ||
| with: | ||
| token: ${{ secrets.PAT }} | ||
| author: opensearch-ci-bot <[email protected]> | ||
| commit-message: | | ||
| Version Increment. | ||
| Signed-off-by: opensearch-ci-bot <[email protected]> | ||
| delete-branch: true | ||
| branch: create-pull-request/${{ env.OPENSEARCH_VERSION }} | ||
| title: '[AUTO] Version Increment to ${{ env.OPENSEARCH_VERSION }}' | ||
| body: | | ||
| - Version Increment from **${{ env.OPENSEARCH_EXISTING_VERSION }}** to **${{ env.OPENSEARCH_VERSION }}**. | ||
| - name: Check outputs | ||
| run: |- | ||
| echo "Pull Request Number - ${{ steps.cpr.outputs.pull-request-number }}" | ||
| echo "Pull Request URL - ${{ steps.cpr.outputs.pull-request-url }}" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,69 @@ | ||
| #!/bin/bash | ||
|
|
||
|
|
||
| # SPDX-License-Identifier: Apache-2.0 | ||
| # | ||
| # The OpenSearch Contributors require contributions made to | ||
| # this file be licensed under the Apache-2.0 license or a | ||
| # compatible open source license. | ||
|
|
||
| # This script is used in OpenSearch Core repo github actions | ||
| # To trigger Jenkins Gradle Check from a PR | ||
|
|
||
|
|
||
| JENKINS_URL="https://build.ci.opensearch.org" | ||
| TIMEPASS=0 | ||
| TIMEOUT=7200 | ||
| RESULT="null" | ||
| TRIGGER_TOKEN=$1 | ||
| PAYLOAD_JSON="{\"pr_from_sha\": \"$pr_from_sha\", \"pr_from_clone_url\": \"$pr_from_clone_url\", \"pr_to_clone_url\": \"$pr_to_clone_url\", \"pr_title\": \"$pr_title\", \"pr_number\": \"$pr_number\"}" | ||
|
|
||
| echo "Trigger Jenkins workflows" | ||
| JENKINS_REQ=`curl -s -XPOST \ | ||
| -H "Authorization: Bearer $TRIGGER_TOKEN" \ | ||
| -H "Content-Type: application/json" \ | ||
| "$JENKINS_URL/generic-webhook-trigger/invoke" \ | ||
| --data "$(echo $PAYLOAD_JSON)"` | ||
|
|
||
| echo $PAYLOAD_JSON | jq | ||
| echo $JENKINS_REQ | ||
|
|
||
| QUEUE_URL=$(echo $JENKINS_REQ | jq --raw-output '.jobs."gradle-check".url') | ||
| echo QUEUE_URL $QUEUE_URL | ||
| echo "wait for jenkins to start workflow" && sleep 15 | ||
|
|
||
| echo "Check if queue exist in Jenkins after triggering" | ||
| if [ -z "$QUEUE_URL" ] || [ "$QUEUE_URL" != "null" ]; then | ||
| WORKFLOW_URL=$(curl -s -XGET ${JENKINS_URL}/${QUEUE_URL}api/json | jq --raw-output .executable.url) | ||
| echo WORKFLOW_URL $WORKFLOW_URL | ||
|
|
||
| echo "Use queue information to find build number in Jenkins if available" | ||
| if [ -z "$WORKFLOW_URL" ] || [ "$WORKFLOW_URL" != "null" ]; then | ||
|
|
||
| RUNNING="true" | ||
|
|
||
| echo "Waiting for Jenkins to complete the run" | ||
| while [ "$RUNNING" = "true" ] && [ "$TIMEPASS" -le "$TIMEOUT" ]; do | ||
| echo "Still running, wait for another 30 seconds before checking again, max timeout $TIMEOUT" | ||
| echo "Jenkins Workflow Url: $WORKFLOW_URL" | ||
| TIMEPASS=$(( TIMEPASS + 30 )) && echo time pass: $TIMEPASS | ||
| sleep 30 | ||
| RUNNING=$(curl -s -XGET ${WORKFLOW_URL}api/json | jq --raw-output .building) | ||
| done | ||
|
|
||
| echo "Complete the run, checking results now......" | ||
| RESULT=$(curl -s -XGET ${WORKFLOW_URL}api/json | jq --raw-output .result) | ||
|
|
||
| fi | ||
| fi | ||
|
|
||
| echo "Please check jenkins url for logs: $WORKFLOW_URL" | ||
|
|
||
| if [ "$RESULT" != "SUCCESS" ]; then | ||
| echo "Result: $RESULT" | ||
| exit 1 | ||
| else | ||
| echo "Result: $RESULT" | ||
| echo "Get codeCoverage.xml" && curl -SLO ${WORKFLOW_URL}artifact/codeCoverage.xml | ||
| echo 0 | ||
| fi |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.