Steps for executing system tests using Docker Swarm based System Test Framework

On AWS

Prerequisites:

• An AWS account.

• Terraform installed.

• aws-access-key, aws-secret-key,aws-region and AWS key pem file from AWS console.

Parameters:

• aws-cred-path - the absolute path where AWS .pem file is located.

• config-path - the absolue path where AWS config terraform files are located.($rootDir/test/system/aws)

• pravega-org-name - the default is pravega/pravega and if it is a fork that you are using, then use fork-name/pravega(github user-name/repo-name). Some forks might be like xxxx/pravega1. In such cases, we should use the same xxxx/pravega1.

• branch-name - the branch against which you want to run system tests.

• image-version - should be same as branch-name.

• commit-id - the commit id for the latest commit to your branch.

Manual:

Commands:

To execute system tests

./gradlew clean --info startSystemTestsWithDocker -DskipServiceInstallation=false -Dlog.level=DEBUG -DexecType=DOCKER -PawsExecution=true -Paws_access_key=<aws-access-key>  -Paws_secret_key=<aws-secret-key>  -Paws_region=<aws-region>  -Paws_key_name=<aws-key-name> -Pcred_path=<aws-cred-path> -Pconfig_path=<config-path> -Ppravega_org=<pravega-org-name> -Ppravega_branch=<branch-name> -DimageVersion=<pravega-image-version> -DawsExec=true 

To collect logs into s3 bucket

 ./gradlew --info collectSystemTestLogsFromAws -Paws_access_key=<aws-access-key> -Paws_secret_key=<aws-secret-key>
 -Paws_region=<aws-region> -Paws_key_name=<aws-key-name> -Pcred_path=<aws-cred-path> -Pconfig_path=<config-path>
 -Ppravega_org=<pravega-org-name> -Ppravega_branch= <branch-name> -Ptravis_commit=<commit-id>

Automatic:

Use travis.yml

Logs:

s3 bucket

Note: Logs are stored in the following format:

branch-name
|
commit-id
|
log-files