Skip to content

Latest commit

 

History

History
124 lines (110 loc) · 5 KB

test_campaign.md

File metadata and controls

124 lines (110 loc) · 5 KB

Running test campaigns for each operator

We provide the scripts to run the test campaigns for each operator below.

If you are going to run multiple test campaigns serially on one machine, you will have to do the following between runs for a cleanup:

bash scripts/teardown.sh

Cassop

This script runs the test campaign for the Cassop. This test campaign takes ~10 hours, and the results will be stored at testrun-cass directory.

python3 -m acto \
        --config data/cass-operator/config.json \
        --num-workers 16 \
        --workdir testrun-cass

CockroachOp

This script runs the test campaign for the CockroachOp. This test campaign takes ~6 hours, and the results will be stored at testrun-crdb directory.

python3 -m acto \
        --config data/cockroach-operator/config.json \
        --num-workers 16 \
        --workdir testrun-crdb

KnativeOp

This script runs the test campaigns for the two operators in the KnativeOp. The two test campaigns take ~6 hours in total, and the results will be stored separately at testrun-knative-serving and testrun-knative-eventing directories.

python3 -m acto \
        --config data/knative-operator-serving/config.json \
        --num-workers 16 \
        --workdir testrun-knative-serving
python3 -m acto \
        --config data/knative-operator-eventing/config.json \
        --num-workers 16 \
        --workdir testrun-knative-eventing

OCK/RedisOp

This script runs the test campaign for the OCK/RedisOp. This test campaign takes ~6 hours, and the results will be stored at testrun-redis-ot directory.

python3 -m acto \
        --config data/redis-ot-container-kit-operator/config.json \
        --num-workers 16 \
        --workdir testrun-redis-ot

OFC/MongoOp

This script runs the test campaign for the OFC/MongoOp. This test campaign takes ~6 hours, and the results will be stored at testrun-mongodb-comm directory.

python3 -m acto \
        --config data/mongodb-community-operator/config.json \
        --num-workers 16 \
        --workdir testrun-mongodb-comm

PCN/MongoOp

This script runs the test campaign for the PCN/MongoOp. This test campaign takes ~27 hours, and the results will be stored at testrun-percona-mongodb directory.

python3 -m acto \
        --config data/percona-server-mongodb-operator/config.json \
        --num-workers 12 \
        --workdir testrun-percona-mongodb

RabbitMQOp

This script runs the test campaign for the RabbitMQOp. This test campaign takes ~5 hours, and the results will be stored at testrun-rabbitmq directory.

python3 -m acto \
        --config data/rabbitmq-operator/config.json \
        --num-workers 16 \
        --workdir testrun-rabbitmq

SAH/RedisOp

This script runs the test campaign for the SAH/RedisOp. This test campaign takes ~8 hours, and the results will be stored at testrun-redis directory.

python3 -m acto \
        --config data/redis-operator/config.json \
        --num-workers 16 \
        --workdir testrun-redis

TiDBOp

This script runs the test campaign for the TiDBOp. This test campaign takes ~16 hours, and the results will be stored at testrun-tidb directory.

python3 -m acto \
        --config data/tidb-operator/config.json \
        --num-workers 12 \
        --workdir testrun-tidb

XtraDBOp

This script runs the test campaign for the XtraDBOp. This test campaign takes ~58 hours, and the results will be stored at testrun-xtradb directory.

python3 -m acto \
        --config data/percona-xtradb-cluster-operator/config.json \
        --num-workers 8 \
        --workdir testrun-xtradb

ZooKeeperOp

This script runs the test campaign for the ZooKeeperOp. This test campaign takes ~9 hours, and the results will be stored at testrun-zk directory.

python3 -m acto \
        --config data/zookeeper-operator/config.json \
        --num-workers 16 \
        --workdir testrun-zk