Running on Solstorm (cluster)

Setup

To use the cluster, you have to put the following in your .bashrc:

module load Python/3.10.4-GCCcore-11.3.0 (or other python3 version)

You should use solstorm.iot.ntnu.no and not solstorm-login.iot.ntnu.no.

Scripts

The cluster support is built with four scripts:

• create_runs.py: Creates the jobs to be distributed to the cluster. Modify and run this script to generate the cluster jobs for your experiment.
• run_all.sh: Distributes all jobs created with create_jobs.py and runs them on the individual nodes
• run.py: This script runs on all the individual compute nodes. It is executed automatically by run_all.sh
• visualise_runs.py: Example of how to visualize the results from the cluster run.

Usage

1. First modify create_runs.py with the requirements of your experiment
2. Create the jobs like this: $ python3 create_runs.py
3. Distribute and run all jobs like this: $ ./run_all.sh
4. The results are stored in output.csv
5. Optionally visualize the results like this (on a computer with X11): $ python3 visualise_runs.py