Running on Solstorm (cluster)

Setup

To use the cluster, you have to put the following in your .bashrc:

module load Python/3.10.4-GCCcore-11.3.0 (or other python3 version)

You should use solstorm.iot.ntnu.no and not solstorm-login.iot.ntnu.no.

Scripts

The cluster support is built with four scripts:

• create_runs.py: Creates the jobs to be distributed to the cluster. Modify and run this script to generate the cluster jobs for your experiment.
• run_all.sh: Distributes all jobs created with create_jobs.py and runs them on the individual nodes.
• run.py: This script runs on all the individual compute nodes. It is executed automatically by run_all.sh. The script stores data from the run in a file called output.csv. Modify this script to choose which data to store.
• visualise_runs.py: Example of how to visualize the results from the cluster run.

Usage

1. Modify create_runs.py with the requirements of your experiment
2. On solstorm.iot.ntnu.no:
   1. Create the jobs like this: $ python3 create_runs.py
   2. Distribute and run all jobs like this: $ ./run_all.sh
   3. The results are stored in output.csv
3. Optionally visualize the results like this (on your PC): $ python3 visualise_runs.py