Skip to content

MPI Configuration

Nicole Slattengren edited this page Jul 14, 2020 · 21 revisions

This page is for listing configuration/version information for different MPI implementations on target platforms.

Mutrino with Cray MPI (MPICH derivative)

  • The man page for MPI configuration can be found by running: man intro_mpi

  • For getting an informational print about MPI at startup: export MPICH_ENV_DISPLAY=1

Vortex with IBM Spectrum MPI (OpenMPI derivative)

  • The man page for MPI configuration can be found by running man ompi_info and ompi_info.

  • Here is a reference to the IBM Spectrum MPI manual that discusses how to tune the implementation: IBM Spectrum MPI Guide.

  • You can use ompi_info --param all all to see the options. Better yet, try ompi_info --param all all -l 9 --internal.

  • If you need to pass mpirun options to jsrun, use jsrun --smpiargs "<mpiarg1> <mpiarg2> ...".

  • Here is a link that discusses MCA tunnel atomics for RDMA: tunnel atomics. Enabling tunnel atomics doesn't seem to help performance of MPI_Fetch_and_op on Vortex.