Niagara

Basic Description of Niagara here.

Login

Use your CC credentials to login to USERID@niagara.scinet.utoronto.ca.

QuickStart

FileSystems

$HOME $PROJECT $SCRATCH

Software

module load

Scheduling

Scheduler is Slurm, 24 hour walltime. Debug queue on 5 nodes, 1 hour walltime.

Submit a job

sbatch my.script

List jobs

squeue

Look at available nodes

sinfo

Cancel a job

scancel $JOBID

Partitions are dragonfly1,dragonfly2,dragonfly3,dragonfly4,compute. Specify a dragonfly[1-4] if you want to ensure 1:1 (upto 432 nodes), otherwise specify nothing or compute to use upto 1500. You can also specify an explicit noderange if you want #SBATCH --nodelist=nia[0801-1000]

For IntelMPI - Start with this

#!/bin/bash 
#SBATCH -N 200
#SBATCH --ntasks-per-node=40
#SBATCH -t 00:30:00
#SBATCH -J test

module load NiaEnv/2018b intel/2018.1 intelmpi/2018.1

mpiexec.hydra my.code

For HPCX (OpenMPI)

Main Page

Contents