SciNet Users Documentation - User contributions [en]

Main Page

2026-11-13T13:08:00Z

Dgruner: /* System Status */

2026-08-29T18:25:54Z

Dgruner: /* Available modules */

The [https://www.vasp.at Vienna Ab initio Simulation Package] is an atomic-scale materials modelling program, (electronic structure calculations, from first principles). It is available through both the Trillium and {{Alliance}} software stacks.

=Licensing=
To start, we at SciNet don't have a site license, and we are not able to provide VASP on Trillium through CVMFS (CCEnv). If you want to run VASP on SciNet systems you or your PI must already have your own license from your UofT department or institution. This way we can make arrangements to honor that license on our systems.

To use the pre-built VASP binaries on Trillium, you must first [mailto:support@tech.alliancecan.ca write to {{TheAlliance}} support] requesting access to VASP with the following information:
* Include license holder (your PI) information:
*# Name
*# Email address
*# Department and institution (university).
* Include license information:
*# Indicate the version of VASP license ('''VASP version 6 or version 5''').
*# The '''license number'''.

If you are licensed for version 6 you may also use version 5, but a version 5 license does not permit you to use version 6.

=Available modules=
vasp/5.4.1-mods-mch-vtst
vasp/5.4.4
vasp/5.4.4-mnvfm
vasp/5.4.4.pl2-vaspsol
vasp/6.3.2-vtst-vaspsol
vasp/6.4.2
vasp/6.4.2-gpu
vasp/6.6.1

=Running using the Trillium installation=

Because VASP is commercial software it is hidden in the Trillium software stack by default. To see which modules are available, perform the following steps from a Trillium login node.
module use /opt/software/commercial/modules
module spider vasp
Membership in this group is administered by {{TheAlliance}}. See [[#Licensing | the licensing section]] above.
Module should be loaded as follows:

For vasp/6.4.2:
module load StdEnv/2023 intel/2023.2.1 intelmpi/2021.9.0 hdf5/1.14.2
module use /opt/software/commercial/modules
module load vasp/6.4.2

For vasp/5.4.4:
module load StdEnv/2023 intel/2023.2.1 intelmpi/2021.9.0
module load imkl/2023.2.0
module use /opt/software/commercial/modules
module load vasp/5.4.4

==VASP 6.4.2 on Trillium CPU==

Example submission script for a job running on 1 nodes, with max walltime of 11 hours:

<source lang="bash">
#!/bin/bash
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=192
#SBATCH --time=11:00:00
#SBATCH --job-name=vasp_cpu_test

cd "$SLURM_SUBMIT_DIR"

module load StdEnv/2023 intel/2023.2.1 intelmpi/2021.9.0 hdf5/1.14.2
module use /opt/software/commercial/modules
module load vasp/6.4.2

mpirun vasp_std
</source>
Further customization of the script can be found at the [https://ondemand.scinet.utoronto.ca/pun/sys/OpenComposer/vasp-slurm OnDemand portal].

==Running VASP on Trillium GPU==
Module should be loaded as follows:
module load StdEnv/2023 nvhpc/25.1 cuda/12.6 nccl/2.26.2 imkl/2023.2.0 hdf5/1.14.5
module use /opt/software/commercial/modules
module load vasp/6.4.2-gpu

==VASP 6.4.2 on Trillium GPU==

Example submission script for a job running on 1 nodes, with max walltime of 11 hours:

<source lang="bash">
#!/bin/bash
#SBATCH --nodes=1
#SBATCH --gpus-per-node=1
#SBATCH --ntasks=1
#SBATCH --time=11:00:00
#SBATCH --job-name=vasp_gpu_test

cd "$SLURM_SUBMIT_DIR"

module load StdEnv/2023 nvhpc/25.1 cuda/12.6 nccl/2.26.2 imkl/2023.2.0 hdf5/1.14.5
module use /opt/software/commercial/modules
module load vasp/6.4.2-gpu

mpirun vasp_std
</source>
Further customization of the script can be found at the [https://ondemand.scinet.utoronto.ca/pun/sys/OpenComposer/vasp-slurm OnDemand portal].

==Running VASP on Balam==

VASP is available on Balam. Load <code>CCEnv</code> before loading the VASP prerequisite modules and commercial module path.

Example submission script for a one-GPU VASP 6.4.2 job:

<source lang="bash">
#!/bin/bash
#SBATCH --nodes=1
#SBATCH --gpus-per-node=1
#SBATCH --ntasks=1
#SBATCH --time=11:00:00
#SBATCH --job-name=vasp_balam_gpu_test

cd "$SLURM_SUBMIT_DIR"

module load CCEnv
module load StdEnv/2023 nvhpc/25.1 cuda/12.6 nccl/2.26.2 imkl/2023.2.0 hdf5/1.14.5
module use /opt/software/commercial/modules
module load vasp/6.4.2-gpu

mpirun vasp_std
</source>

VASP uses four input files: INCAR, KPOINTS, POSCAR, POTCAR. It is best to prepare VASP input files in a separate directory for each job.

Choose suitable INCAR parallelization settings (for example, <code>KPAR</code> and, where appropriate, <code>NCORE</code> or <code>NSIM</code>) to match the allocated MPI ranks and k-point workload, which helps ensure efficient use of requested resources.

Main Page

2026-07-21T20:40:58Z

Dgruner: /* System Status */

Main Page

2025-12-31T17:40:05Z

Dgruner: /* System Status */

Main Page

2025-12-30T19:11:36Z

Dgruner: /* System Status */

S4H

2025-12-02T21:43:03Z

Dgruner:

= Introduction =
S4H (formerly SciNet4Health) is our secure computing environment pilot, providing users with the ability to run [https://docs.alliancecan.ca/wiki/Trillium_Quickstart Trillium] jobs on confidential data. This subsystem is comprised of a dedicated login node and a storage appliance, but it is highly integrated with Trillium. Security concerns are addressed by

* Hardened access
* Encryption at rest
* Group isolation
* Data egress control (optional)

Usage of S4H is by request only. Access must be requested by a principal investigator (PI) on behalf of their group members (i.e. sponsored users on CCDB).

= Policies =
Each user is assigned one of three policies:

* '''Permissive:''' the user may connect to the login node using SSH from pre-approved source IP addresses, and has unrestricted internet access from the login node
* '''Restrictive:''' the user may connect to the login node using SSH from pre-approved source IP addresses, but internet access from the login node is restricted
* '''Prohibitive:''' the user may only connect to the login node using a remote desktop client program from pre-approved source IP addresses, and internet access from the login node is restricted

If you don't know what policy you belong to, you should ask your PI.

= Login =
== Direct ==
Users with permission to connect directly to the login node (permissive and restrictive policies) should first make sure that they are able to login to Trillium (i.e. they have uploaded an SSH public key to, and set up second factor authentication on CCDB). If access to Trillium is successful, use the same username and SSH key to login to the following address:

<pre>
s4h.scinet.utoronto.ca
</pre>

You should be prompted for the second factor, like in Trillium.

The connection must be made from one of the '''IP addresses pre-approved by the PI''' for that user (e.g. a workstation or a jump host in your lab).

== Through the graphical gateway ==
Users with permission to connect through the graphical gateway should use an RDP-enabled remote desktop client and login to the following address using their CCDB username and password:

<pre>
s4h-ggw.scinet.utoronto.ca
</pre>

It is recommended to set the display resolution to 1600×900 if the resolution is not picked up automatically by the program.

Additionally, a "pre-login" step has to be performed. In this step, an SSH ''agent'' must be forwarded to the above address. The graphical gateway asks the user's SSH agent program to perform the authentication (i.e. the workstation where the user is connecting from has the private key and it has been added to the agent). In a sense this is a 3-factor authentication: one needs the password, the SSH private key, and have either a YubiKey or the Duo mobile app registered with CCDB. Here is an example of this process:

<pre>
eval $(ssh-agent)
ssh-add /home/alice/.ssh/ccdb_ed25519
ssh -T -A alice@s4h-ggw.scinet.utoronto.ca
</pre>

Note that no shell access is expected after the <code>ssh</code> command; but the window on the remote desktop program should now prompt for the YubiKey passcode or Duo mobile app push. Once that is done as well, the SSH client will print _Login successful_ and quit.

The connection must be made from one of the '''IP addresses pre-approved by the PI''' for that user (e.g. a workstation or a jump host in your lab).

= Storage =
== Directories ==
Trillium file systems are accessible via their usual paths but are read-only on S4H (to prevent accidentally saving sensitive data there). Instead, home, scratch, and project spaces are provided on alternative paths under <code>/s4h</code> (indicating the encrypted storage appliance). If the user "alice" belongs to the group "def-bob" on S4H, their home directory (which can be expanded from <code>~</code> or <code>$HOME</code>) will be located in <code>/s4h/def-bob/home/alice</code> and similarly their scratch directory (can be expanded from <code>$SCRATCH</code>) will be in <code>/s4h/def-bob/scratch/alice</code>. The project directory is <code>/s4h/def-bob/project</code>, users may create their own directories there as needed.

The environment variables <code>$TRIHOME</code>, <code>$TRISCRATCH</code>, and <code>$TRIPROJECT</code> expand to the corresponding file system paths for Trillium (as noted above, they are read-only on S4H)

== Data transfer ==
For users in the permissive and restrictive policies, please use an SSH-based program (such as <code>scp</code> or <code>rsync</code>) to transfer data directly in and out of the S4H login node. There is no dedicated datamover for S4H.

Under the prohibitive policy, users may not transfer sensitive data in and out of S4H. They may only upload non-sensitive data to Trillium (storage not encrypted at rest) where they can be accessed from S4H. For egress purposes, the PI should designate at least one user (could be themselves) that is not under the prohibitive policy. Other users in the group could share files for egress with the designated user (e.g. by putting them in the group's project directory).

== Data policies ==
It is important to understand that:
* Within a group, file access is managed by traditional POSIX permissions and access-control lists, like on Trillium. In case users in a group are working on separate sub-projects where there should not be mutual access, it is their responsibility to make sure that permissions are set up correctly.
* There is no way to facilitate cross-group file sharing of sensitive files on S4H; each group has a different encryption key and the system is set up so that a compute node can only use one key at a time.
* No backup is provided for encrypted storage; deletion is irreversible. This ensure that data are securely disposed of in compliance with a provision found in many data sharing agreements.

= Software =
Same as Trillium.

Note that you may use software (including, for example, Python virtual environments) that you installed in your Trillium file systems on S4H (but not vice versa). This could be useful for users under the restrictive or prohibitive policy, that may otherwise have difficulty installing software in their encrypted storage spaces.

= Submitting jobs =
This is largely the same as Trillium. Note however that job metadata are not kept confidential! In particular, the submitting user, work directory, job name, comment, and command should be ''considered public information'' and the users must not include any sensitive information in these.

Main Page

2025-07-05T02:06:46Z

Dgruner: /* System Status */

Gurobi

2024-06-14T19:54:43Z

Dgruner: /* Gurobi 9.5.1 */

The [http://www.gurobi.com/ Gurobi] linear programming solver is installed on the Niagara software stack.

"Given a set of linear inequality/equality constraints, Ax>=b, where A is a matrix and x & b are vectors, what is the set of variables x (within a given range) that maximizes/minimizes a target objective function f(x)?"

Such a model is very common in scientific computation, engineering, and business. If the variables x are (partially) limited to integers, this becomes Mixed Integer Programming (MIP) which is a much more sophisticated problem. Gurobi, along with other solvers (such as "linprog" and "intlinprog" in [[MATLAB]]) can solve such LP/MIP problems efficiently. And for Gurobi, for instance, efficient multi-threading (and even distributed computation, depending on the license) capabilities are also implemented for parallelism and easy scaling for large models.

=Getting a license=
The University of Toronto has a free academic license to use Gurobi. Access to the license is granted by loading the Gurobi module.

=Running using the Niagara installation=

==Gurobi 11.0.1==
To access commercial modules on Niagara one must invoke the 'module use' command.

module load NiaEnv/2022a
module use /scinet/niagara/software/commercial/modules
module load gurobi/11.0.1

==Using Gurobi==

To use Gurobi, one only needs to include "gurobi_c++.h" in the source file, and use the compilation/linking flags:

CXXLIB=-L ${SCINET_GUROBI_LIB} -lgurobi_g++5.2 -lgurobi75 -fopenmp
CXXINC=-I ${SCINET_GUROBI_INC} -fopenmp

The actual documentation for using Gurobi's API can be found [http://www.gurobi.com/documentation/7.5 here].

==Running Gurobi==
Example submission script for a job running on 1 node, with max walltime of 11 hours:

<source lang="bash">
#!/bin/bash
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=40
#SBATCH --time=11:00:00
#SBATCH --job-name test

module use /scinet/niagara/software/commercial/modules
module load gurobi/7.5.2

# DIRECTORY TO RUN - $SLURM_SUBMIT_DIR is directory job was submitted from
cd $SLURM_SUBMIT_DIR

# If you are using OpenMP
export OMP_NUM_THREADS=$SLURM_CPUS_PER_TASK

./mycode
</source>

Main Page

2024-05-29T17:55:35Z

Dgruner: /* System Status */

__NOTOC__
{| style="border-spacing:10px; width: 95%"
| style="padding:1em; padding-top:.1em; border:2px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|

==System Status==


{|style="width:100%"
|{{Down |Niagara|Niagara_Quickstart}}
|{{Down |Mist|Mist}}
|{{Down |Teach|Teach}}
|{{Down |Rouge|Rouge}}
|-
|{{Down |Jupyter Hub|Jupyter_Hub}}
|{{Down |Scheduler|Niagara_Quickstart#Submitting_jobs}}
|{{Down |File system|Niagara_Quickstart#Storage_and_quotas}}
|{{Down |Burst Buffer|Burst_Buffer}}
|-
|{{Down |HPSS|HPSS}}
|{{Down |Login Nodes|Niagara_Quickstart#Logging_in}}
|{{Down |External Network|Niagara_Quickstart#Logging_in}}
|{{Down |Globus |Globus}}
|-
|{{Down |Balam|Balam}}
|{{Down |CCEnv|Using_modules}}
|}

'''Wednesday May 29, 2 PM EDT''' Electricians are checking and testing all junction boxes and connectors under the raised floor for safety. Some systems are expected to be back up later today (storage, login nodes), and compute systems will be powered up as soon as it is deemed safe.

'''Tuesday May 28, 3 PM EDT''' Cleaning crews are at the datacentre, to pump the water and install dryers. Once the floors are dry, we need to inspect all electrical boxes to ensure safety. We do not expect to have a fully functional datacentre before Thursday, although we hope to be able to turn on the storage and login nodes sometime tomorrow, if circumstances permit. Apologies, and thank you for your patience.

'''Tuesday May 28, 7 AM EDT''' A water mains break outside our datacentre has caused extensive flooding, and all systems have been shut down preventatively.

'''Friday May 17, 10 PM EDT - Saturday May 18, 2 AM EDT:''' The external network will be unavailable for maintenance. Running and queued jobs on the systems will not be affected.

'''Tuesday May 14, 6:45 PM EDT:''' All systems are recovered now.

'''Tuesday May 14, 5 PM EDT:''' Power loss at the datacentre resulted in loss of cooling. Systems are being restored.

'''Friday May 3, 10 PM EDT - Saturday May 4, 2 AM EDT:''' The external network will be unavailable for maintenance. Running and queued jobs on the systems will not be affected.


[[Previous messages]]

{|style="border-spacing: 10px;width: 100%"
|valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== QuickStart Guides ==
* [[Niagara Quickstart]]
* [[HPSS | HPSS archival storage]]
* [[Mist| Mist Power 9 GPU cluster]]
* [[Teach|Teach cluster]]
* [[FAQ | FAQ (frequently asked questions)]]
* [[Acknowledging SciNet]]
| valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== Tutorials, Manuals, etc. ==
* [https://education.scinet.utoronto.ca SciNet education material]
* [https://www.youtube.com/c/SciNetHPCattheUniversityofToronto SciNet's YouTube channel]
* [[Modules specific to Niagara|Software Modules specific to Niagara]]
* [[Modules for Mist]]
* [[Commercial software]]
* [[Burst Buffer]]
* [[SSH#SSH Keys|SSH keys]]
* [[SSH Tunneling]]
* [[Visualization]]
* [[Running Serial Jobs on Niagara]]
* [[Jupyter Hub]]
|}

Main Page

2024-05-28T19:17:20Z

Dgruner: /* System Status */

__NOTOC__
{| style="border-spacing:10px; width: 95%"
| style="padding:1em; padding-top:.1em; border:2px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|

==System Status==


{|style="width:100%"
|{{Down |Niagara|Niagara_Quickstart}}
|{{Down |Mist|Mist}}
|{{Down |Teach|Teach}}
|{{Down |Rouge|Rouge}}
|-
|{{Down |Jupyter Hub|Jupyter_Hub}}
|{{Down |Scheduler|Niagara_Quickstart#Submitting_jobs}}
|{{Down |File system|Niagara_Quickstart#Storage_and_quotas}}
|{{Down |Burst Buffer|Burst_Buffer}}
|-
|{{Down |HPSS|HPSS}}
|{{Down |Login Nodes|Niagara_Quickstart#Logging_in}}
|{{Down |External Network|Niagara_Quickstart#Logging_in}}
|{{Down |Globus |Globus}}
|-
|{{Down |Balam|Balam}}
|{{Down |CCEnv|Using_modules}}
|}

'''Tuesday May 28, 3 PM EDT''' Cleaning crews are at the datacentre, to pump the water and install dryers. Once the floors are dry, we need to inspect all electrical boxes to ensure safety. We do not expect to have a fully functional datacentre before Thursday, although we hope to be able to turn on the storage and login nodes sometime tomorrow, if circumstances permit. Apologies, and thank you for your patience.

'''Tuesday May 28, 7 AM EDT''' A water mains break outside our datacentre has caused extensive flooding, and all systems have been shut down preventatively.

'''Friday May 17, 10 PM EDT - Saturday May 18, 2 AM EDT:''' The external network will be unavailable for maintenance. Running and queued jobs on the systems will not be affected.

'''Tuesday May 14, 6:45 PM EDT:''' All systems are recovered now.

'''Tuesday May 14, 5 PM EDT:''' Power loss at the datacentre resulted in loss of cooling. Systems are being restored.

'''Friday May 3, 10 PM EDT - Saturday May 4, 2 AM EDT:''' The external network will be unavailable for maintenance. Running and queued jobs on the systems will not be affected.


[[Previous messages]]

{|style="border-spacing: 10px;width: 100%"
|valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== QuickStart Guides ==
* [[Niagara Quickstart]]
* [[HPSS | HPSS archival storage]]
* [[Mist| Mist Power 9 GPU cluster]]
* [[Teach|Teach cluster]]
* [[FAQ | FAQ (frequently asked questions)]]
* [[Acknowledging SciNet]]
| valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== Tutorials, Manuals, etc. ==
* [https://education.scinet.utoronto.ca SciNet education material]
* [https://www.youtube.com/c/SciNetHPCattheUniversityofToronto SciNet's YouTube channel]
* [[Modules specific to Niagara|Software Modules specific to Niagara]]
* [[Modules for Mist]]
* [[Commercial software]]
* [[Burst Buffer]]
* [[SSH#SSH Keys|SSH keys]]
* [[SSH Tunneling]]
* [[Visualization]]
* [[Running Serial Jobs on Niagara]]
* [[Jupyter Hub]]
|}

Main Page

2024-05-28T10:58:14Z

Dgruner: /* System Status */

__NOTOC__
{| style="border-spacing:10px; width: 95%"
| style="padding:1em; padding-top:.1em; border:2px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|

==System Status==


{|style="width:100%"
|{{Down |Niagara|Niagara_Quickstart}}
|{{Down |Mist|Mist}}
|{{Down |Teach|Teach}}
|{{Down |Rouge|Rouge}}
|-
|{{Down |Jupyter Hub|Jupyter_Hub}}
|{{Down |Scheduler|Niagara_Quickstart#Submitting_jobs}}
|{{Down |File system|Niagara_Quickstart#Storage_and_quotas}}
|{{Down |Burst Buffer|Burst_Buffer}}
|-
|{{Down |HPSS|HPSS}}
|{{Down |Login Nodes|Niagara_Quickstart#Logging_in}}
|{{Down |External Network|Niagara_Quickstart#Logging_in}}
|{{Down |Globus |Globus}}
|-
|{{Down |Balam|Balam}}
|{{Down |CCEnv|Using_modules}}
|}

'''Tuesday May 28, 7 AM EDT''' A water mains break outside our datacentre has caused extensive flooding, and all systems have been shut down preventatively.

'''Friday May 17, 10 PM EDT - Saturday May 18, 2 AM EDT:''' The external network will be unavailable for maintenance. Running and queued jobs on the systems will not be affected.

'''Tuesday May 14, 6:45 PM EDT:''' All systems are recovered now.

'''Tuesday May 14, 5 PM EDT:''' Power loss at the datacentre resulted in loss of cooling. Systems are being restored.

'''Friday May 3, 10 PM EDT - Saturday May 4, 2 AM EDT:''' The external network will be unavailable for maintenance. Running and queued jobs on the systems will not be affected.


[[Previous messages]]

{|style="border-spacing: 10px;width: 100%"
|valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== QuickStart Guides ==
* [[Niagara Quickstart]]
* [[HPSS | HPSS archival storage]]
* [[Mist| Mist Power 9 GPU cluster]]
* [[Teach|Teach cluster]]
* [[FAQ | FAQ (frequently asked questions)]]
* [[Acknowledging SciNet]]
| valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== Tutorials, Manuals, etc. ==
* [https://education.scinet.utoronto.ca SciNet education material]
* [https://www.youtube.com/c/SciNetHPCattheUniversityofToronto SciNet's YouTube channel]
* [[Modules specific to Niagara|Software Modules specific to Niagara]]
* [[Modules for Mist]]
* [[Commercial software]]
* [[Burst Buffer]]
* [[SSH#SSH Keys|SSH keys]]
* [[SSH Tunneling]]
* [[Visualization]]
* [[Running Serial Jobs on Niagara]]
* [[Jupyter Hub]]
|}

Main Page

2024-05-28T10:56:11Z

Dgruner: /* System Status */

2019-04-10T02:24:39Z

Dgruner: /* System Status */

__NOTOC__
{| style="border-spacing:10px; width: 95%"
| style="padding:1em; padding-top:.1em; border:2px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|

==System Status==


{|style="width:100%"
|{{Up|Niagara|Niagara_Quickstart}}
|{{Up|HPSS|HPSS}}
|{{Up|BGQ|BGQ}}
|{{Up|SOSCIP GPU|SOSCIP_GPU}}
|-
|{{Up|P7|P7}}
|{{Up|P8|P8}}
|{{Up|Teach|Teach}}
|{{Up|Jupyter Hub|Jupyter_Hub}}
|-
|{{Up|Scheduler|Niagara_Quickstart#Submitting_jobs}}
|{{Up|File system|Niagara_Quickstart#Storage_and_quotas}}
|{{Up|External Network|Niagara_Quickstart#Logging_in}}
|{{Up|Globus|Globus}}
|}


Tue 9 Apr 2019 22:24:14 EDT: Network connection restored.

April 9, 2019, 15:20: Network connection down. Investigating.

April 5, 2019: Planned, short outage in connectivity to the SciNet datacentre from 7:30 am to 8:55 am EST for maintenance of the network. This outage will not affect running or queued jobs. It may be necessary to reboot the login nodes at some point tomorrow, which could result in a short interruption of connectivity, but which will have no effect on running or queued jobs.

April 5, 2019: Software updates on Niagara: The default CCEnv software stack now uses avx512 on Niagara, and there is now a NiaEnv/2019b stack ("epoch").

April 4, 2019: The 2019 compute and storage allocations have taken effect on Niagara.

{|style="border-spacing: 10px;width: 100%"
|valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== QuickStart Guides ==
* [[Niagara_Quickstart|Niagara Quickstart]]
* [[HPSS | HPSS archival storage]]
* [[BGQ | SOSCIP BlueGene/Q cluster]]
* [[SOSCIP_GPU | SOSCIP GPU cluster]]
* [[P7|Experimental Power 7 cluster]]
* [[P8|Experimental Power 8 GPU cluster]]
* [[Teach|Teach cluster]]
* [[FAQ | FAQ (frequently asked questions)]]
* [[Acknowledging_SciNet | Acknowledging SciNet]]
| valign="top" style="margin: 1em; padding:1em; padding-top:.1em; border:2px solid #000; background-color:#fff; border-radius:7px; width: 49.5%" |

== Tutorials, Manuals, etc. ==
* [https://courses.scinet.utoronto.ca SciNet education material]
* [https://www.youtube.com/c/SciNetHPCattheUniversityofToronto SciNet's YouTube channel]
* [[Modules specific to Niagara|Software Modules specific to Niagara]]
* [[Commercial software]]
* [[Burst Buffer]]
* [[SSH Tunneling]]
* [[Visualization]]
* [[Running Serial Jobs on Niagara]]
* [[Jupyter Hub]]
|}