Trillium Quickstart
| Trillium | |
|---|---|
| Installed | Aug 2025 |
| Operating System | Rocky Linux 9.6 |
| Number of Nodes | 1,224 nodes (235,008 cores) |
| Interconnect | Mellanox Dragonfly+ |
| Ram/Node | 768 GB |
| Cores/Node | 96 (192 hyperthreads) |
| Login/Devel Node | trillium.scinet.utoronto.ca |
| Vendor Compilers | icc (C) ifort (fortran) icpc (C++) |
| Queue Submission | Slurm |
Specifications
The Trillium cluster is a large cluster comprised of two types of nodes:
| nodes | cores | available memory | CPU | GPU |
|---|---|---|---|---|
| 1224 | 192 | 768GB DDR5 | 2 x AMD EPYC 9655 (Zen 5) @ 2.6 GHz, 384MB cache L3 | |
| 60 | 96 | 768GB DDR5 | 1 x AMD EPYC 9654 (Zen 4) @ 2.4 GHz, 384MB cache L3 | 4 x NVIDIA H100 SXM (80 GB memory) |
Each node of the cluster has 768 GB RAM per node. Being designed for large parallel workloads, it has a fast interconnect consisting of NDR InfiniBand in a Dragonfly+ topology with Adaptive Routing. The compute nodes are accessed through a queueing system that allows jobs with a minimum of 15 minutes and a maximum of 24 hours.
Getting started on Trillium
Access to Trillium is not enabled automatically for everyone with an account with the Digital Reseach Alliance of Canada (formerly Compute Canada), but anyone with an active Alliance account can get their access enabled.
Trillium is not automatically available to all Alliance account holders. If you are new to SciNet or your Supervisor/PI does not hold a current Alliance (formerly Compute Canada) RAC allocation, you may need to request access on the opt-in page on the CCDB site. After clicking the "Join" button, it usually takes only one or two business days for access to be granted.
You can check if you already have Trillium access by attempting to log in. If you receive a "Permission denied" error (and your SSH key is correctly set up), you may need to opt in.
Please read this document carefully. The FAQ is also a useful resource. If at any time you require assistance, or if something is unclear, please do not hesitate to contact us.
Logging in
Trillium runs Rocky Linux 9.6, which is a type of Linux. You will need to be familiar with Linux systems to work on Trillium. If you are not it will be worth your time to review our Introduction to Linux Shell class.
As with all SciNet and Alliance (formerly Compute Canada) compute systems, access to Trillium is done via SSH (secure shell) only and authentication is only allowed via SSH keys. Please refer to this page to generate your SSH key pair and make sure you use them securely.
Open a terminal window (e.g. Connecting with PuTTY on Windows or Connecting with MobaXTerm), then SSH into the Trillium login nodes with your Alliance (formerly Compute Canada) credentials:
$ ssh -i /path/to/ssh_private_key -Y MYALLIANCEUSERNAME@trillium.scinet.utoronto.ca
- The Trillium login nodes are where you develop, edit, compile, prepare and submit jobs.
- These login nodes are not part of the Trillium compute cluster, but have the same architecture, operating system, and software stack.
- The optional
-Yenables X11 forwarding, allowing graphical programs to open windows on your local computer. - To run on Trillium compute nodes, you must submit a batch job.
If you cannot log in, be sure to first check the System Status on this site's front page.