Main Page
System Status
Monday March 11, 2024: There will be an shutdown of the file system at SciNet for an emergency repair. As a consequence, the login nodes and compute nodes of all SciNet clusters using the file system (Niagara, Mist, Balam, Rouge, and Teach) will be down from 11 am EST until later in the afternoon. February 28, 2024, 16:30 PM EDT: All systems are recovered now. February 28, 2024, 1:00 PM EDT: A loop pump fault caused many compute nodes overheat. If you jobs failed around this time, please resubmit. Once the root cause has been addressed, the cluster will be brought up completely. Please report issues to support@scinet.utoronto.ca. February 22, 2024, 5:45 PM EDT: Maintenance finished and system restored. Please report issues to support@scinet.utoronto.ca. February 21, 2024, 7:00 AM EDT: Maintenance starting. Niagara login nodes and the file system are kept up as much as possible, but will be rebooted at some point. February 20, 2024, 3:45 PM EDT: Cooling tower has been restored, all systems are in production. February 20, 2024, 1:30 AM EDT: Cooling tower malfunction, all compute nodes are shutdown, the root cause will be addressed earliest in the morning. February 21 and 22, 2024: SciNet Data Centre Maintenance: The scheduler will hold jobs that cannot finish before the start of the shutdown. Users are encouraged to submit small and short jobs that can take advantage of this, as the scheduler may be able to fit these jobs in before the maintenance on otherwise idle nodes.
|