August 21, 2020, 6:00 PM EST: The pump has been repaired, cooling is restored, systems are up.
August 19, 2020, 4:40 PM EST: Update: The current estimate is to have the cooling restored on Friday and we hope to have the systems available for users on Saturday August 22, 2020.
August 17, 2020, 4:00 PM EST: Unfortunately after taking the pump apart it was determined there was a more serious failure of the main drive shaft, not just the seal. As a new one will need to be sourced or fabricated we're estimating that it will take at least a few more days to get the part and repairs done to restore cooling. Sorry for the inconvenience.
August 15, 2020, 1:00 PM EST: Due to parts availablity to repair the failed pump and cooling system it is unlikely that systems will be able to be restored until Monday afternoon at the earliest.
August 15, 2020, 00:04 AM EST: A primary pump seal in the cooling infrastructure has blown and parts availability will not be able be determined until tomorrow. All systems are shut down as there is no cooling. If parts are available, systems may be back at the earliest late tomorrow. Check here for updates.
August 14, 2020, 21:04 AM EST: Tomorrow's /scratch purge has been postponed.
August 14, 2020, 21:00 AM EST: Staff at the datacenter. Looks like one of the pumps has a seal that is leaking badly.
August 14, 2020, 20:37 AM EST: We seem to be undergoing a thermal shutdown at the datacenter.
August 14, 2020, 20:20 AM EST: Network problems to niagara/mist. We are investigating.