Burst Buffer

From SciNet Users Documentation
Revision as of 20:45, 3 May 2018 by Rzon (talk | contribs) (Created page with "The Niagara Burst Buffer is available, but in a preliminary setup, as follows: To use burst buffer, you have to request space on it, with a proper motivation, to support@scin...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

The Niagara Burst Buffer is available, but in a preliminary setup, as follows:

To use burst buffer, you have to request space on it, with a proper motivation, to support@scinet.utoronto.ca.

Users with burst buffer access, will have a directory there that can be used. The location is $BBUFFER and is accessible like $SCRATCH from all nodes. A quota (several TBs) will be set.

Burst buffer is meant for temporary files, and will have a 48 hour purge policy setup to make sure it stays available.

Please test a burst buffer workflow using a short test job first.

Make sure to run in $BBUFFER and then copy any final solution files back to $SCRATCH at the end of the job.

Unlike /dev/shm though the files will stay between jobs, however you should still endeavour to clean up after each job.