Burst Buffer

From SciNet Users Documentation
Revision as of 20:45, 3 May 2018 by Rzon (talk | contribs) (Created page with "The Niagara Burst Buffer is available, but in a preliminary setup, as follows: To use burst buffer, you have to request space on it, with a proper motivation, to support@scin...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

The Niagara Burst Buffer is available, but in a preliminary setup, as follows:

To use burst buffer, you have to request space on it, with a proper motivation, to support@scinet.utoronto.ca.

Users with burst buffer access, will have a directory there that can be used. The location is $BBUFFER and is accessible like $SCRATCH from all nodes. A quota (several TBs) will be set.

Burst buffer is meant for temporary files, and will have a 48 hour purge policy setup to make sure it stays available.

Please test a burst buffer workflow using a short test job first.

Make sure to run in $BBUFFER and then copy any final solution files back to $SCRATCH at the end of the job.

Unlike /dev/shm though the files will stay between jobs, however you should still endeavour to clean up after each job.

Retrieved from "https://docs.scinet.utoronto.ca/index.php?title=Burst_Buffer&oldid=119"