SciNet Command Line Utilities

From SciNet Users Documentation
Revision as of 01:28, 10 August 2018 by Ejspence (talk | contribs) (→‎Modules)
Jump to navigation Jump to search

Below is list of handy command-line utilities written by SciNet to help manage your data and compute.

Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').

Storage

Command Arguments Description Cluster
quota Short overview of a user's storage usage. Niagara
diskUsage -h to see all command options Informs about the user and group file system usage. Niagara, BGQ
topUserDirOver1000list Lists your directories that have over 1,000 files Niagara
topUserDirOver1GBlist Lists your directories that have over 1 GB of data Niagara

Jobs & Queues

Command Arguments Description Cluster
qsum most squeue arguments work Lists jobs running or in the queue, grouped by user. Niagara
llq2 Detailed information on jobs that are actively running. BGQ
scinet niagara priority Compute usage in the last 7 days, and how this affects your priority in the queue. Niagara
nodeperf [userName] Who is doing what on the current node? NIagara
jobperf <jobId | jobName> Informs about the performance of all nodes of a given job. NIagara
debugjob [number of nodes] Requests a time-limited interactive session of up to 4 dedicated nodes Niagara

Modules

Command Arguments Description Cluster
ml "module list" NIagara
ml <modulename> "module load <modulename>" NIagara
ml X "module X" NIagara

Related Topics

Checking the memory usage from jobs
GPC Quickstart
Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs