SciNet Command Line Utilities
Below is list of handy command-line utilities written by SciNet to help manage your data and compute.
Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').
Storage
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| quota | Short overview of a user's storage usage. | Niagara | |
| diskUsage | -h to see all command options | Informs about the user and group file system usage. | Niagara, BGQ |
| topUserDirOver1000list | Lists your directories that have over 1,000 files | Niagara | |
| topUserDirOver1GBlist | Lists your directories that have over 1 GB of data | Niagara |
Jobs & Queues
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| qsum | most squeue arguments work | Lists jobs running or in the queue, grouped by user. | Niagara |
| llq2 | Detailed information on jobs that are actively running. | BGQ | |
| scinet niagara priority | Compute usage in the last 7 days, and how this affects your priority in the queue. | Niagara | |
| nodeperf | [userName] | Who is doing what on the current node? | NIagara |
| jobperf | <jobId | jobName> | Informs about the performance of all nodes of a given job. | NIagara |
| debugjob | [nodes] | Requests a time-limited interactive session of up to 8 dedicated nodes | Niagara |
Modules
| Template:Hl2 | Command | Template:Hl2| Arguments | Template:Hl2| Description | Template:Hl2| Cluster |
|---|---|---|---|
| modulefind | [searchWord] | Finds modules containing searchWord and indicate their compatibility with already loaded modules. | GPC |
| moduleadvice | <modulename> | Show the module commands required to load modulename, taking into account prerequisites and conflicts with already loaded modules. | GPC |
| modulewrap | <comma-separated-modules> <command> | Load the modules in the comma-separated-modules list (no spaces!) only to run the given command. | GPC |
Related Topics
Checking the memory usage from jobs
GPC Quickstart
Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs