Difference between revisions of "SciNet Command Line Utilities"

From SciNet Users Documentation
Jump to: navigation, search
(Jobs & Queues)
(Jobs & Queues)
Line 62: Line 62:
 
|NIagara
 
|NIagara
 
|-
 
|-
|jobperf
+
|[[Slurm#jobperf | jobperf]]
 
| <''jobId''<nowiki> | </nowiki>''jobName''>
 
| <''jobId''<nowiki> | </nowiki>''jobName''>
 
|Informs about the performance of all nodes of a given job.
 
|Informs about the performance of all nodes of a given job.
 
|NIagara
 
|NIagara
 
|-
 
|-
|debugjob
+
|[[Slurm#Debug | debugjob]]
|[''nodes'']
+
|[''number of nodes'']
|Requests a time-limited interactive session of up to 8 dedicated nodes
+
|Requests a time-limited interactive session of up to 4 dedicated nodes
 
|Niagara
 
|Niagara
 
|-
 
|-

Revision as of 01:16, 10 August 2018

Below is list of handy command-line utilities written by SciNet to help manage your data and compute.

Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').

Storage

Command Arguments Description Cluster
quota Short overview of a user's storage usage. Niagara
diskUsage -h to see all command options Informs about the user and group file system usage. Niagara, BGQ
topUserDirOver1000list Lists your directories that have over 1,000 files Niagara
topUserDirOver1GBlist Lists your directories that have over 1 GB of data Niagara

Jobs & Queues

Command Arguments Description Cluster
qsum most squeue arguments work Lists jobs running or in the queue, grouped by user. Niagara
llq2 Detailed information on jobs that are actively running. BGQ
scinet niagara priority Compute usage in the last 7 days, and how this affects your priority in the queue. Niagara
nodeperf [userName] Who is doing what on the current node? NIagara
jobperf <jobId | jobName> Informs about the performance of all nodes of a given job. NIagara
debugjob [number of nodes] Requests a time-limited interactive session of up to 4 dedicated nodes Niagara

Modules

Template:Hl2 | Command Template:Hl2| Arguments Template:Hl2| Description Template:Hl2| Cluster
modulefind [searchWord] Finds modules containing searchWord and indicate their compatibility with already loaded modules. GPC
moduleadvice <modulename> Show the module commands required to load modulename, taking into account prerequisites and conflicts with already loaded modules. GPC
modulewrap <comma-separated-modules> <command> Load the modules in the comma-separated-modules list (no spaces!) only to run the given command. GPC


Related Topics

Checking the memory usage from jobs
GPC Quickstart
Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs