Difference between revisions of "SciNet Command Line Utilities"
From SciNet Users Documentation
(→Jobs & Queues) |
(→Jobs & Queues) |
||
| (7 intermediate revisions by one other user not shown) | |||
| Line 60: | Line 60: | ||
|[''userName''] | |[''userName''] | ||
|Who is doing what on the current node? | |Who is doing what on the current node? | ||
| − | | | + | |Niagara |
|- | |- | ||
| − | |jobperf | + | |[[Slurm#jobperf | jobperf]] |
| <''jobId''<nowiki> | </nowiki>''jobName''> | | <''jobId''<nowiki> | </nowiki>''jobName''> | ||
|Informs about the performance of all nodes of a given job. | |Informs about the performance of all nodes of a given job. | ||
| − | | | + | |Niagara |
|- | |- | ||
| − | |debugjob | + | |[[Slurm#Debug | debugjob]] |
| − | |[''nodes''] | + | |[''number of nodes''] |
| − | |Requests a time-limited interactive session of up to | + | |Requests a time-limited interactive session of up to 4 dedicated nodes |
|Niagara | |Niagara | ||
|- | |- | ||
| Line 75: | Line 75: | ||
= Modules = | = Modules = | ||
| − | {| | + | {|class = "wikitable" |
| − | ! | + | !|Command |
| − | ! | + | !| Arguments |
| − | ! | + | !| Description |
| − | ! | + | !| Cluster |
|- | |- | ||
| − | | | + | |ml |
| − | | | + | | |
| − | | | + | |"module list" |
| − | | | + | |Niagara |
|- | |- | ||
| − | | | + | |ml |
| − | |< | + | |<modulename> |
| − | | | + | |"module load <modulename>" |
| − | | | + | |Niagara |
|- | |- | ||
| − | | | + | |ml |
| − | | | + | |X |
| − | | | + | |"module X" |
| − | | | + | |Niagara |
|- | |- | ||
|} | |} | ||
| − | |||
= Related Topics = | = Related Topics = | ||
| − | [ | + | [[Slurm#Monitoring_jobs | Monitoring jobs]] |
<br> | <br> | ||
| − | [ | + | [[Niagara_Quickstart | Niagara Quickstart]] |
<br> | <br> | ||
| − | [ | + | [[Slurm | Slurm Scheduler]] |
<br> | <br> | ||
| − | [ | + | [[FAQ#Monitoring_jobs_in_the_queue | Monitoring Jobs]] |
<br> | <br> | ||
[https://wiki.scinet.utoronto.ca/wiki/images/a/a0/TechTalkJobMonitoring.pdf Tech Talk on Monitoring Jobs] | [https://wiki.scinet.utoronto.ca/wiki/images/a/a0/TechTalkJobMonitoring.pdf Tech Talk on Monitoring Jobs] | ||
Latest revision as of 15:02, 16 August 2018
Below is list of handy command-line utilities written by SciNet to help manage your data and compute.
Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').
Storage
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| quota | Short overview of a user's storage usage. | Niagara | |
| diskUsage | -h to see all command options | Informs about the user and group file system usage. | Niagara, BGQ |
| topUserDirOver1000list | Lists your directories that have over 1,000 files | Niagara | |
| topUserDirOver1GBlist | Lists your directories that have over 1 GB of data | Niagara |
Jobs & Queues
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| qsum | most squeue arguments work | Lists jobs running or in the queue, grouped by user. | Niagara |
| llq2 | Detailed information on jobs that are actively running. | BGQ | |
| scinet niagara priority | Compute usage in the last 7 days, and how this affects your priority in the queue. | Niagara | |
| nodeperf | [userName] | Who is doing what on the current node? | Niagara |
| jobperf | <jobId | jobName> | Informs about the performance of all nodes of a given job. | Niagara |
| debugjob | [number of nodes] | Requests a time-limited interactive session of up to 4 dedicated nodes | Niagara |
Modules
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| ml | "module list" | Niagara | |
| ml | <modulename> | "module load <modulename>" | Niagara |
| ml | X | "module X" | Niagara |
Related Topics
Monitoring jobs
Niagara Quickstart
Slurm Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs
