SciNet Command Line Utilities: Difference between revisions

From SciNet Users Documentation
Jump to navigation Jump to search
No edit summary
Line 62: Line 62:
|Niagara
|Niagara
|-
|-
|[[Slurm#jobperf | jobperf]]
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Monitoring_running_and_past_jobs jobperf]
| <''jobId''<nowiki> | </nowiki>''jobName''>
| <''jobId''<nowiki> | </nowiki>''jobName''>
|Informs about the performance of all nodes of a given job.
|Informs about the performance of all nodes of a given job.
|Niagara
|Trillium
|-
|-
|[[Slurm#Debug | debugjob]]
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Testing_and_debugging debugjob]
|[''number of nodes'']
|[''number of nodes'']
|Requests a time-limited interactive session of up to 4 dedicated nodes
|Requests a time-limited interactive session of up to 4 dedicated nodes
|Niagara
|Trillium
|-
|-
|}
|}
Line 84: Line 84:
|
|
|"module list"
|"module list"
|Niagara
|Trillium
|-
|-
|ml
|ml
|<modulename>
|<modulename>
|"module load <modulename>"
|"module load <modulename>"
|Niagara
|Trillium
|-
|-
|ml
|ml
|X
|X
|"module X"
|"module X"
|Niagara
|Trillium
|-
|-
|}
|}


= Related Topics =
= Related Topics =
[[Slurm#Monitoring_jobs | Monitoring jobs]]
[https://docs.alliancecan.ca/wiki/Running_jobs#Monitoring_jobs Monitoring jobs]
<br>
<br>
[[Niagara_Quickstart | Niagara Quickstart]]
[[Niagara_Quickstart | Niagara Quickstart]]
<br>
<br>
[[Slurm | Slurm Scheduler]]
[https://docs.alliancecan.ca/wiki/Running_jobs Slurm Scheduler]
<br>
<br>
[[FAQ#Monitoring_jobs_in_the_queue | Monitoring Jobs]]
[[FAQ#Monitoring_jobs_in_the_queue | Monitoring Jobs]]
<br>
<br>
[https://wiki.scinet.utoronto.ca/wiki/images/a/a0/TechTalkJobMonitoring.pdf Tech Talk on Monitoring Jobs]
[https://wiki.scinet.utoronto.ca/wiki/images/a/a0/TechTalkJobMonitoring.pdf Tech Talk on Monitoring Jobs]

Revision as of 18:03, 9 November 2026

Below is list of handy command-line utilities written by SciNet to help manage your data and compute.

Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').

Storage

Command Arguments Description Cluster
quota Short overview of a user's storage usage. Niagara
diskUsage -h to see all command options Informs about the user and group file system usage. Niagara, BGQ
topUserDirOver1000list Lists your directories that have over 1,000 files Niagara
topUserDirOver1GBlist Lists your directories that have over 1 GB of data Niagara

Jobs & Queues

Command Arguments Description Cluster
qsum most squeue arguments work Lists jobs running or in the queue, grouped by user. Niagara
llq2 Detailed information on jobs that are actively running. BGQ
scinet niagara priority Compute usage in the last 7 days, and how this affects your priority in the queue. Niagara
nodeperf [userName] Who is doing what on the current node? Niagara
jobperf <jobId | jobName> Informs about the performance of all nodes of a given job. Trillium
debugjob [number of nodes] Requests a time-limited interactive session of up to 4 dedicated nodes Trillium

Modules

Command Arguments Description Cluster
ml "module list" Trillium
ml <modulename> "module load <modulename>" Trillium
ml X "module X" Trillium

Related Topics

Monitoring jobs
Niagara Quickstart
Slurm Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs