SciNet Command Line Utilities: Difference between revisions

From SciNet Users Documentation
Jump to navigation Jump to search
No edit summary
No edit summary
 
(One intermediate revision by the same user not shown)
Line 16: Line 16:
|
|
|Short overview of a user's storage usage.
|Short overview of a user's storage usage.
|Niagara
|Trillium
|-
|-
|diskUsage
|diskUsage
|''-h'' to see all command options
|''-h'' to see all command options
|Informs about the user and group file system usage.
|Informs about the user and group file system usage.
|Niagara, BGQ
|Trillium
|-
|-
|topUserDirOver1000list
|topUserDirOver1000list
|
|
|Lists your directories that have over 1,000 files
|Lists your directories that have over 1,000 files
|Niagara
|Trillium
|-
|-
|topUserDirOver1GBlist  
|topUserDirOver1GBlist  
|
|
|Lists your directories that have over 1 GB of data
|Lists your directories that have over 1 GB of data
|Niagara
|Trillium
|-
|-
|}
|}
Line 45: Line 45:
|most squeue arguments work
|most squeue arguments work
|Lists jobs running or in the queue, grouped by user.
|Lists jobs running or in the queue, grouped by user.
|Niagara
|Trillium
|-
|-
|llq2
|scinet-priority
|
|Detailed information on jobs that are actively running.
|BGQ
|-
|scinet niagara priority
|
|
|Compute usage in the last 7 days, and how this affects your priority in the queue.
|Compute usage in the last 7 days, and how this affects your priority in the queue.
|Niagara
|Trillium
|-
|-
|nodeperf
|nodeperf
|[''userName'']
|[''userName'']
|Who is doing what on the current node?
|Who is doing what on the current node?
|Niagara
|Trillium
|-
|-
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Monitoring_running_and_past_jobs jobperf]
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Monitoring_running_and_past_jobs jobperf]
Line 69: Line 64:
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Testing_and_debugging debugjob]
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Testing_and_debugging debugjob]
|[''number of nodes'']
|[''number of nodes'']
|Requests a time-limited interactive session of up to 4 dedicated nodes
|Requests a time-limited interactive session of up to 4 dedicated nodes.  A <code>debugjob</code> session has X11 forwarding enabled, so graphical tools such as DDT can be started directly in the session.
|Trillium
|Trillium
|-
|-
Line 101: Line 96:
[https://docs.alliancecan.ca/wiki/Running_jobs#Monitoring_jobs Monitoring jobs]
[https://docs.alliancecan.ca/wiki/Running_jobs#Monitoring_jobs Monitoring jobs]
<br>
<br>
[[Niagara_Quickstart | Niagara Quickstart]]
[[Trillium_Quickstart | Trillium Quickstart]]
<br>
<br>
[https://docs.alliancecan.ca/wiki/Running_jobs Slurm Scheduler]
[https://docs.alliancecan.ca/wiki/Running_jobs Slurm Scheduler]

Latest revision as of 19:35, 9 November 2026

Below is list of handy command-line utilities written by SciNet to help manage your data and compute.

Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').

Storage

Command Arguments Description Cluster
quota Short overview of a user's storage usage. Trillium
diskUsage -h to see all command options Informs about the user and group file system usage. Trillium
topUserDirOver1000list Lists your directories that have over 1,000 files Trillium
topUserDirOver1GBlist Lists your directories that have over 1 GB of data Trillium

Jobs & Queues

Command Arguments Description Cluster
qsum most squeue arguments work Lists jobs running or in the queue, grouped by user. Trillium
scinet-priority Compute usage in the last 7 days, and how this affects your priority in the queue. Trillium
nodeperf [userName] Who is doing what on the current node? Trillium
jobperf <jobId | jobName> Informs about the performance of all nodes of a given job. Trillium
debugjob [number of nodes] Requests a time-limited interactive session of up to 4 dedicated nodes. A debugjob session has X11 forwarding enabled, so graphical tools such as DDT can be started directly in the session. Trillium

Modules

Command Arguments Description Cluster
ml "module list" Trillium
ml <modulename> "module load <modulename>" Trillium
ml X "module X" Trillium

Related Topics

Monitoring jobs
Trillium Quickstart
Slurm Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs