SciNet Command Line Utilities: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| Line 62: | Line 62: | ||
|Niagara | |Niagara | ||
|- | |- | ||
|[ | |[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Monitoring_running_and_past_jobs jobperf] | ||
| <''jobId''<nowiki> | </nowiki>''jobName''> | | <''jobId''<nowiki> | </nowiki>''jobName''> | ||
|Informs about the performance of all nodes of a given job. | |Informs about the performance of all nodes of a given job. | ||
| | |Trillium | ||
|- | |- | ||
|[ | |[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Testing_and_debugging debugjob] | ||
|[''number of nodes''] | |[''number of nodes''] | ||
|Requests a time-limited interactive session of up to 4 dedicated nodes | |Requests a time-limited interactive session of up to 4 dedicated nodes | ||
| | |Trillium | ||
|- | |- | ||
|} | |} | ||
| Line 84: | Line 84: | ||
| | | | ||
|"module list" | |"module list" | ||
| | |Trillium | ||
|- | |- | ||
|ml | |ml | ||
|<modulename> | |<modulename> | ||
|"module load <modulename>" | |"module load <modulename>" | ||
| | |Trillium | ||
|- | |- | ||
|ml | |ml | ||
|X | |X | ||
|"module X" | |"module X" | ||
| | |Trillium | ||
|- | |- | ||
|} | |} | ||
= Related Topics = | = Related Topics = | ||
[ | [https://docs.alliancecan.ca/wiki/Running_jobs#Monitoring_jobs Monitoring jobs] | ||
<br> | <br> | ||
[[Niagara_Quickstart | Niagara Quickstart]] | [[Niagara_Quickstart | Niagara Quickstart]] | ||
<br> | <br> | ||
[ | [https://docs.alliancecan.ca/wiki/Running_jobs Slurm Scheduler] | ||
<br> | <br> | ||
[[FAQ#Monitoring_jobs_in_the_queue | Monitoring Jobs]] | [[FAQ#Monitoring_jobs_in_the_queue | Monitoring Jobs]] | ||
<br> | <br> | ||
[https://wiki.scinet.utoronto.ca/wiki/images/a/a0/TechTalkJobMonitoring.pdf Tech Talk on Monitoring Jobs] | [https://wiki.scinet.utoronto.ca/wiki/images/a/a0/TechTalkJobMonitoring.pdf Tech Talk on Monitoring Jobs] | ||
Revision as of 18:03, 9 November 2026
Below is list of handy command-line utilities written by SciNet to help manage your data and compute.
Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').
Storage
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| quota | Short overview of a user's storage usage. | Niagara | |
| diskUsage | -h to see all command options | Informs about the user and group file system usage. | Niagara, BGQ |
| topUserDirOver1000list | Lists your directories that have over 1,000 files | Niagara | |
| topUserDirOver1GBlist | Lists your directories that have over 1 GB of data | Niagara |
Jobs & Queues
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| qsum | most squeue arguments work | Lists jobs running or in the queue, grouped by user. | Niagara |
| llq2 | Detailed information on jobs that are actively running. | BGQ | |
| scinet niagara priority | Compute usage in the last 7 days, and how this affects your priority in the queue. | Niagara | |
| nodeperf | [userName] | Who is doing what on the current node? | Niagara |
| jobperf | <jobId | jobName> | Informs about the performance of all nodes of a given job. | Trillium |
| debugjob | [number of nodes] | Requests a time-limited interactive session of up to 4 dedicated nodes | Trillium |
Modules
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| ml | "module list" | Trillium | |
| ml | <modulename> | "module load <modulename>" | Trillium |
| ml | X | "module X" | Trillium |
Related Topics
Monitoring jobs
Niagara Quickstart
Slurm Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs