SciNet Command Line Utilities: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| (One intermediate revision by the same user not shown) | |||
| Line 16: | Line 16: | ||
| | | | ||
|Short overview of a user's storage usage. | |Short overview of a user's storage usage. | ||
| | |Trillium | ||
|- | |- | ||
|diskUsage | |diskUsage | ||
|''-h'' to see all command options | |''-h'' to see all command options | ||
|Informs about the user and group file system usage. | |Informs about the user and group file system usage. | ||
| | |Trillium | ||
|- | |- | ||
|topUserDirOver1000list | |topUserDirOver1000list | ||
| | | | ||
|Lists your directories that have over 1,000 files | |Lists your directories that have over 1,000 files | ||
| | |Trillium | ||
|- | |- | ||
|topUserDirOver1GBlist | |topUserDirOver1GBlist | ||
| | | | ||
|Lists your directories that have over 1 GB of data | |Lists your directories that have over 1 GB of data | ||
| | |Trillium | ||
|- | |- | ||
|} | |} | ||
| Line 45: | Line 45: | ||
|most squeue arguments work | |most squeue arguments work | ||
|Lists jobs running or in the queue, grouped by user. | |Lists jobs running or in the queue, grouped by user. | ||
| | |Trillium | ||
|- | |- | ||
| | |scinet-priority | ||
| | | | ||
|Compute usage in the last 7 days, and how this affects your priority in the queue. | |Compute usage in the last 7 days, and how this affects your priority in the queue. | ||
| | |Trillium | ||
|- | |- | ||
|nodeperf | |nodeperf | ||
|[''userName''] | |[''userName''] | ||
|Who is doing what on the current node? | |Who is doing what on the current node? | ||
| | |Trillium | ||
|- | |- | ||
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Monitoring_running_and_past_jobs jobperf] | |[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Monitoring_running_and_past_jobs jobperf] | ||
| Line 69: | Line 64: | ||
|[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Testing_and_debugging debugjob] | |[https://docs.alliancecan.ca/wiki/Trillium_Quickstart#Testing_and_debugging debugjob] | ||
|[''number of nodes''] | |[''number of nodes''] | ||
|Requests a time-limited interactive session of up to 4 dedicated nodes | |Requests a time-limited interactive session of up to 4 dedicated nodes. A <code>debugjob</code> session has X11 forwarding enabled, so graphical tools such as DDT can be started directly in the session. | ||
|Trillium | |Trillium | ||
|- | |- | ||
| Line 101: | Line 96: | ||
[https://docs.alliancecan.ca/wiki/Running_jobs#Monitoring_jobs Monitoring jobs] | [https://docs.alliancecan.ca/wiki/Running_jobs#Monitoring_jobs Monitoring jobs] | ||
<br> | <br> | ||
[[ | [[Trillium_Quickstart | Trillium Quickstart]] | ||
<br> | <br> | ||
[https://docs.alliancecan.ca/wiki/Running_jobs Slurm Scheduler] | [https://docs.alliancecan.ca/wiki/Running_jobs Slurm Scheduler] | ||
Latest revision as of 19:35, 9 November 2026
Below is list of handy command-line utilities written by SciNet to help manage your data and compute.
Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').
Storage
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| quota | Short overview of a user's storage usage. | Trillium | |
| diskUsage | -h to see all command options | Informs about the user and group file system usage. | Trillium |
| topUserDirOver1000list | Lists your directories that have over 1,000 files | Trillium | |
| topUserDirOver1GBlist | Lists your directories that have over 1 GB of data | Trillium |
Jobs & Queues
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| qsum | most squeue arguments work | Lists jobs running or in the queue, grouped by user. | Trillium |
| scinet-priority | Compute usage in the last 7 days, and how this affects your priority in the queue. | Trillium | |
| nodeperf | [userName] | Who is doing what on the current node? | Trillium |
| jobperf | <jobId | jobName> | Informs about the performance of all nodes of a given job. | Trillium |
| debugjob | [number of nodes] | Requests a time-limited interactive session of up to 4 dedicated nodes. A debugjob session has X11 forwarding enabled, so graphical tools such as DDT can be started directly in the session.
|
Trillium |
Modules
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| ml | "module list" | Trillium | |
| ml | <modulename> | "module load <modulename>" | Trillium |
| ml | X | "module X" | Trillium |
Related Topics
Monitoring jobs
Trillium Quickstart
Slurm Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs