This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
keller_and_evans_lab:cu_research_computing [2016/07/18 19:36] matthew_keller /* Controlling jobs */ |
keller_and_evans_lab:cu_research_computing [2019/11/08 12:06] borderr [Overview of best practices] |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | General documentation for using RC is [[[https:// | ||
+ | This document will mostly cover specific instructions for using RC in the Vrieze and Keller labs. We will try to update this, but RC is a bit of a moving target, so some of what is written below may now be outdated. | ||
- | ======= Logging in ======= | ||
+ | ======= Getting started ======= | ||
+ | |||
+ | General documentation for using RC is [[[https:// | ||
+ | Logging In <which you've already done> | ||
+ | Duo 2-factor Authentication <which you've already done> | ||
+ | Allocations | ||
+ | Node Types | ||
+ | Filesystems | ||
+ | The modules system | ||
+ | The PetaLibrary | ||
+ | Running applications with Jobs | ||
+ | Batch Jobs and Job Scripting | ||
+ | Interactive Jobs | ||
+ | Useful Slurm commands | ||
+ | Job Resource Information | ||
+ | squeue status and reason codes | ||
+ | Containerization on Summit | ||
+ | |||
+ | |||
+ | ======= Overview of best practices ======= | ||
+ | |||
+ | [[https:// | ||
+ | |||
+ | |||
+ | |||
+ | ======= Logging in ======= | ||
Put these settings in your '' | Put these settings in your '' | ||
Line 25: | Line 50: | ||
These settings should work from Mac and Linux. I'm not sure how to do the equivalent from Windows with Putty. On a Mac, those settings will cause X11 to start. If you don't want that to happen, then remove the '' | These settings should work from Mac and Linux. I'm not sure how to do the equivalent from Windows with Putty. On a Mac, those settings will cause X11 to start. If you don't want that to happen, then remove the '' | ||
+ | |||
+ | For those with access to summit (ONLY!), here are the steps to using it: | ||
+ | | ||
+ | #From a login node: | ||
+ | ssh -YC < | ||
+ | | ||
+ | #In your shell script: | ||
+ | No need to include -A UCB00000442 | ||
+ | | ||
+ | | ||
+ | #To run R: | ||
+ | ml load R | ||
+ | ml load gcc | ||
+ | R | ||
+ | |||
Line 63: | Line 103: | ||
======= Slurm ======= | ======= Slurm ======= | ||
+ | |||
+ | |||
+ | |||
+ | ====== Queues ====== | ||
+ | |||
+ | |||
+ | #if you want to run on ibg himem, you need to load the right module | ||
+ | module load slurm/ | ||
+ | |||
+ | #then in your shell script | ||
+ | #SBATCH --qos=blanca-ibg | ||
+ | |||
+ | #If you want to run on normal queues, then: | ||
+ | module load slurm/slurm | ||
+ | |||
+ | #then in your shell script, one of the below, depending on what queue you want | ||
+ | #SBATCH --qos=himem | ||
+ | #SBATCH --qos=crestone | ||
+ | #SBATCH --qos=janus | ||
+ | |||
+ | |||
Line 71: | Line 132: | ||
#To check our balance on our allocations and get the account id# | #To check our balance on our allocations and get the account id# | ||
sbank balance statement | sbank balance statement | ||
+ | sacctmgr -p show user < | ||
#To see how busy the nodes are. For seeing how many janus nodes are available, look for the | #To see how busy the nodes are. For seeing how many janus nodes are available, look for the | ||
Line 76: | Line 138: | ||
sinfo -l | sinfo -l | ||
- | squeue -u < | + | #checking on submissions for a user |
+ | squeue -u < | ||
squeue -u < | squeue -u < | ||
squeue -u < | squeue -u < | ||
- | showq-slurm -o -U -q <partition> #List job priority order for current user (you) in given partition | + | squeue |
- | scontrol show jobid -dd < | + | |
- | squeue -u mmkeller #To see your job statuses (R is for running, | + | #detailed information |
- | squeue -u mmkeller | + | squeue -q blanca-ibg -o %u, |
- | pbsnodes | + | |
+ | #current | ||
qstat -i #To see jobs that are currently pending (this is helpful for seeing if queue is overbooked) | qstat -i #To see jobs that are currently pending (this is helpful for seeing if queue is overbooked) | ||
qstat -r #To see jobs that are currently running | qstat -r #To see jobs that are currently running | ||
Line 90: | Line 154: | ||
qstat -r -n #To see running jobs, and which nodes they are running on | qstat -r -n #To see running jobs, and which nodes they are running on | ||
+ | #other commands | ||
+ | showq-slurm -o -U -q < | ||
+ | scontrol show jobid -dd < | ||
+ | pbsnodes -a #To look at the status of each node | ||
### Once job has completed, you can get additional information | ### Once job has completed, you can get additional information |