Bash basics
Essential command-line skills for working on DAIC.
2 minute read
These tutorials take you from first login to running GPU workloads. Each tutorial builds on the previous one, so we recommend following them in order.
flowchart TB
subgraph local["YOUR COMPUTER"]
L1["Write code, prepare data"]
end
subgraph login["LOGIN NODE - daic01.hpc.tudelft.nl"]
L2["Prepare scripts"]
L3["Submit jobs (sbatch)"]
L4["Monitor jobs (squeue)"]
L5["Transfer data (scp, rsync)"]
L6["DO NOT run computations here!"]
end
subgraph compute["COMPUTE NODES - gpu01...gpu45"]
C1["Run training scripts"]
C2["Access GPUs (L40, A40, RTX Pro 6000)"]
C3["Process large datasets"]
end
subgraph storage["STORAGE"]
S1["/home - 5 MB, config only"]
S2["~/linuxhome - ~30 GB, personal files"]
S3["staff-umbrella - Project data"]
end
local -->|SSH| login
login -->|Slurm| compute
compute --> storage| Tutorial | Time | What you’ll learn |
|---|---|---|
| Bash Basics | 30 min | Navigate the filesystem, manage files, write scripts |
| Slurm Basics | 45 min | Submit jobs, request GPUs, monitor your work |
| Apptainer | 45 min | Package your environment in containers |
| Vim | 30 min | Edit files efficiently on the cluster |
I just got access to DAIC → Start with Bash Basics, then Slurm Basics
kinit after connecting to access network storage (linuxhome, project storage). See Storage for details.I know Linux but not clusters → Start with Slurm Basics
My code needs specific packages/versions → Read Apptainer to containerize your environment
I need to edit files on the cluster → Learn Vim for efficient editing over SSH
After completing these tutorials, you’ll be able to:
man command or command --helpEach tutorial follows the same structure:
Now let’s get started with Bash Basics.
Essential command-line skills for working on DAIC.
Understanding the job scheduler on DAIC.
Using Apptainer to containerize environments.
Learn the Vim text editor for efficient file editing on DAIC.
Managing Python packages and environments on DAIC.
Scale deep learning across multiple GPUs on DAIC.