Overview of specialty machines

The specialty machines controlled by the Slurm workload manager include:

Head node

  • hostname rsubmit.math.private.uwaterloo.ca
  • head node is for job submission and short tasks only, e.g. code compilation, not for executing jobs
# Nodes 1
Node names slurm-pr2-01 (alias rsubmit.math.private)
CPU model (2 per node) Xeon(R) CPU E5-2620 @ 2.00GHz (Sandy Bridge EP)
# Cores per node 12
Threads per core 2
System Memory per node 64 GB
head node hardware specification

CPU clusters

This resource is intended for medium-sized parallel jobs (OpenMP or MPI) and for developing and testing parallel code. Large jobs are better served by the Digital Research Alliance of Canada (formerly Compute Canada).

  • hpc-pr3 cluster
    #Nodes 8
    Node names hpc-pr3-01 to hpc-pr3-08
    CPU model (2 per node) Xeon(R) Gold 6326 2.9 GHz (Ice Lake)
    #Cores per node 32
    Threads per core 2
    System Memory per node 128 GB
    compute node hardware specifications

The Hagrid cluster is for members of the Bauch Lab.

  • hagrid cluster
    #Nodes 8 compute, 1 storage
    Node names hagrid01 to hagrid08, hagrid-storage
    CPU model (2 per node) Xeon(R) Silver 4114 CPU @ 2.20GHz
    #Cores per node 10
    Threads per core 1
    System Memory per node 187 GB
    hardware specificationsÌý

GPU servers

This resource is intended for GPU-specific computing on a small scale. Medium and large-scale GPU jobs are better served by SHARCNET.

Node Name CPU model # Cores System Memory GPU type # GPUs GPU memory per device
gpu-pr1-01 2x Intel Xeon E5-2680v4 2.4 GHz (Broadwell) 28 128 GB NVIDIA Tesla P100 4 16 GB
gpu-pr1-02 2x AMD EPYC 7542 2.9 GHz 64 1024 GB NVIDIA Ampere A100 PCI 8 four with 40 GB, four with 80 GB
gpu-pr1-03 2x Intel Xeon 8480+ 2.0 GHz (Sapphire Rapids) 56 1024 GB NVIDIA Hopper H100 SXM 4 80 GB
gpu-pr1-04 1x AMD EPYC 9634 2.25 GHz 84 768 GB

NVIDIA Ada Lovelace L40S

3 48 GB
gpu-pr1-05 2x Intel Xeon Gold 6548Y+ (Emerald Rapids) 64 512 GB NVIDIA Ada Lovelace L40S 2 48 GB
gpu-pr1-06 2x Intel Xeon Gold 6548Y+ (Emerald Rapids) 64 512 GB NVIDIA H100 NVL 2 94 GB