Getting Started with HPC-AI AC Clusters

Owned by Ophir Maor
Last updated: Apr 03, 2024 by David Jaekyu Cho
4 min read

This post will help you get started with clusters on HPCAC-AI cluster center. We are using helios cluster in this document.

Once you got your username, login to the clusters:

$ ssh <userid>@gw.hpcadvisorycouncil.com

 

To check available helios nodes using slurm commands.

$ sinfo -p helios PARTITION AVAIL TIMELIMIT NODES STATE NODELIST helios up infinite 4 alloc helios[011-012],heliosbf2a[011-012] helios up infinite 76 idle helios[001-010,013-032],heliosbf2a[001-012,013-016] $squeue -p helios JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) 494552 helios interact ... R 25:51 4 helios[011-012],heliosbf2a[011-012]

To allocate nodes interactively

Please avoid allocating nodes interactively if possible or set the time limit short because we are sharing the resources with multiple users.

# CPU nodes only $ salloc -N 2 -p helios --time=1:00:00 -w helios001,helios002 # CPU and BlueField nodes $ salloc -N 4 -p helios --time=1:00:00 -w helios00[1-2],heliosbf2a00[1-2]

To submit a batch job

Note: helios cluster has NVIDIA BlueField-2 cards with ARM processors on it. Those adapters can also be seen in slurm as “nodes” marked with heliosbf2a0[01-16], while the hosts are named helios[001-032].

Storage

Basic environment

Based on the order of module load/unload, extra module are present to the user. Remember to load compilers first.

  • Loading HPC-X with Intel compiler 2022.

  • Loading HPC-X with GNU compiler

Running OSU latency using HPC-X