Aspire-1 (NSCC) Cluster Access for ISC21 SCC

ISC21 Committee will supply your team captain the username and password required to connect to Aspire cluster of National Supercomputing Centre Singapore (NSCC) - aspire.nscc.sg

You will need to follow the guidelines given here to connect to VPN and connect to the cluster login nodes, see https://help.nscc.sg/wp-content/uploads/Getting-Started-ASPIRE-1-v1.08-final.pdf

Get to know PBS scheduler, see https://help.nscc.sg/pbspro-quickstartguide/ and online. If you are familier with Slurm, see here comparison.

Once connected, create a sample file and submit a job. Here is a basic example to get the CPU type and Network adapter on the node.

$ cat submit.pbs

#!/bin/bash
#PBS -q normal
#PBS -l select=1:ncpus=1:mem=100M
#PBS -l walltime=00:10:00
#PBS -P <your project ID>
#PBS -o outputfile.o
#PBS -e errorfile.e

echo Checking The CPU and Network
echo lscpu
lscpu
echo lspci | grep Mel
lspci | grep Mell

Submit the job

$ qsub submit.pbs
9954607.wlm01

Check the output:

$ cat outputfile.o
Checking The CPU and Network
lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                24
On-line CPU(s) list:   0-23
Thread(s) per core:    1
Core(s) per socket:    12
Socket(s):             2
NUMA node(s):          4
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 63
Model name:            Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz
Stepping:              2
CPU MHz:               1200.000
BogoMIPS:              5187.61
Virtualization:        VT-x
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              15360K
NUMA node0 CPU(s):     0-5
NUMA node1 CPU(s):     6-11
NUMA node2 CPU(s):     12-17
NUMA node3 CPU(s):     18-23

lspci | grep Mel
81:00.0 Infiniband controller: Mellanox Technologies MT27700 Family [ConnectX-4]
======================================================================================

        Resource Usage on 2020-04-25 10:08:30.888043:

 JobId: 9954616.wlm01
 Project: 21120227
 Exit Status: 0
 NCPUs Requested: 1         NCPUs Used: 1
                CPU Time Used: 00:00:00
 Memory Requested: 100mb               Memory Used: 0kb
                Vmem Used: 0kb
 Walltime requested: 00:10:00           Walltime Used: 00:00:00

 Execution Nodes Used: (std1708:ncpus=1:mem=102400kb)

 ======================================================================================

For DGX access, follow this guide:

https://help.nscc.sg/wp-content/uploads/AI_System_QuickStart.pdf

DGX HW description: