Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For more information, please visit https://neko.cfd.

Note: The page may be changed until the competition stats, maybe sure to follow up until the opening ceremony.

Neko presentation to the teams:

...

To build Neko, you will need a Fortran compiler supporting the Fortran-08 standard, autotools, pkg-config, a working MPI installation supporting the Fortran 2008 bindings (mpi_f08), BLAS/LAPACK and JSON-Fortran. Detailed installation instructions can be found in the Neko manual.

Note: For the in-person event, a Fortran compiler supporting the entire Fortran 2008 standard is required; compilers with partial support are not supported. It is not allowed to modify src/common/signal.f90, with the exception of provided patches located in patches/.

Sample build script:

Build json-fortran:

Code Block
git clone --depth=1 https://github.com/jacobwilliams/json-fortran.git
cd json-fortran && mkdir b && cd b
cmake -DCMAKE_INSTALL_PREFIX=/path/to/installation -DUSE_GNU_INSTALL_CONVENTION=ON ..
make install

Build Neko:

Code Block
#!/bin/bash
# Load Intel Compilers and MPI libraries.
export MPIFC=mpif90mpiifort
export CC=mpiccmpiicc
export FC=$MPIFC
export PKG_CONFIG_PATH=/path/to/jsonfortran/liblib64/pkgconfig:${PKG_CONFIG_PATH}

./regen.sh
./configure --prefix=<path>
make
make install

...

Sample run script:

Code Block
# Untar tgv.zip
cd tgv
# Load Intel Compilers and MPI libraries.
export MPIFC=mpiifort
export FC=$MPIFC

export LD_LIBRARY_PATH=<path>/json-fortran/lib64:$LD_LIBRARY_PATH
<path>/neko/bin/makeneko  ${TEST}.f90
mpirun -np <NPROC> -genv USE_UCX=1 -genv UCX_NET_DEVICES mlx5_0:1 -genv FI_PROVIDER=mlx ./neko tgv_Re1600.case

Sample output:

Code Block
    _  __  ____  __ __  ____
   / |/ / / __/ / //_/ / __ \
  /    / / _/  / ,<   / /_/ /
 /_/|_/ /___/ /_/|_|  \____/

 (version: 0.8.0-rc1)
 (build: 2024-04-10 on x86_64-pc-linux-gnu using cray)


 -------Job Information--------
 Start time: 10:41 / 2024-04-10
 Running on: 256 MPI ranks
 CPU type  : AMD EPYC 7742 64-Core Processor
 Bcknd type: CPU
 Real type : double precision

 -------------Case-------------
 Reading case file tgv_Re1600.case

   -------------Mesh-------------
   Reading a binary Neko file 32768.nmsh
...

   -----Material properties------
   Read non-dimensional values:
...
   -----Starting simulation------
...


  -----Starting simulation------
   T  : [  0.0000000E+00,  0.2000000E+01)
   dt :    0.5000000E-03
...
   ----------------------------------------------------------------
   t =   0.0000000E+00                                  [   0.00% ]
   ----------------------------------------------------------------
   Time-step:      1
    CFL:  0.3970812E-01 dt:  0.5000000E-03

...

   ----------------------------------------------------------------
   t =   0.2000000E2683500E+01                                  [  10026.00%84% ]
   ----------------------------------------------------------------
   Time-step:   40015368
    CFL:  0.4271451E4915199E-01 dt:  0.5000000E-03
...
       --------Writer output----Fluid-------------
       Projection Pressure
       Proj. vec.:   Orig. residual:
                 2     0.4020491E-05
       Pressure
       Iterations:   Start residual:     Final residual:
                 1     0.2061696E-06       0.8489571E-07
       X-Velocity
        File name: field.fld
       Output number:     10
       Writing at time:   2.000500 OutputIterations:   Start residual:     Final residual:
                 2     0.8948043E-03       0.1355196E-08
       Y-Velocity
       Iterations:   Start residual:     Final residual:
                 2     0.8948043E-03       0.1355196E-08
       Z-Velocity
       Iterations:   Start residual:     Final residual:
                 2     0.8240080E-03       0.1270342E-08
       Elapsed time (s):  0.8980917E+03 Step 2.501281time:  0.1604918E+00

       --------Postprocessing--------
   ! stop at job limit >>>
   ! saving checkpoint >>>
   Normal end.

GPU support:

To compile Neko with GPU support, please follow either the instructions in the manual (Compiling Neko for NVIDIA GPUs and Compiling Neko for AMD GPUs).

Note: A Neko installation can only support one backend. Thus, to run both CPU and GPU experiments, two different builds and installations are necessary.

...

Task &

...

Submission

These tasks aim to solve The aim of this task is to compute as many time steps as possible for the given flow case as fast as possible (time to solution); this is reported as the Elapsed time in the log files and includes everything from solving the equations to performing I/Owithin a time limit of maximum 15 minutes.

  1. Run Neko with the given input

    View file
    nametgv.zip
    (neko tgv_Re1600.case) on CPU nodes and submit the results to the team’s folder either CPUs or GPUs.

  2. Submit your best result (standard output)
    Note: the small input is for you to play around.Run Neko with the given input on a couple of GPUs (the memory requirements of the case is roughly 2 A100 or 4 V100) and submit the results to the team’s folder (see instructions for GPU support above, and the additional information provided with the input file) . Do not submit binary output files nor multiple results.

Note: You are allowed to experiment with different linear solvers in Neko (see the manual) to achieve the fastest runtime. However, all of them are not guaranteed to work for the given case or support all hardware backends in Neko. Furthermore, it is allowed to experiment with different configuration options when building Neko, e.g., enabling device-aware MPI. However, it is not allowed to use single precision, changing the time-step size or any other parameters related to the case.