...
Relaxed ordering API is used by default on perftest since MLNX_OFED version 5.1-0.6.6.0
UCX (v1.9 and above) has a parameter to force using relaxed ordering: UCX_IB_PCI_RELAXED_ORDERING
Code Block # Enable relaxed ordering for PCIe transactions to improve performance on some systems. # # syntax: <on|off|auto> # UCX_IB_PCI_RELAXED_ORDERING=auto
In case you have Nvidia GPUs, make sure to use NCCL 2.8 or later.
...