...

ar_sl_mask 0xFFFA # A=0x1010 SL1, SL3 enabled with AR

UCX Support

FW 12.29.0356 added support for ooo_sl_mask per vport that’s now used by UCX.

With that, UCX has a way to request AR support. It could be done using UCX_IB_AR_ENABLE={ yes | no | try}. The default value is “try”.

• UCX_IB_AR_ENABLE=yes strictly selects SL with AR, if there no SLs with AR, it fails UCX

• UCX_IB_AR_ENABLE=try selects SL with AR, if there no SLs with AR, it selects the first available (or specified by UCX_IB_SL=<sl>)

• UCX_IB_AR_ENABLE=no strictly selects SL without AR, if there no SLs without AR, it fails UCX

Specific SL still could be specified by user through UCX_IB_SL=[0..15]

If the UCX_IB_AR_ENABLE=yes/no was asked on old FW, it fails UCX since UCX is not able to detect ooo_sl_mask.

The feature is part of the UCX v1.10 release.

Validation

smparquery

Check that AR is enabled on a switch (using the switch lid), us the smparquery (supported on OFED 5.x)

...

Note that the switch SL map is always enabled for all SLs. The SL mask configuration is done on the adapter.

Get the SL Mask Configuration on the hosts

ibdiagnet gathers the SL Mask on the adapters. look for the OOOSLMASK column in the ibdiagnet2.db_csv output. In this example, SL mask is set to 0xFFFA.

cat /var/tmp/ibdiagnet2/ibdiagnet2.db_csv | grep -A 1 OOOSLMask
NodeGuid,PortGuid,PortNum, ... ,OOOSLMask,CapMsk2,FECActv,RetransActv
0x248a0703009c01e6,0x248a0703009c01e6,1, ... ,0xfffa,2,3,0
--
NodeGuid,PortGuid,PortNum, ... , ,HDRFECModeEnabled,OOOSLMask
0x248a0703009c01e6,0x248a0703009c01e6,1,,0x0000,0xfffa

ibdiagnet

Refer to the example here: .