-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: c012 Local adapter: mlx5_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There is at least non-excluded one OpenFabrics device found, but there are no active ports detected (or Open MPI was unable to use them). This is most certainly not what you wanted. Check your cables, subnet manager configuration, etc. The openib BTL will be ignored for this job. Local host: c012 -------------------------------------------------------------------------- [c012:379103] *** Process received signal *** [c012:379103] Signal: Segmentation fault (11) [c012:379103] Signal code: Invalid permissions (2) [c012:379103] Failing at address: 0xfe4010 [c012:379103] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x43090)[0x7f474c1d9090] [c012:379103] [ 1] [0xfe4010] [c012:379103] *** End of error message *** Segmentation fault (core dumped) Command exited with non-zero status 139 {"realtime":5.47,"usertime":1.21,"systime":5.75,"memmax":122496,"memavg":0}