-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: c407-002 Local adapter: hfi1_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: c407-002 Local device: hfi1_0 -------------------------------------------------------------------------- c407-002.stampede2.tacc.utexas.edu.227210Out of memory for malloc at /build/libpsm2-GHG80G/libpsm2-11.2.86/ptl_ips/ips_scb.c:95 Command exited with non-zero status 255 {"realtime":23.68,"usertime":25.78,"systime":33.54,"memmax":133484,"memavg":0}