-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: c404-063 Local adapter: hfi1_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: c404-063 Local device: hfi1_0 -------------------------------------------------------------------------- c404-063.stampede2.tacc.utexas.edu.17485Out of memory for malloc at /build/libpsm2-GHG80G/libpsm2-11.2.86/ptl_ips/ips_scb.c:121 Command exited with non-zero status 255 {"realtime":27.30,"usertime":30.69,"systime":37.46,"memmax":205684,"memavg":0}