-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: pd-compute-3-31 Local adapter: qib0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: pd-compute-3-31 Local device: qib0 -------------------------------------------------------------------------- [pd-compute-3-31.local:12116] [[64559,0],0] ORTE_ERROR_LOG: Out of resource in file util/show_help.c at line 501 [pd-compute-3-31.local:12116] [[64559,0],0] ORTE_ERROR_LOG: Data unpack had inadequate space in file util/show_help.c at line 513 -------------------------------------------------------------------------- MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD with errorcode 1. NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes. You may or may not see output from other processes, depending on exactly when Open MPI kills them. -------------------------------------------------------------------------- {"realtime":9.92,"usertime":0.56,"systime":1.35,"memmax":30116,"memavg":0}