-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: c412-001 Local adapter: hfi1_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: c412-001 Local device: hfi1_0 -------------------------------------------------------------------------- [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_pml_monitoring: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_monitoring.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_pml_ob1: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_ob1.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_vprotocol_pessimist: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_vprotocol_pessimist.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_mtl_ofi: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_ofi.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_mtl_psm: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_mtl_psm2: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm2.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_coll_basic: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_basic.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_coll_inter: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_inter.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_coll_libnbc: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_libnbc.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_coll_monitoring: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_monitoring.so: failed to map segment from shared object (ignored) [c412-001.stampede2.tacc.utexas.edu:135159] mca_base_component_repository_open: unable to open mca_coll_self: /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_self.so: failed to map segment from shared object (ignored) -------------------------------------------------------------------------- No components were able to be opened in the pml framework. This typically means that either no components of this type were installed, or none of the installed components can be loaded. Sometimes this means that shared libraries required by these components are unable to be found/loaded. Host: c412-001 Framework: pml -------------------------------------------------------------------------- [c412-001.stampede2.tacc.utexas.edu:135159] PML ob1 cannot be selected Command exited with non-zero status 1 {"realtime":21.03,"usertime":26.33,"systime":31.76,"memmax":114936,"memavg":0}