-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: c401-021 Local adapter: hfi1_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: c401-021 Local device: hfi1_0 -------------------------------------------------------------------------- terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc [c401-021:275784] *** Process received signal *** [c401-021:275784] Signal: Aborted (6) [c401-021:275784] Signal code: (-6) [c401-021:275784] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x43090)[0x2b433d2be090] [c401-021:275784] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x2b433d2be00b] [c401-021:275784] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x2b433d29d859] [c401-021:275784] [ 3] /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911)[0x2b43c7a45911] [c401-021:275784] [ 4] /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c)[0x2b43c7a5138c] [c401-021:275784] [ 5] /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7)[0x2b43c7a513f7] [c401-021:275784] [ 6] /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9)[0x2b43c7a516a9] [c401-021:275784] [ 7] /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e522)[0x2b43c7a45522] [c401-021:275784] [ 8] /usr/local/lib/liblammps.so(_ZNSt3mapINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEPFPN9LAMMPS_NS4PairEPNS6_6LAMMPSEESt4lessIS5_ESaISt4pairIKS5_SC_EEEixEOS5_+0x110)[0x2b445400aa60] [c401-021:275784] [ 9] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Force16create_factoriesEv+0x723)[0x2b44540067e3] [c401-021:275784] [10] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5ForceC2EPNS_6LAMMPSE+0x318)[0x2b4454008e98] [c401-021:275784] [11] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS6LAMMPS6createEv+0x18c)[0x2b445404fb2c] [c401-021:275784] [12] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS6LAMMPSC2EiPPcP19ompi_communicator_t+0x9c7)[0x2b4454072f87] [c401-021:275784] [13] /usr/local/lib/liblammps.so(lammps_open+0x5c)[0x2b445407b97c] [c401-021:275784] [14] /lib/x86_64-linux-gnu/libffi.so.7(+0x6ff5)[0x2b43c6fa7ff5] [c401-021:275784] [15] /lib/x86_64-linux-gnu/libffi.so.7(+0x640a)[0x2b43c6fa740a] [c401-021:275784] [16] /usr/lib/python3.8/lib-dynload/_ctypes.cpython-38-x86_64-linux-gnu.so(_ctypes_callproc+0x5b6)[0x2b43c6f8b306] [c401-021:275784] [17] /usr/lib/python3.8/lib-dynload/_ctypes.cpython-38-x86_64-linux-gnu.so(+0x13ae7)[0x2b43c6f8bae7] [c401-021:275784] [18] python3(_PyObject_MakeTpCall+0x296)[0x5f7056] [c401-021:275784] [19] python3(_PyEval_EvalFrameDefault+0x5dae)[0x57107e] [c401-021:275784] [20] python3(_PyEval_EvalCodeWithName+0x26a)[0x569cea] [c401-021:275784] [21] python3(_PyFunction_Vectorcall+0x393)[0x5f6a13] [c401-021:275784] [22] python3[0x59c757] [c401-021:275784] [23] python3(_PyObject_MakeTpCall+0x1ff)[0x5f6fbf] [c401-021:275784] [24] python3(_PyEval_EvalFrameDefault+0x62d2)[0x5715a2] [c401-021:275784] [25] python3(_PyFunction_Vectorcall+0x1b6)[0x5f6836] [c401-021:275784] [26] python3(_PyEval_EvalFrameDefault+0x90f)[0x56bbdf] [c401-021:275784] [27] python3(_PyEval_EvalCodeWithName+0x26a)[0x569cea] [c401-021:275784] [28] python3(_PyFunction_Vectorcall+0x393)[0x5f6a13] [c401-021:275784] [29] python3(_PyEval_EvalFrameDefault+0x90f)[0x56bbdf] [c401-021:275784] *** End of error message *** Aborted Command exited with non-zero status 134 {"realtime":28.94,"usertime":34.32,"systime":32.68,"memmax":137556,"memavg":0}