-------------------------------------------------------------------------- By default, for Open MPI 4.0 and later, infiniband ports on a device are not used by default. The intent is to use UCX for these devices. You can override this policy by setting the btl_openib_allow_ib MCA parameter to true. Local host: c401-021 Local adapter: hfi1_0 Local port: 1 -------------------------------------------------------------------------- -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device. Local host: c401-021 Local device: hfi1_0 -------------------------------------------------------------------------- terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc [c401-021:273482] *** Process received signal *** [c401-021:273482] Signal: Aborted (6) [c401-021:273482] Signal code: (-6) [c401-021:273482] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x43090)[0x2b770bf32090] [c401-021:273482] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x2b770bf3200b] [c401-021:273482] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x2b770bf11859] [c401-021:273482] [ 3] /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911)[0x2b77966b9911] [c401-021:273482] [ 4] /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c)[0x2b77966c538c] [c401-021:273482] [ 5] /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa3f7)[0x2b77966c53f7] [c401-021:273482] [ 6] /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa6a9)[0x2b77966c56a9] [c401-021:273482] [ 7] /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e522)[0x2b77966b9522] [c401-021:273482] [ 8] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS15TabularFunction10reset_sizeEi+0xab)[0x2b7822e20fab] [c401-021:273482] [ 9] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS15TabularFunction10set_valuesEiddPd+0x24)[0x2b7822e21654] [c401-021:273482] [10] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS7PairBOP10read_tableEPc+0xe87)[0x2b7822fc2197] [c401-021:273482] [11] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS7PairBOP5coeffEiPPc+0x319)[0x2b7822fc33d9] [c401-021:273482] [12] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input10pair_coeffEv+0xde)[0x2b7822cb4d0e] [c401-021:273482] [13] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input15execute_commandEv+0xe00)[0x2b7822cba300] [c401-021:273482] [14] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input3oneERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xa9)[0x2b7822cbacd9] [c401-021:273482] [15] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS15KimInteractions8do_setupEiPPc+0xf8b)[0x2b7822e7ad5b] [c401-021:273482] [16] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS15KimInteractions7commandEiPPc+0x38)[0x2b7822e7ba78] [c401-021:273482] [17] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS10KimCommand7commandEiPPc+0x3ee)[0x2b7822e7283e] [c401-021:273482] [18] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input15execute_commandEv+0xc38)[0x2b7822cba138] [c401-021:273482] [19] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input3oneERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xa9)[0x2b7822cbacd9] [c401-021:273482] [20] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS10Deprecated7commandEiPPc+0x4fb)[0x2b7822b50a0b] [c401-021:273482] [21] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input15execute_commandEv+0xc38)[0x2b7822cba138] [c401-021:273482] [22] /usr/local/lib/liblammps.so(_ZN9LAMMPS_NS5Input3oneERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xa9)[0x2b7822cbacd9] [c401-021:273482] [23] /usr/local/lib/liblammps.so(lammps_command+0x92)[0x2b7822cf8fe2] [c401-021:273482] [24] /lib/x86_64-linux-gnu/libffi.so.7(+0x6ff5)[0x2b7795c1bff5] [c401-021:273482] [25] /lib/x86_64-linux-gnu/libffi.so.7(+0x640a)[0x2b7795c1b40a] [c401-021:273482] [26] /usr/lib/python3.8/lib-dynload/_ctypes.cpython-38-x86_64-linux-gnu.so(_ctypes_callproc+0x5b6)[0x2b7795bff306] [c401-021:273482] [27] /usr/lib/python3.8/lib-dynload/_ctypes.cpython-38-x86_64-linux-gnu.so(+0x13ae7)[0x2b7795bffae7] [c401-021:273482] [28] python3(_PyObject_MakeTpCall+0x296)[0x5f7056] [c401-021:273482] [29] python3(_PyEval_EvalFrameDefault+0x5dae)[0x57107e] [c401-021:273482] *** End of error message *** Aborted Command exited with non-zero status 134 {"realtime":31.32,"usertime":45.68,"systime":81.94,"memmax":177376,"memavg":0}