RuntimeError: Job process returned error code 255

Traceback (most recent call last):
  File "/usr/local/bin/run_openkim_job.py", line 546, in <module>
    execute_in_place(runner, runner_driver, subject, subject_driver, env)
  File "/usr/local/bin/run_openkim_job.py", line 396, in execute_in_place
    raise RuntimeError(f"Job process returned error code {retcode}")
RuntimeError: Job process returned error code 255

output/pipeline.stdout:
-----------------------
Model Extended KIM ID = 

output/pipeline.stderr:
-----------------------
By default, for Open MPI 4.0 and later, infiniband ports on a deviceare not used by default.  The intent is to use UCX for these devices.You can override this policy by setting the btl_openib_allow_ib MCA parameterto true.  Local host:              c407-082  Local adapter:           hfi1_0  Local port:              1----------------------------------------------------------------------------------------------------------------------------------------------------WARNING: There was an error initializing an OpenFabrics device.  Local host:   c407-082  Local device: hfi1_0--------------------------------------------------------------------------c407-082.stampede2.tacc.utexas.edu.85035Out of memory for malloc at /build/libpsm2-GHG80G/libpsm2-11.2.86/psm_mpool.c:498Command exited with non-zero status 255{"realtime":9.25,"usertime":4.46,"systime":13.58,"memmax":94640,"memavg":0}

output/kim.log:
---------------
2022-05-23:19:04:22CDT * 0 * information * 0x2461060 * KIM_LogImplementation.cpp:110 * Log object created.  Default verbosity level is 'information'.2022-05-23:19:04:22CDT * 1 * information * 0x2461060 * KIM_LogImplementation.cpp:120 * Log object destroyed.2022-05-23:19:04:22CDT * 0 * information * 0x24cbd90 * KIM_LogImplementation.cpp:110 * Log object created.  Default verbosity level is 'information'.2022-05-23:19:04:22CDT * 0 * information * 0x23b3220 * KIM_LogImplementation.cpp:110 * Log object created.  Default verbosity level is 'information'.2022-05-23:19:04:22CDT * 1 * information * 0x23b3220 * KIM_LogImplementation.cpp:242 * Log object renamed.  ID changed to '0x24cbd90_Collections'.2022-05-23:19:04:22CDT * 2 * information * 0x24cbd90_Collections * KIM_LogImplementation.cpp:246 * Log object renamed.  ID changed from '0x23b3220'.2022-05-23:19:04:22CDT * 3 * information * 0x24cbd90_Collections * KIM_LogImplementation.cpp:120 * Log object destroyed.2022-05-23:19:04:22CDT * 1 * information * 0x24cbd90 * KIM_LogImplementation.cpp:120 * Log object destroyed.2022-05-23:19:04:22CDT * 0 * information * 0x23b0d50 * KIM_LogImplementation.cpp:110 * Log object created.  Default verbosity level is 'information'.2022-05-23:19:04:22CDT * 1 * information * 0x23b0d50 * KIM_LogImplementation.cpp:120 * Log object destroyed.2022-05-23:19:04:22CDT * 0 * information * 0x23b0d50 * KIM_LogImplementation.cpp:110 * Log object created.  Default verbosity level is 'information'.2022-05-23:19:04:22CDT * 0 * information * 0x23b3220 * KIM_LogImplementation.cpp:110 * Log object created.  Default verbosity level is 'information'.2022-05-23:19:04:22CDT * 1 * information * 0x23b3220 * KIM_LogImplementation.cpp:242 * Log object renamed.  ID changed to '0x23b0d50_Collections'.2022-05-23:19:04:22CDT * 2 * information * 0x23b0d50_Collections * KIM_LogImplementation.cpp:246 * Log object renamed.  ID changed from '0x23b3220'.2022-05-23:19:04:22CDT * 3 * information * 0x23b0d50_Collections * KIM_LogImplementation.cpp:120 * Log object destroyed.2022-05-23:19:04:22CDT * 1 * information * 0x23b0d50 * KIM_LogImplementation.cpp:120 * Log object destroyed.