Confused on running a pre-industrial test of ACCESS-ESM1.5 with payu

[Aidan (Aidan Heerdegen, ACCESS-NRI Release Team Lead)]

@paulleopardi has also been running into difficulties with the ACCESS-ESM payu configs

"Run ACCESS-ESM" fails with error code 139

As a step towards creating a Spack build for ACCESS-ESM1.5, I have been trying to use the “Run ACCESS-ESM1.5” instructions. I have tried to run ESM1.5 according to these instructions at least 4 times, and each time I see error code 139. Looking at /g/data/tm70/pcl851/src/penguian/esm-pre-industrial/access.err I see that there are MPI failures in CICE4.1, with output like: [gadi-cpu-clx-2636:39774:0:39774] ib_mlx5_log.c:168 Remote OP on mlx5_0:1/IB (synd 0x14 vend 0x89 hw_synd 0/0) [gadi-cpu-c…

The intention is for ACCESS-NRI to release supported versions of ACCESS-ESM1.5 in March, which will require any outstanding issues with these configurations be fixed in the versions we release.