I’m running some perturbation experiments with the pre-industrial control in ACCESS-ESM1-5 but since last week a number of them have started crashing during the run and I don’t know why. I get the error message: “payu: Model exited with error code 139; aborting.”. I can see this has been mentioned …

There’s also a version updated for python3 available in the pythonlib/umfile_utils/access_cm2 module. It differs in requiring a seed as an argument which makes it reproducible module use ~access/modules module load pythonlib/umfile_utils/access_cm2 perturbIC.py -h usage: perturbIC.py [-h] [-a AMP…

I think it crashed in the UM but not sure which atmosphere logs give more details. This is a snippet from the access.err file. [gadi-cpu-clx-0429:974522:0:974522] Caught signal 11 (Segmentation fault: Sent by the kernel at address (nil)) -------------------------------------------------------------…

I know it might sound unlikely, but have you checked if the error occurs again if you simply do a sweep and re-run it? ACCESS-ESM1.5 has a habit of crashing for unknown reasons, and I find it’s best to first check if the error occurs twice. (Sometimes it just runs fine the second time you try…)

Yep, I’ve tried that. If I recall correctly, it’s crashed at the exact same time step. I can try again now to confirm.

Twice is enough to confirm. Thanks Hannah. Dr David Hutchinson (he/him) ARC DECRA fellow in paleoclimate modelling Climate Change Research Centre, UNSW Sydney david.hutchinson@unsw.edu.au

yep, confirming it’s crashed at the same spot.

Have you tried perturbing the model using /projects/access/apps/pythonlib/umfile_utils/perturbIC.py. I encountered this error, and I’m not sure why, but perturbing sometimes does the trick.

[image] hrsdawson: 0000000000989C5D bi_linear_h_ 613 bi_linear_h.f90 A crash in the bi_linear_h routine is often the result of the model becoming unstable and if so can fixed with a small perturbation of the atmosphere as @HIMADRI_SAINI suggested. See also http://clima…

Thanks for the suggestion @HIMADRI_SAINI . I’ve not tried this. I’ll give it a go.

@Aidan @HIMADRI_SAINI sorry, what’s the syntax for running this? I’ve just tried like so (from the CLEX instructions): /projects/access/apps/pythonlib/umfile_utils/perturbIC.py restart_dump.astart and I get the following message: File "/projects/access/apps/pythonlib/umfile_utils/perturbIC.py", …

Hi Hannah, This seems like a python2 / python3 problem. The perturbIC.py in the example is using the old print method, where print is done without brackets. A couple of ways to deal with this (not sure what Himadri did…): explicitly call python2 interpreter copy the script to a local directory an…

Need help finding and interpreting ACCESS-ESM1-5 errors

Earth System

Aidan (Aidan Heerdegen, ACCESS-NRI Release Team Lead) 20 August 2024 09:41 17

This was covered in a previous topic

Topic		Replies	Views
How to preserve reproducibility when applying perturbations in the event of a numerical instability crash Atmosphere python , documentation , payu , knowledge-base , needs-review	29	1077	19 January 2026
ACCESS ESM1.6 experiment segfault Earth System Model help	11	161	15 September 2026
Restart problem (atmosphere) Earth System help , payu , restart , access-esm	22	801	24 March 2025
"Run ACCESS-ESM" fails with error code 139 Earth System Model help , mpi , access-esm , cice4	17	663	8 February 2024
Exp. crashing Earth System Model	1	63	12 June 2025

Need help finding and interpreting ACCESS-ESM1-5 errors

Related topics