Thanks for clearing that up.
After doing a
pip install . in the new cloned directory (
/$MYSOFTWARE/payu_new), the new libraries were setup in the '$MYSOFTWARE/setonix/python/lib/python3.10/site-packages/payu
directory and binary file in the $MYSOFTWARE/conda_install/bin/` directory (I think that’s what happened at least).
I’ve modified a few things now to get the
payu sweep working, but now I’m stuck on trying to get
payu-run working. The slurm batch flags were causing errors, e.g., it didn’t recognise
cluster=c4, but I think we had the same issues with the old version so I just copied what I had under the
python3.9/site-packages/payu/schedulers/slurm.py to the
python3.10/site-packages/payu/schedulers/slurm.py file. That fixed the job-submission issue.
Now, I’m stuck on the environment modules (something to do with
env.py). The error in my
slurm.out file is:
payu: Found modules in /opt/cray/pe/lmod/lmod
Traceback (most recent call last):
File "/software/projects/pawsey0410/jreilly/conda_install/bin/payu-run", line 33, in <module>
sys.exit(load_entry_point('payu==1.0.19', 'console_scripts', 'payu-run')())
File "/software/projects/pawsey0410/jreilly/setonix/python/lib/python3.10/site-packages/payu/subcommands/run_cmd.py", line 132, in runscript
File "/software/projects/pawsey0410/jreilly/setonix/python/lib/python3.10/site-packages/payu/experiment.py", line 457, in run
File "/software/projects/pawsey0410/jreilly/setonix/python/lib/python3.10/site-packages/payu/experiment.py", line 246, in load_modules
File "/software/projects/pawsey0410/jreilly/setonix/python/lib/python3.10/site-packages/payu/envmod.py", line 90, in module
envs, _ = subprocess.Popen(shlex.split(cmd),
File "/software/projects/pawsey0410/jreilly/conda_install/lib/python3.10/subprocess.py", line 971, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/software/projects/pawsey0410/jreilly/conda_install/lib/python3.10/subprocess.py", line 1847, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/opt/cray/pe/lmod/lmod/bin/modulecmd'
It’s right, in that the file/directory doesn’t exist. There’s no
bin directory on the path
Any suggestions here? Thanks for the help!