I use dask_jobqueue to set up bespoke clusters within a jupyter lab notebook. I don’t use the ARE but a script to start the notebook, which seems to work fine with the new xp65 env.
My problem occurs when submitting the dask_jobqueue to set up a cluster, which I do like this:
from dask.distributed import Client,LocalCluster
from dask_jobqueue import PBSCluster
@access-nri folks, the path to python would be handy to have as an environment variable from the module, rather than needing to set the version number here explicitly
1 Like
clairecarouge
(Claire Carouge, ACCESS-NRI Land Modelling Team Lead)
3
@jpeter Can you please confirm @Scott 's answer solve your issue so we can show this topic as solved and we can close it?