Description of request:
hh5 contained a dask-optimser module that took care of a bunch of things that made PBSCluster much easier to use in ARE and possibly more performant - could this please be added to the xp65 modules?
Environment:
ARE
Personal env built on xp65 conda following Building custom python environments on top of conda/analysis3 — CLEX CMS Blog
What executed:
When using hh5 as my conda base to launch ARE jobs:
udunits/2.2.26 conda/analysis3-24.07 dask-optimiser
When using xp65 as conda base for ARE:
udunits/2.2.26 conda/analysis3
In a jupyter notebook, with hh5 I do not require the following code block as it’s part of the dask-optimiser module:
os.environ\[‘DASK_JOBQUEUE__PBS__INTERFACE’\]= ‘ib0’
os.environ\[‘DASK_JOBQUEUE__PBS__JOB_EXTRA_DIRECTIVES’\] = f’\[“-lstorage=‘+os.environ\[‘PBS_NCI_STORAGE’\]+’”,\]’
os.environ\[‘DASK_JOBQUEUE__PBS__JOB_DIRECTIVES_SKIP’\] = ‘\[“select”,\]’
and consequently
job_script_prologue = \[
#‘module use /g/data/hh5/public/modules’,
#‘module load conda udunits/2.2.26 netcdf/4.9.2 dask-optimiser’,
‘module use /g/data/xp65/public/modules’,
‘module load conda/analysis3-25.08 udunits/2.2.26 netcdf/4.9.2’,
f"source {os.path.join(os.environ\[‘VIRTUAL_ENV’\], ‘bin/activate’)}"\]
The dask-optimiser module does nice magic like after starting a PBSCluster client, showing the client gives a clickable link to the dask dashboard rather than just /proxy/8787/status
Actual results:
Expected results:
Additional info:
In hh5,
module show dask-optimiser,
cat /g/data/hh5/public/modules/dask-optimiser
show what is needed.
I believe the code could probably be forked from https://github.com/coecms/dask-optimiser