Dear NRI help, I am using dask bag to read multiple files in parallel. This code was working on the hh5 environment, however, crashes on the xp65 env. Here are the pertinent fragments of code: from dask import compute, delayed import dask.bag as db #Create key:value pairs of keys and directory p…

Dask bag crashing in xp65 env (but wasn't in hh5)

anton (Anton Steketee, ACCESS-NRI Oceans Team) 1 May 2025 23:22 5

Oh - never mind my comments about starting the dask cluster - i see you have that handled (Using dask_jobqueue in the new xp65 environment)

Topic		Replies	Views
Strange error using xp65 Technical help , inscope	6	70	1 May 2025
Using dask_jobqueue in the new xp65 environment Technical help , inscope , climate-conda-enviro	5	47	2 May 2025
Latest version of dask (2022.11.0) could fix many workflow issues Technical python , dask	6	422	5 January 2023
Hh5 analysis environment in ARE Infrastructure	4	248	12 September 2024
NCI_era5grib - WRF crash? Atmosphere python , help , outofscope	5	50	12 March 2025