Many of us use xarray and dask to analyse model output. When I was first introduced to dask a few years ago, I was given a snippet of code to set up a client, and I had absolutely no idea what it was doing. The general wisdom was that there weren’t any hard and fast rules about how to make dask work…

A reference for making dask work (faster)

rmholmes (Ryan Holmes) 3 September 2023 22:50 9

Linking in this very useful comment from @dougiesquire on chunking during and after open_mfdataset: Dask remove time chunks for Fourier transforms - #8 by dougiesquire

1 Like

Topic		Replies	Views
How to efficiently chunk data for faster processing and plotting? Technical python , cosima , access-om2	5	50	29 September 2024
Presentation on dask and xarray Technical	2	375	9 May 2023
Latest version of dask (2022.11.0) could fix many workflow issues Technical python , dask	6	419	5 January 2023
Dask remove time chunks for Fourier transforms Technical dask , xarray , chunking	9	335	30 August 2023
Rechunking large data at constant memory in Dask Technical python , dask	1	202	21 March 2023