I am trying to calculate daily statistics from hourly ERA5 data using xarray. When calculating this for large datasets, it is very very slow. I have tried a number of optimisation techniques (like using Dask), but the problem still seems to persist. I want to do this for multiple 4D variables in a time efficient manner and would love some help. I know there has already been some discussion about this on this forum, so apologies for any overlap!
I was wondering if there is a collection of daily statistics for some general variables from ERA5 hosted somewhere on gadi that can be accessed? Is this a dataset the NRI can help support?
Thanks in advance!
Cheers,
Sramana
dougiesquire
(Dougie Squire, ACCESS-NRI Ocean/Sea-Ice Modelling Team Lead (acting))
2
Your list is pretty comprehensive, I love it! Thank you. Just another question, would the 3D variables like ta, ua, va etc be available on multiple levels or just one?
I need to analyze ERA5 winds at 10 m and was wondering where on gadi I can find the data. I could only find data for 2023 in /g/data/ik11/inputs/ERA5/input/IAF/10u
Hi Christina - The data straight from ERA5 (3 hourly) is in /g/data/rt52/era5/single-levels/reanalysis/ and the link above might help to resample at a more useable frequency