# 7th March 2025 - Introduction to Cosima-Cookbook/Cosima-Recipes & how to make it go - loading data fast **URL:** \ **Category:** 2025 training program\ **Created:** [5 March 2025 07:04 UTC](https://forum.access-hive.org.au/t/7th-march-2025-introduction-to-cosima-cookbook-cosima-recipes-how-to-make-it-go-loading-data-fast/4263 "2025-03-05T07:04:22Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![CharlesTurner](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/charlesturner/32/2518_2.png) [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)\ **Post date:** [5 March 2025 07:04 UTC](https://forum.access-hive.org.au/t/7th-march-2025-introduction-to-cosima-cookbook-cosima-recipes-how-to-make-it-go-loading-data-fast/4263/1 "2025-03-05T07:04:22Z")
Friday 7th March 11AM AEDT, [Zoom Link](https://anu.zoom.us/j/88150486976?pwd=GjNteS8wQbku4EygvvKp4QQR4ySZn8.1). In this session, we’ll cover the basics of getting started with cosima-recipes, through to optimising loading datasets - to help perform analyses quicker & more effectively. We’ll start with a brief history and overview of the cosima-cookbook and cosima-recipes, before we dive into tutorial notebooks to get up to speed with what cosima-recipes can help you with. Depending on the experience of the attendees, we’ll focus either on (or split into groups doing both): - Getting up to speed with the cosima-cookbook (0-60); or - Making it go: how to speed up loading your data, following the cosima cookbook approaches (60-100). ## Pre-Requisites - Get [account on NCI](https://nci.org.au/users/how-access-nci), also see [this help](https://access-hive.org.au/getting_started/set_up_nci_account/#macos). Join your own NCI project and then `hh5`, `xp65`, `ik11`, `cj50`, `oi10`. [Find the project here](https://my.nci.org.au/mancini/project-search) and join it (see `Join` tab). Also see [this help](https://access-hive.org.au/getting_started/set_up_nci_account/#macos) - Clone session materials: `$ git clone https://github.com/COSIMA/cosima-recipes` ## ARE Setup - Module directories `/g/data/xp65/public/modules` - Modules `conda/analysis3-25.02` - Projects: `gdata/xp65+gdata/$PROJECT` `+gdata/hh5+gdata/ik11+gdata/cj50` (these projects have most COSIMA model results) `+gdata/oi10+gdata/ol01+gdata/fs38+gdata/p73` (these projects have more model results) - Compute Size of large or greater. ![Screenshot 2025-02-20 at 9.38.48 am](https://us1.discourse-cdn.com/flex020/uploads/access1/original/2X/0/0e501415efdb66b0a9e54cc34b2df2bfe543fe14.png) ## Slides [cookbook-tutorial.pdf](https://forum.access-hive.org.au/uploads/short-url/whaPy1HUM35YwpSFSR30asBVB8H.pdf) (138.3 KB) [making\_it\_go.pdf](https://forum.access-hive.org.au/uploads/short-url/6csyESaIHVa3ffCJ5TGN9hmDVBI.pdf) (363.6 KB) ---
**Author:** ![Thomas-Moore](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/thomas-moore/32/329_2.png) [@Thomas-Moore](https://forum.access-hive.org.au/u/Thomas-Moore)\ **Post date:** [7 March 2025 01:12 UTC](https://forum.access-hive.org.au/t/7th-march-2025-introduction-to-cosima-cookbook-cosima-recipes-how-to-make-it-go-loading-data-fast/4263/2 "2025-03-07T01:12:26Z")
Thanks for the great training session @CharlesTurner, @AndyHoggANU, et al. I do recognise that many folks just want to get on with science and really don’t wan’t to deal with the details of how to make an “analysis ready” data object. I think there is much to be gained across the community - doing much more with given resources - by continuing the excellent efforts like today. I’ll attach here a poster from OMO24 from myself and @ChrisC28 that was and is just about stimulating discussion on how the wider community can address reducing the cost in time and effort involved in getting past turning large groups of NetCDF files into analysis ready datasets for ocean, climate, and earth science. Thanks again. ---
**Author:** ![Thomas-Moore](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/thomas-moore/32/329_2.png) [@Thomas-Moore](https://forum.access-hive.org.au/u/Thomas-Moore)\ **Post date:** [7 March 2025 01:15 UTC](https://forum.access-hive.org.au/t/7th-march-2025-introduction-to-cosima-cookbook-cosima-recipes-how-to-make-it-go-loading-data-fast/4263/3 "2025-03-07T01:15:11Z")
[Moore\_OMO24\_poster\_29062024\_Apaper.pdf](https://forum.access-hive.org.au/uploads/short-url/1J5LOxvbO9SnPd3NrW05MsoGHDP.pdf) (10.4 MB) ---
**Author:** ![cbull](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/cbull/32/2203_2.png) [@cbull](https://forum.access-hive.org.au/u/cbull)\ **Post date:** [7 March 2025 01:34 UTC](https://forum.access-hive.org.au/t/7th-march-2025-introduction-to-cosima-cookbook-cosima-recipes-how-to-make-it-go-loading-data-fast/4263/4 "2025-03-07T01:34:45Z")
Thanks for coming along today everyone. [Please fill in our feedback poll here, should take less than a minute…](https://wall.sli.do/event/47i675oSVJ9pymd7TBbZyJ?section=edf3a277-010f-4bf0-ad98-b406b050012c). ---
**Author:** ![cbull](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/cbull/32/2203_2.png) [@cbull](https://forum.access-hive.org.au/u/cbull)\ **Post date:** [17 March 2025 04:40 UTC](https://forum.access-hive.org.au/t/7th-march-2025-introduction-to-cosima-cookbook-cosima-recipes-how-to-make-it-go-loading-data-fast/4263/5 "2025-03-17T04:40:12Z")
Session feedback. ### Anonymous The beginners’ session was super-clear and easy to follow. The method of loading input {catalog = intake.cat.access\_nri; ds = catalog[experiment].search(variable=variable).to\_dask()} was really simple and useful From there, the tutorial explored slicing/plotting analyses which were helpful (more on resampling options would be good) An early exercise asked about chunking - it’d be good to explore this, too The advanced exercises included dask distributed computing - again, this would be a good follow-up Will definitely do the cartopy tute Thanks ### Anonymous I appreciated the format and content. It worked well for me and I found the information useful. ### Anonymous Great to be able to get everyone in one room with the experts to dive into chunking advice - very helpful ### Anonymous I really like the advices on chunking in the advanced session! Really helpful!