# ACCESS-NRI Intake catalog: a way to find, load and share data on Gadi
**URL:** https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659
**Category:** ACCESS-NRI Releases
**Tags:** catalogue, nci, nri-updates, intake, python, release
**Created:** [1 December 2023 05:49 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659 "2023-12-01T05:49:01Z")
**Posts on this page:** 15
**Page:** 1
### Author:  [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)
#### Post date: [1 December 2023 05:49 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/1 "2023-12-01T05:49:01Z")
# What is this?
A topic that will be used to announce updates to the ACCESS-NRI Intake catalog at [NCI](http://nci.org.au).
# What is the ACCESS-NRI Intake catalog?
The ACCESS-NRI Intake catalog provides a simple, community-driven approach to finding, loading & sharing ACCESS & ACCESS-related model data on Gadi. The catalog can be used from within your Python environment to discover & load data that meet your research needs without having to know where the data are or how they fit together. It’s also easy to add your data to the catalog so that others can find & use them.
See the documentation for more information: [access-nri-intake-catalog.rtfd.io](http://access-nri-intake-catalog.rtfd.io)
# What are we releasing?
ACCESS-NRI has released v0.1.0 of the `access-nri-intake` Python package. This package allows users to find relevant data from the ACCESS-NRI Intake catalog and open them into xarray Datasets for subsequent analysis.
Subsequent releases of the catalog will be posted in this topic.
# What’s in the ACCESS-NRI Intake catalog?
Approximately 3 PB of ACCESS-related data are accessible through the catalog. These include the [NCI-managed CMIP5 and CMIP6 data collections](https://opus.nci.org.au/pages/viewpage.action?pageId=213713098) as well as a large number of non-CMIP ACCESS-OM2, ACCESS-CM2 and ACCESS-ESM1.5 model runs. Requests to add additional ACCESS-related data are encouraged and can be made [via Github](https://github.com/ACCESS-NRI/access-nri-intake-catalog/issues/new/choose).
# How to get started?
The `access-nri-intake` Python package is installed in the [CLEX CMS “analysis3” conda environment](http://climate-cms.wikis.unsw.edu.au/Conda) and the ACCESS-NRI “access-med” conda environment. Instructions on how to utilise these conda environments on NCI’s ARE can be found in the [ACCESS-NRI Intake documentation](https://access-nri-intake-catalog.readthedocs.io/en/latest/usage/how.html). The documentation also includes a [quickstart tutorial](https://access-nri-intake-catalog.readthedocs.io/en/latest/usage/quickstart.html) demonstrating how to use the catalog from your Python environment.
# What should I do to be notified of any updates?
You can [watch this topic](https://forum.access-hive.org.au/docs?topic=792), and be notified by email of _every_ update.
# Where do I ask questions?
Replies to this topic are disabled.
We welcome feedback and contributions through the ACCESS-Hive forum. Please create a topic in the #Technical category and [follow the guidelines for requesting help from ACCESS-NRI](https://forum.access-hive.org.au/t/access-help-and-support/908) should you need it. You can also open an issue [on Github](https://github.com/ACCESS-NRI/access-nri-intake-catalog/issues/new/choose).
# Useful links
- [ACCESS-NRI Intake catalog documentation](https://access-nri-intake-catalog.readthedocs.io/en/latest/index.html)
- [COSIMA tutorial on using the catalog instead of the `cosima-cookbook`](https://github.com/COSIMA/cosima-recipes/blob/main/Tutorials/Using_Intake_Catalog.ipynb)
- [Training material on the catalog](https://github.com/ACCESS-Hive/intake-training)
---
### Author:  [@rbeucher](https://forum.access-hive.org.au/u/rbeucher)
#### Post date: [5 December 2023 00:05 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/2 "2023-12-05T00:05:12Z")
---
### Author:  [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)
#### Post date: [6 May 2024 02:16 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/3 "2024-05-06T02:16:49Z")
# 04/03/2024
The catalog has been updated to v0.1.1
> **[Release v0.1.1 · ACCESS-NRI/access-nri-intake-catalog](https://github.com/ACCESS-NRI/access-nri-intake-catalog/releases/tag/v0.1.1)**
>
> What's Changed
>
> Update release.rst for #137 by @anton-seaice in #138
> Draft action for automated update of the catalog on Gadi by @rbeucher in #140
> Bump appleboy/ssh-action from 0.1.7 to 1.0.0 by @d...
## Updates
- Updates to the developer documentation ([#138](https://github.com/ACCESS-NRI/access-nri-intake-catalog/pull/138) by @anton)
- Added ACCESS-OM3 Builder for building datastores of ACCESS-OM3 output ([#154](https://github.com/ACCESS-NRI/access-nri-intake-catalog/pull/154) by @dougiesquire)
---
### Author:  [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)
#### Post date: [6 May 2024 02:22 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/4 "2024-05-06T02:22:23Z")
# 28/03/2024
The catalog has been updated to v0.1.2
> **[Release v0.1.2 · ACCESS-NRI/access-nri-intake-catalog](https://github.com/ACCESS-NRI/access-nri-intake-catalog/releases/tag/v0.1.2)**
>
> What's Changed
>
> Include metadata validation and template scripts in package by @dougiesquire in #158
> Bump actions/checkout from 4.1.1 to 4.1.2 by @dependabot in #159
> Update schema by @dougiesquire ...
## Updates
- `metadata.yaml` validating and templating scripts are now included in package ([#158](https://github.com/ACCESS-NRI/access-nri-intake-catalog/pull/158) by @dougiesquire)
- Update schema to be less restrictive about model metadata ([#161](https://github.com/ACCESS-NRI/access-nri-intake-catalog/pull/161) by @dougiesquire)
- Assign ACCESS-OM3 WW3 data to “wave” realm ([#162](https://github.com/ACCESS-NRI/access-nri-intake-catalog/pull/162) by @dougiesquire)
---
### Author:  [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)
#### Post date: [7 May 2024 02:04 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/5 "2024-05-07T02:04:14Z")
# 07/05/2024
The catalog has been updated to v0.1.3
> **[Release v0.1.3 · ACCESS-NRI/access-nri-intake-catalog](https://github.com/ACCESS-NRI/access-nri-intake-catalog/releases/tag/v0.1.3)**
>
> What's Changed
>
> Bump actions/checkout from 4.1.2 to 4.1.3 by @dependabot in #165
> Bump actions/checkout from 4.1.3 to 4.1.4 by @dependabot in #166
> Release v0.1.3 by @dougiesquire in #169
>
> Full Chang...
## Updates
- Rebuild to include [recent updates to ERA5-forced ACCESS-OM2 runs](https://forum.access-hive.org.au/t/era-5-forced-access-om2-simulations/1103/6)
---
### Author:  [@marc.white](https://forum.access-hive.org.au/u/marc.white)
#### Post date: [11 December 2024 02:50 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/6 "2024-12-11T02:50:02Z")
# 11/12/2024
`access-nri-intake-catalog` has been updated to version 1.0.0, and a new catalog has been built (`v2024-12-10`).
The new package is available on the `conda/analysis3` environment on Gadi, available from project `xp65`.
> **[Release v1.0.0 · ACCESS-NRI/access-nri-intake-catalog](https://github.com/ACCESS-NRI/access-nri-intake-catalog/releases/tag/v1.0.0)**
>
> This marks the first full release of access-nri-intake-catalog. Highlights include:
>
> Added support for a large number of datasets (BARPA, Cordex, MOM6, ERA5, ERA6, NARCliM).
> Catalog version numbers...
## Updates
- The `access-nri-intake-catalog` Python package version (`vX.Y.Z`) has now been decoupled from the catalog version. Updated catalogs (with a version format `vYYYY-MM-DD`) can now be created without a new Python package release being required. All previous `access-nri-intake-catalog` catalog versions can be accessed by supplying a `version` keyword argument to `intake.cat.access_nri`. Use `access_nri_intake_catalog.data.utils.available_versions` to see the available iterations of the catalog.
- Builders for new data sets (ERA5, CMIP5, CMIP6, MOM6, NARClim, BARPA, Cordex) have been added, and examples of each data type have been added to the new catalog (except for Cordex, which will follow at a later date).
- The metadata validation script (`metadata-validate`) now provides a full report, rather than only giving the first validation issue found.
- User, developer & maintainer documentation has been updated.
---
### Author:  [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)
#### Post date: [17 February 2025 07:16 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/7 "2025-02-17T07:16:28Z")
# 17/02/2025
`access-nri-intake-catalog` has been updated to version 1.1.1, and a new catalog has been built (`v2025-02-17`).
The new package is available on the `conda/analysis3` environment on Gadi, available from project `xp65`.
> **[Release v1.1.1 · ACCESS-NRI/access-nri-intake-catalog](https://github.com/ACCESS-NRI/access-nri-intake-catalog/releases/tag/v1.1.1)**
>
> Highlights:
>
> Add command line utility to build, verify correctness, and update individual experiment esm-datastores.
> Searchable coordinate variables following upgrade to intake-esm 2025.2.3.
> Docume...
# Updates
- A command line utility (`build-esm-datastore`), and notebook accessible utility function (`use_datastore`) have been added, allowing users to quickly and easily build, update and load individual esm-datastores for a single experiment with a known location.
- Coordinate variables are now indexed by the catalog, allowing users to find coordinate variables stored in separate grid files without the need for workarounds.
- Substantial improvements to tests and infrastructure.
- Documentation has been updated.
---
### Author:  [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)
#### Post date: [10 June 2025 08:21 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/8 "2025-06-10T08:21:41Z")
# 10/06/2025
`access-nri-intake-catalog` is now at version `1.2.3`, with the added functionality and an increased range of available data.
The default catalog version is now `v2025-06-10`, comprising 119 sources (18 new distinct esm-datastores since `v2025-02-17` for various experiments).
# Updates to the Catalog
## New ESM-Datastores
- 01deg\_jra55\_ryf\_Control
- cmip-forcing-qv56
- 01deg\_jra55v13\_ryf9091\_qian\_wthmp
- esmvaltool-obs-ct11
- shackleton\_v4\_jk72
- 01deg\_jra55v13\_ryf9091\_weddell\_up1
- cordex\_ig45
- 01deg\_jra55\_ryf\_LNFull
- 01deg\_jra55\_ryf\_ENFull
- 01deg\_jra55v13\_ryf9091\_easterlies\_up10\_zonal
- 01deg\_jra55v13\_ryf9091\_qian\_wthp
- 01deg\_jra55v13\_ryf9091\_weddell\_down2
- 01deg\_jra55v13\_ryf9091\_easterlies\_up10\_meridional
- 01deg\_jra55v13\_ryf9091\_easterlies\_down10
- 01deg\_jra55v13\_ryf9091\_easterlies\_up10
- panant-0025-zstar-ACCESSyr2
- panant-005-zstar-ACCESSyr2
- panant-01-zstar-ACCESSyr2
## Updated ESM-Datastores
- cmip6\_fs38
- cmip6\_oi10
- barpa\_py18
- era5\_rt52
- narclim\_zz63
## Software Updates
There are presently no user facing software updates to the catalog interface since `v1.1.1`. However, we have a number of exciting updates (including performance improvement, interactive catalog explorers, and better dataset concatenation) which will be released soon!
---
### Author:  [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)
#### Post date: [13 August 2025 09:44 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/9 "2025-08-13T09:44:27Z")
# Catalog Update
The default ACCESS-NRI Intake Catalog now uses a file id system based on the grids on which variables are defined, rather than filenames. This system is substantially simpler than the previous system, with the following benefits:
- User created catalogs (via eg. `use-esm-datastore`) should now automatically group all assets into xarray datasets correctly, regardless of how the files are named
- There are now fewer distinct datasets per experiment, with these datasets grouped by grid. This should massively reduce the likelihood of needing to experiment with search keys until a single dataset can be obtained.
- It enables us to begin virtualising experiment output, which should greatly improve performance.
* * *
### Warning
As a result of this update, file\_id’s in most esm-datastores in the ACCESS-NRI Intake Catalog will have changed. If you _need_ to use a catalog with the old style file id’s, you can do so via:
```python
import intake
intake.cat.access_nri(version="v2025-07-30")
```
which will load the latest catalog built with the old file id system.
User created catalogs will not have been affected by this change.
---
### Author:  [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)
#### Post date: [15 August 2025 03:27 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/10 "2025-08-15T03:27:37Z")
## 15/08/2025
The ACCESS-NRI Intake Catalog is now at version `1.3.0`. Highlights include:
### Interactive Catalog Exploration
The main catalog `intake.cat.access_nri` and it’s constituent datastores can now be explored interactively in a notebook, using the `.interative` attribute. For more info, see the [updated quickstart](https://access-nri-intake-catalog.readthedocs.io/en/latest/usage/quickstart.html).
### File ID updates
As detailed in the previous post, this version of the catalog updates the file id to simplify ESM Datastores.
### New ESM-Datastores
- WOA-13
- esmvaltool-obs-ct11
### Other changes
- `build-esm-datastore` now saves a list of invalid assets to a text file.
- Performance improvements to opening, searching, and building datastores.
---
### Author:  [@joshuatorrance](https://forum.access-hive.org.au/u/joshuatorrance)
#### Post date: [23 October 2025 05:30 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/11 "2025-10-23T05:30:09Z")
## 23/10/2025
The ACCESS-NRI Intake Catalog is now at version `1.4.1`. The default catalog version is now `v2025-10-23`.
### New ESM-Datastores
- WOA-23
- AUS2200
### New Builders
- CM3
- CMIP6
- ESM1.6
### Other changes
- iPython magic `%%check_storage_enabled` can now by used in Jupyter notebooks to verify NCI project access
- Catalogs are now stored as `parquet` files instead of `CSV` to provide significant performance improvements
---
### Author:  [@paigem](https://forum.access-hive.org.au/u/paigem)
#### Post date: [22 January 2026 01:39 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/12 "2026-01-22T01:39:30Z")
---
### Author:  [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)
#### Post date: [22 January 2026 01:53 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/13 "2026-01-22T01:53:38Z")
# 22/01/2026
The ACCESS-NRI Intake Catalog is now at version `1.5.0`. The default catalog version is now `v2026-01-20`.
### Changes to the catalog
- There are now an extra seven records in the catalog. No new sources have been added.
- All ACCESS-NRI ESM Datastores now contain a `temporal_label` attribute, which disambiguates on variable\_cell\_methods where necessary.
- Catalog data are now serialised using parquet. This should substantially improve performance when opening large catalogs.
### Updates to builders
- `AccessOM3Builder` will now include the `ocean.stats.nc` file. This also applies if `build-esm-datastore` is used.
---
### Author:  [@Aidan](https://forum.access-hive.org.au/u/Aidan)
#### Post date: [23 January 2026 01:11 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/14 "2026-01-23T01:11:17Z")
---
### Author:  [@CharlesTurner](https://forum.access-hive.org.au/u/CharlesTurner)
#### Post date: [17 March 2026 04:20 UTC](https://forum.access-hive.org.au/t/access-nri-intake-catalog-a-way-to-find-load-and-share-data-on-gadi/1659/15 "2026-03-17T04:20:21Z")
# 17/03/2026
The ACCESS-NRI Intake Catalog is now at version `1.6.0`. The default catalog version is now `v2026-02-18`.
### Changes to the catalog
- The BARRA2 dataset is now included in the catalog
### Updates to functionality
- The catalog now supports aliasing, allowing users to search using CMIP standardised vocabularies. For more information, see [Aliasing — ACCESS-NRI Intake catalog documentation](https://access-nri-intake-catalog.readthedocs.io/en/latest/usage/aliases.html) and [Aliasing demo — ACCESS-NRI Intake catalog documentation](https://access-nri-intake-catalog.readthedocs.io/en/latest/usage/aliases_demo.html)