# \#storage **URL:** https://forum.access-hive.org.au/tag/storage/112.md [Latest](https://forum.access-hive.org.au/latest.md) · [Categories](https://forum.access-hive.org.au/categories.md) · [Tags](https://forum.access-hive.org.au/tags.md) --- ## [Adding data to the COSIMA community WG space \`ol01\`](https://forum.access-hive.org.au/t/adding-data-to-the-cosima-community-wg-space-ol01/5761)
**Author:** [@cbull](https://forum.access-hive.org.au/u/cbull)\ **Replies:** 20\ **Last updated:** [20 July 2026 05:28 UTC](https://forum.access-hive.org.au/t/adding-data-to-the-cosima-community-wg-space-ol01/5761 "2026-07-20T05:28:17Z")
This post is to describe how the NCI COSIMA community WG space ol01 is managed. The approach is meant to be light weight and the important thing is that anyone that has a dataset that is of interest to others (e.g. 4 peo… --- ## [Zarr 2.14.0 includes experimental support for sharding](https://forum.access-hive.org.au/t/zarr-2-14-0-includes-experimental-support-for-sharding/410)
**Author:** [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)\ **Replies:** 12\ **Last updated:** [27 August 2025 01:20 UTC](https://forum.access-hive.org.au/t/zarr-2-14-0-includes-experimental-support-for-sharding/410 "2025-08-27T01:20:27Z")
The latest release of zarr (2.14.0) includes experimental support for sharding, along with a number of other features from the v3 spec. Previous zarr specs stored one chunk per storage object. This can be problematic fo… --- ## [COSIMA Working Group Reference Datasets FY23-24](https://forum.access-hive.org.au/t/cosima-working-group-reference-datasets-fy23-24/1430)
**Author:** [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)\ **Replies:** 15\ **Last updated:** [1 October 2024 04:12 UTC](https://forum.access-hive.org.au/t/cosima-working-group-reference-datasets-fy23-24/1430 "2024-10-01T04:12:15Z")
Introduction ACCESS-NRI would like to know the needs of the Working Groups for Reference Datasets. We would like to know what datasets of significance for the working group you would like to have hosted in a published da… --- ## [Reference datasets needs - FY23-24](https://forum.access-hive.org.au/t/reference-datasets-needs-fy23-24/1417)
**Author:** [@clairecarouge](https://forum.access-hive.org.au/u/clairecarouge)\ **Replies:** 7\ **Last updated:** [20 August 2024 04:57 UTC](https://forum.access-hive.org.au/t/reference-datasets-needs-fy23-24/1417 "2024-08-20T04:57:30Z")
ACCESS-NRI would like to know the needs of the Working Groups for Reference Datasets. We would like to know what datasets of significance for the working group you would like to have hosted in a published data collection… --- ## [Reference Datasets FY23-24: Atmosphere WG](https://forum.access-hive.org.au/t/reference-datasets-fy23-24-atmosphere-wg/1427)
**Author:** [@heidi](https://forum.access-hive.org.au/u/heidi)\ **Replies:** 12\ **Last updated:** [20 August 2024 04:54 UTC](https://forum.access-hive.org.au/t/reference-datasets-fy23-24-atmosphere-wg/1427 "2024-08-20T04:54:29Z")
Introduction ACCESS-NRI would like to know the needs of the Working Groups for Reference Datasets. We would like to know what datasets of significance for the working group you would like to have hosted in a published da… --- ## [Don't use /scratch/ol01/](https://forum.access-hive.org.au/t/dont-use-scratch-ol01/2188)
**Author:** [@adele-morrison](https://forum.access-hive.org.au/u/adele-morrison)\ **Replies:** 0\ **Last updated:** [25 June 2024 23:31 UTC](https://forum.access-hive.org.au/t/dont-use-scratch-ol01/2188 "2024-06-25T23:31:30Z")
Hi all, A public service announcement: Please don’t use /scratch/ol01/. We only have 1 TB and it fills up very fast and stops others from using compute. You can set your storage path differently from your compute path … --- ## [Hh5 access-om2-025 cleanup](https://forum.access-hive.org.au/t/hh5-access-om2-025-cleanup/2125)
**Author:** [@aekiss](https://forum.access-hive.org.au/u/aekiss)\ **Replies:** 2\ **Last updated:** [28 May 2024 10:16 UTC](https://forum.access-hive.org.au/t/hh5-access-om2-025-cleanup/2125 "2024-05-28T10:16:23Z")
It’s unclear whether hh5 (and therefore /g/data/hh5/tmp/cosima) will persist past the end of CLEX, so we should archive/move what we want to keep and delete the rest. /g/data/hh5/tmp/cosima/access-om2-025 contains 16T, … --- ## [Deleting old daily 3D 0.1° data from rr6?](https://forum.access-hive.org.au/t/deleting-old-daily-3d-0-1-data-from-rr6/2040)
**Author:** [@aekiss](https://forum.access-hive.org.au/u/aekiss)\ **Replies:** 9\ **Last updated:** [13 May 2024 02:11 UTC](https://forum.access-hive.org.au/t/deleting-old-daily-3d-0-1-data-from-rr6/2040 "2024-05-13T02:11:14Z")
Hi folks, Back in 2018 I saved 26TB of 3d daily salt, temp, u and v data from 01deg\_jra55v13\_iaf here /g/data/rr6/cosima/access-om2-01/01deg\_jra55v13\_iaf and it’s time to think about whether we still need it. This w… --- ## [Applying for ESM Working Group Resources](https://forum.access-hive.org.au/t/applying-for-esm-working-group-resources/799)
**Author:** [@Aidan](https://forum.access-hive.org.au/u/Aidan)\ **Replies:** 4\ **Last updated:** [6 March 2024 02:13 UTC](https://forum.access-hive.org.au/t/applying-for-esm-working-group-resources/799 "2024-03-06T02:13:05Z")
Introduction ACCESS-NRI allocates compute and storage resources to the Working Groups to use to support their activities. Currently those resources consist of computational resources (KSUs) and storage (/g/data allocati… --- ## [Applying for COSIMA Working Group Resources](https://forum.access-hive.org.au/t/applying-for-cosima-working-group-resources/1864)
**Author:** [@dougiesquire](https://forum.access-hive.org.au/u/dougiesquire)\ **Replies:** 0\ **Last updated:** [27 February 2024 02:41 UTC](https://forum.access-hive.org.au/t/applying-for-cosima-working-group-resources/1864 "2024-02-27T02:41:12Z")
Introduction ACCESS-NRI allocates compute and storage resources to the Working Groups to use to support their activities. Currently those resources consist of computational resources (KSUs) and storage (/g/data allocati… --- ## [Applying for Land Working Group Resources](https://forum.access-hive.org.au/t/applying-for-land-working-group-resources/1863)
**Author:** [@clairecarouge](https://forum.access-hive.org.au/u/clairecarouge)\ **Replies:** 0\ **Last updated:** [26 February 2024 05:39 UTC](https://forum.access-hive.org.au/t/applying-for-land-working-group-resources/1863 "2024-02-26T05:39:29Z")
Introduction ACCESS-NRI allocates compute and storage resources to the Working Groups to use to support their activities. Currently those resources consist of computational resources (KSUs) and storage (/g/data allocati… --- ## [COSIMA gdata storage](https://forum.access-hive.org.au/t/cosima-gdata-storage/1560)
**Author:** [@adele-morrison](https://forum.access-hive.org.au/u/adele-morrison)\ **Replies:** 7\ **Last updated:** [30 October 2023 06:47 UTC](https://forum.access-hive.org.au/t/cosima-gdata-storage/1560 "2023-10-30T06:47:36Z")
COSIMA has been given 100 TB from NRI on project ol01 for shared storage. Given that ik11 is already pretty full up, I propose that we put the new panan 1/10th, 1/20th and 1/40th simulation output on ol01. Does that soun… --- ## [ESM Working Group Reference Datasets FY23-24](https://forum.access-hive.org.au/t/esm-working-group-reference-datasets-fy23-24/1426)
**Author:** [@Aidan](https://forum.access-hive.org.au/u/Aidan)\ **Replies:** 0\ **Last updated:** [20 September 2023 12:48 UTC](https://forum.access-hive.org.au/t/esm-working-group-reference-datasets-fy23-24/1426 "2023-09-20T12:48:14Z")
Introduction ACCESS-NRI would like to know the needs of the Working Groups for Reference Datasets. We would like to know what datasets of significance for the working group you would like to have hosted in a published da… --- ## [Projects for the working group resources - Q4 2023](https://forum.access-hive.org.au/t/projects-for-the-working-group-resources-q4-2023/1407)
**Author:** [@clairecarouge](https://forum.access-hive.org.au/u/clairecarouge)\ **Replies:** 0\ **Last updated:** [18 September 2023 07:00 UTC](https://forum.access-hive.org.au/t/projects-for-the-working-group-resources-q4-2023/1407 "2023-09-18T07:00:59Z")
The ACCESS-NRI Working Groups can access some computing and storage resources for use by the community, through the ACCESS-NRI Community Merit Allocation Scheme. In summary, this resource allocation is, in priority, to b…