Overview of current shared infrastructure

Infrastructure
, ,
1

Overview of current shared infrastructure

Introduction

The climate modelling community relies on many services at NCI, some of which are in part provided by members of the community.

Where this infrastructure is used by community members from multiple organisations there is a desire to collaborate to reduce wasteful duplication, or improve productivity by sharing knowledge.

We have begun regular infrastructure meetings to facilitate this collaboration. The first step is to list all the current infrastructure currently used by the community, who is responsible for it, who uses it, and who is interested in collaborating with maintaining and supporting it, either currently or in the future.

Infrastructure inventory

ACCESS-Hive
Responsible entity: ACCESS-NRI
Description: Portal to all documentation relevant to the Australian Community Climate and Earth System Simulator, ACCESS, and the wider ACCESS community.
URL: https://access-hive.org.au
Users: ACCESS community (includes Universities, Centres of Excellence, CSIRO and BoM)
Collaborators:
ACCESS-HIve Forum
Responsible entity: ACCESS-NRI
Description: Place for the ACCESS Community to come together, share information, have fruitful discussions, organise and plan shared activities.
URL: https://forum.access-hive.org.au
Users: ACCESS community (includes Universities, Centres of Excellence, CSIRO and BoM)
Collaborators:
CWS Help
Responsible entity: BoM, CSIRO, CLEX-CMS, NCI
Description: Dedicated queue on the NCI helpdesk for questions/issues related to climate and weather data analysis and models at NCI
URL: cws_help@nci.org.au
Users: BoM, CSIRO, CLEX
Collaborators:
COSIMA Cookbook
Responsible entity: COSIMA (Consortium for Ocean-Sea Ice Modelling in Australia)
Description: Framework for analysing output from ocean-sea ice models. The focus is on the ACCESS-OM2 suite of models being developed and run by members of COSIMA
URL: https://github.com/COSIMA/cosima-cookbook
Users: COSIMA community (includes Universities, Centres of Excellence, CSIRO and BoM)
Collaborators:
NCI Resource Analytics
Responsible entity: CLEX (ARC Centre of Excellence for Climate Extremes) CMS
Description: Grafana dashboard interface to Postgres database of NCI resource usage data for selected project codes at NCI
URL: https://accessdev.nci.org.au/grafana/
Users: CLEX community (includes Universities, Centres of Excellence, CSIRO and BoM)
Collaborators: ACCESS-NRI, BoM
ACCESS modules
Responsible entity:
Description: Modules used for running ACCESS family models. Some modules are under UM license
URL: /g/data/access/modules
Users: BoM, CSIRO, CLEX
Collaborators: BoM
hh5 conda environments
Responsible entity: CLEX-CMS
Description: Conda Python environments at NCI, with a wide variety of climate and weather related libraries.
URL: Conda - climate-cms wikis.unsw.edu.au
Users: BoM, CSIRO, CLEX
Collaborators:
accessdev
Responsible entity:
Description: VM for running Rose/Cylc and UMUI models
URL: accessdev.nci.org.au
Users: BoM, CSIRO, CLEX
Collaborators:
Jenkins
Responsible entity:
Description:
URL: https://accessdev.nci.org.au/jenkins/
Users: BoM, CSIRO, CLEX
Collaborators:
Gitlab CI (BoM NGM)
Responsible entity: BoM
Description: CI for running tests on Gadi & building conda singularity containers
URL: Sign in · GitLab
Users: BoM
Collaborators:
ARE Rose/Cylc
Responsible entity: NCI
Description: Rose/Cylc suite control on ARE
URL: https://are.nci.org.au
Users: BoM
Collaborators: NCI, BoM
payu
Responsible entity: Marshall Ward, CLEX CMS
Description: Climate model workflow tool used for Ocean Sea-Ice and ESM models
URL: GitHub - payu-org/payu: A workflow management tool for numerical models on the NCI computing systems
Users: ACCESS community (includes Universities, Centres of Excellence, CSIRO and BoM)
Collaborators: COSIMA, ACCESS-NRI
coecms GitHub organisation
Responsible entity: CLEX-CMS
Description: Github organisation, with a wide variety of climate and weather related repositories, including repositories related to the ACCESS model. Some of the codes are available in the hh5 conda environments
URL: ARC COE for Climate Extremes: Computational Modelling Systems · GitHub
Users: BoM, CSIRO, CLEX
Collaborators: CLEX