# Infrastructure **URL:** https://forum.access-hive.org.au/c/technical/infrastructure/22.md [Latest](https://forum.access-hive.org.au/latest.md) · [Categories](https://forum.access-hive.org.au/categories.md) · [Tags](https://forum.access-hive.org.au/tags.md) --- ## [Infrastructure Management Meetings](https://forum.access-hive.org.au/t/infrastructure-management-meetings/281)
**Author:** [@Aidan](https://forum.access-hive.org.au/u/Aidan)\ **Replies:** 0\ **Last updated:** [15 December 2022 05:12 UTC](https://forum.access-hive.org.au/t/infrastructure-management-meetings/281 "2022-12-15T05:12:08Z")
Announcement topic for management of shared infrastructure. --- ## [About the Infrastructure category](https://forum.access-hive.org.au/t/about-the-infrastructure-category/53)
**Author:** [@Aidan](https://forum.access-hive.org.au/u/Aidan)\ **Replies:** 0\ **Last updated:** [20 October 2022 22:24 UTC](https://forum.access-hive.org.au/t/about-the-infrastructure-category/53 "2022-10-20T22:24:26Z")
Organisation and administration of shared infrastructure. This is the shared infrastructure used, developed and supported by the community. e.g. accessdev, supported software and conda environments and analytics, There… --- ## [From analysis3 26.07 onwards, xarray hits "Importerror" on compute nodes](https://forum.access-hive.org.au/t/from-analysis3-26-07-onwards-xarray-hits-importerror-on-compute-nodes/6973)
**Author:** [@ashjbarnes](https://forum.access-hive.org.au/u/ashjbarnes)\ **Replies:** 2\ **Last updated:** [10 September 2026 06:29 UTC](https://forum.access-hive.org.au/t/from-analysis3-26-07-onwards-xarray-hits-importerror-on-compute-nodes/6973 "2026-09-10T06:29:16Z")
From 26.07 onwards, a command like this: import xarray xarray.open\_dataset("/g/data/gb02/ab8992/rom3-inputdirs/sots5km/hgrid.nc") throws this error: /g/data/xp65/public/apps/med\_conda/envs/analysis3-26.08/lib/python3.… --- ## [Plotting coastlines on a compute node](https://forum.access-hive.org.au/t/plotting-coastlines-on-a-compute-node/6926)
**Author:** [@paocorrales](https://forum.access-hive.org.au/u/paocorrales)\ **Replies:** 8\ **Last updated:** [28 August 2026 01:28 UTC](https://forum.access-hive.org.au/t/plotting-coastlines-on-a-compute-node/6926 "2026-08-28T01:28:31Z")
Hi! I’m trying to plot a few figures by running code on a compute node (not ARE) and using the analysis3 environment. When trying to plot coastlines, I get Network is unreachable. I imagine this is because compute nodes … --- ## [Ants module availability in xp65 analysis3 kernels](https://forum.access-hive.org.au/t/ants-module-availability-in-xp65-analysis3-kernels/5149)
**Author:** [@bethanwhite](https://forum.access-hive.org.au/u/bethanwhite)\ **Replies:** 36\ **Last updated:** [21 August 2026 05:40 UTC](https://forum.access-hive.org.au/t/ants-module-availability-in-xp65-analysis3-kernels/5149 "2026-08-21T05:40:04Z")
The ants module is a key piece of software not just for running Met Office family models but also for working on analysis of their outputs. Having transitioned from hh5 to xp65, I’ve been struggling to find out where an… --- ## [UKMO ants library will arbitrarily over-write filenames](https://forum.access-hive.org.au/t/ukmo-ants-library-will-arbitrarily-over-write-filenames/6877)
**Author:** [@Paul.Gregory](https://forum.access-hive.org.au/u/Paul.Gregory)\ **Replies:** 0\ **Last updated:** [20 August 2026 23:49 UTC](https://forum.access-hive.org.au/t/ukmo-ants-library-will-arbitrarily-over-write-filenames/6877 "2026-08-20T23:49:06Z")
Hi all. I’ve been chasing my tail for a few days until I discovered this. I’m posting this so it’s documented within the community. TLDR; ants will arbitarily override some filenames when saving a UM ancillary file. Tr… --- ## [Newer version of ANTS in analysis3 or other env on gadi?](https://forum.access-hive.org.au/t/newer-version-of-ants-in-analysis3-or-other-env-on-gadi/3798)
**Author:** [@mlipson](https://forum.access-hive.org.au/u/mlipson)\ **Replies:** 10\ **Last updated:** [29 July 2026 03:42 UTC](https://forum.access-hive.org.au/t/newer-version-of-ants-in-analysis3-or-other-env-on-gadi/3798 "2026-07-29T03:42:11Z")
The UM ancillary generation process uses ANTS (behind MOSRS firewall). ANTS is available on analysis3, but it is an older version (0.19) which doesn’t work with some of the Regional Ancillary Suite ANTS (1.0) or the JULE… --- ## [Issues with new conda/analysis3 importing netCDF4](https://forum.access-hive.org.au/t/issues-with-new-conda-analysis3-importing-netcdf4/6047)
**Author:** [@srennie](https://forum.access-hive.org.au/u/srennie)\ **Replies:** 3\ **Last updated:** [19 March 2026 03:40 UTC](https://forum.access-hive.org.au/t/issues-with-new-conda-analysis3-importing-netcdf4/6047 "2026-03-19T03:40:16Z")
Description of request: Environment: NCI gadi login node conda/analysis3 What executed: $ module load conda/analysis3 $ python \>\>\> from netCDF4 import Dataset Actual results: Traceback (most recent call last): Fil… --- ## [MOSRS to GitHub migration 2025-2026](https://forum.access-hive.org.au/t/mosrs-to-github-migration-2025-2026/4189)
**Author:** [@paulleopardi](https://forum.access-hive.org.au/u/paulleopardi)\ **Replies:** 7\ **Last updated:** [31 October 2025 00:47 UTC](https://forum.access-hive.org.au/t/mosrs-to-github-migration-2025-2026/4189 "2025-10-31T00:47:28Z")
@Aidan @heidi @MartinDix The UK Met Office has a Science Git Migration Project (Met Office Sharepoint access required). Their Comms Site contains a presentation given in April 2024 that includes a migration timeline. Tha… --- ## [Using xp65 in UM suites](https://forum.access-hive.org.au/t/using-xp65-in-um-suites/5292)
**Author:** [@BecJackson](https://forum.access-hive.org.au/u/BecJackson)\ **Replies:** 16\ **Last updated:** [28 October 2025 00:56 UTC](https://forum.access-hive.org.au/t/using-xp65-in-um-suites/5292 "2025-10-28T00:56:19Z")
Hi everyone, I’m having trouble using the xp65 analysis3 environments in the UM RNS, specifically using iris. My suite (u-de207) includes some extra python scripts to post-process the model output, which I’m trying to u… --- ## [Analysis3 not working with R](https://forum.access-hive.org.au/t/analysis3-not-working-with-r/5246)
**Author:** [@pearseb](https://forum.access-hive.org.au/u/pearseb)\ **Replies:** 10\ **Last updated:** [18 September 2025 07:22 UTC](https://forum.access-hive.org.au/t/analysis3-not-working-with-r/5246 "2025-09-18T07:22:17Z")
Hi all, I’m trying to run an interactive session on the ARE with Rstudio. I’m assuming that the conda/analysis3 also manages R packages as well as python, and so i was wanting to use it. However, it looks like using th… --- ## [Shapely fails to import in analysis3-25.04: undefined symbol GEOSGeom\_getExtent\_r](https://forum.access-hive.org.au/t/shapely-fails-to-import-in-analysis3-25-04-undefined-symbol-geosgeom-getextent-r/4518)
**Author:** [@dpath2o](https://forum.access-hive.org.au/u/dpath2o)\ **Replies:** 6\ **Last updated:** [15 July 2025 03:25 UTC](https://forum.access-hive.org.au/t/shapely-fails-to-import-in-analysis3-25-04-undefined-symbol-geosgeom-getextent-r/4518 "2025-07-15T03:25:30Z")
Hi team, This environment was working yesterday, but today I’m seeing this error in analysis3-25.04: ImportError: shapely/lib.cpython-311-x86\_64-linux-gnu.so: undefined symbol: GEOSGeom\_getExtent\_r Traceback: -----… --- ## [Analysis3 and era5grib](https://forum.access-hive.org.au/t/analysis3-and-era5grib/4620)
**Author:** [@traupach](https://forum.access-hive.org.au/u/traupach)\ **Replies:** 6\ **Last updated:** [2 July 2025 07:27 UTC](https://forum.access-hive.org.au/t/analysis3-and-era5grib/4620 "2025-07-02T07:27:49Z")
Hi all, I’ve switched to the new xp65 version of analysis3 Conda environment, but I’m having trouble finding era5grib in the newest versions. I see that era5grib is included in analysis3 24.12 but not in 25.01 (in xp65… --- ## [Where do I find user documentation on the ACCESS ngm modules?](https://forum.access-hive.org.au/t/where-do-i-find-user-documentation-on-the-access-ngm-modules/4641)
**Author:** [@paulleopardi](https://forum.access-hive.org.au/u/paulleopardi)\ **Replies:** 10\ **Last updated:** [1 July 2025 23:55 UTC](https://forum.access-hive.org.au/t/where-do-i-find-user-documentation-on-the-access-ngm-modules/4641 "2025-07-01T23:55:11Z")
@Scott I am looking for user documentation on the ACCESS ngm modules, in particular, the ants module. I specifically want to know whether anything in my ~/.bashrc file or other modules would interfere with running the sc… --- ## [Running xp65 analysis on ARE](https://forum.access-hive.org.au/t/running-xp65-analysis-on-are/4419)
**Author:** [@Paul.Gregory](https://forum.access-hive.org.au/u/Paul.Gregory)\ **Replies:** 10\ **Last updated:** [15 June 2025 06:48 UTC](https://forum.access-hive.org.au/t/running-xp65-analysis-on-are/4419 "2025-06-15T06:48:22Z")
Hi all. Has anyone managed to run the xp65 analysis3 environment on ARE yet? You could load hh5 analysis3 by specifying as all the environments are present in /g/data/hh5/public/apps/miniconda3/envs/. The xp65 dir… --- ## [Xp65 on ARE VDI - unable to call on /opt/conda/\*](https://forum.access-hive.org.au/t/xp65-on-are-vdi-unable-to-call-on-opt-conda/4442)
**Author:** [@mblack](https://forum.access-hive.org.au/u/mblack)\ **Replies:** 8\ **Last updated:** [20 May 2025 02:33 UTC](https://forum.access-hive.org.au/t/xp65-on-are-vdi-unable-to-call-on-opt-conda/4442 "2025-05-20T02:33:19Z")
Hi all, I am experiencing an issue when trying to run xp65 analysis3 within ARE VDI. I have followed the helpful instructions (inc. adding gdata/xp65 under Storage). When I attempt to execute python from the VDI termin… --- ## [Pygmt on xp65](https://forum.access-hive.org.au/t/pygmt-on-xp65/4516)
**Author:** [@dpath2o](https://forum.access-hive.org.au/u/dpath2o)\ **Replies:** 4\ **Last updated:** [19 May 2025 23:11 UTC](https://forum.access-hive.org.au/t/pygmt-on-xp65/4516 "2025-05-19T23:11:56Z")
Hi, attempting to switch over to xp65 (module use /g/data/xp65/public/modules instead of hh5), but ran into this issue after “pip install pygmt” --------------------------------------------------------------------------… --- ## [Dask bag crashing in xp65 env (but wasn't in hh5)](https://forum.access-hive.org.au/t/dask-bag-crashing-in-xp65-env-but-wasnt-in-hh5/4461)
**Author:** [@jpeter](https://forum.access-hive.org.au/u/jpeter)\ **Replies:** 19\ **Last updated:** [16 May 2025 00:34 UTC](https://forum.access-hive.org.au/t/dask-bag-crashing-in-xp65-env-but-wasnt-in-hh5/4461 "2025-05-16T00:34:54Z")
Dear NRI help, I am using dask bag to read multiple files in parallel. This code was working on the hh5 environment, however, crashes on the xp65 env. Here are the pertinent fragments of code: from dask import compute… --- ## [Getting custom conda environment loaded into ARE environment](https://forum.access-hive.org.au/t/getting-custom-conda-environment-loaded-into-are-environment/4499)
**Author:** [@Paul.Gregory](https://forum.access-hive.org.au/u/Paul.Gregory)\ **Replies:** 8\ **Last updated:** [13 May 2025 06:04 UTC](https://forum.access-hive.org.au/t/getting-custom-conda-environment-loaded-into-are-environment/4499 "2025-05-13T06:04:05Z")
Evening all. The World Climate Research Program 2025 Hackathon is trying to build a temporary python environment to get around the current disk issues on gadi. We want to build a python environment on /scratch/nf33 whi… --- ## [Dashboards for managing NCI resources](https://forum.access-hive.org.au/t/dashboards-for-managing-nci-resources/4378)
**Author:** [@Paul.Gregory](https://forum.access-hive.org.au/u/Paul.Gregory)\ **Replies:** 10\ **Last updated:** [9 April 2025 23:20 UTC](https://forum.access-hive.org.au/t/dashboards-for-managing-nci-resources/4378 "2025-04-09T23:20:26Z")
Hello all. I’m interested in developing simple tools to help monitor NCI resources across the various projects associated with 21st Century Weather. Before I build some simple bash and python scripts, does the communit… --- ## [Grafana post-accessdev](https://forum.access-hive.org.au/t/grafana-post-accessdev/1109)
**Author:** [@Scott](https://forum.access-hive.org.au/u/Scott)\ **Replies:** 14\ **Last updated:** [10 March 2025 05:43 UTC](https://forum.access-hive.org.au/t/grafana-post-accessdev/1109 "2025-03-10T05:43:56Z")
The Grafana instance at https://accessdev.nci.org.au/grafana will need a new home when Accessdev is retired. One solution would be to stand up a new instance on another cloud tenant. Perhaps we could have a shared ansib… --- ## [MOSRS auth recently failing on Gadi](https://forum.access-hive.org.au/t/mosrs-auth-recently-failing-on-gadi/4251)
**Author:** [@mlipson](https://forum.access-hive.org.au/u/mlipson)\ **Replies:** 1\ **Last updated:** [3 March 2025 06:01 UTC](https://forum.access-hive.org.au/t/mosrs-auth-recently-failing-on-gadi/4251 "2025-03-03T06:01:10Z")
Has anyone else had issues authenticating with mosrs-auth in the last few days? Me (and some others) are recently getting: WARN: Subversion authentication with cached credentials failed. INFO: Unable to access https://c… --- ## [Hh5 scratch and analysis3 environment](https://forum.access-hive.org.au/t/hh5-scratch-and-analysis3-environment/3965)
**Author:** [@Michael\_Barnes](https://forum.access-hive.org.au/u/Michael_Barnes)\ **Replies:** 5\ **Last updated:** [6 December 2024 01:33 UTC](https://forum.access-hive.org.au/t/hh5-scratch-and-analysis3-environment/3965 "2024-12-06T01:33:27Z")
I am trying to pip install packages on my user in the analysis3 environment on hh5. However, I get errors relating to disk quota. When looking at the at the hh5 scratch, I noticed that it seems to be full. Would this be … --- ## [Recommended ways to install python library basemap on gadi (if at all?) for dynlib](https://forum.access-hive.org.au/t/recommended-ways-to-install-python-library-basemap-on-gadi-if-at-all-for-dynlib/3694)
**Author:** [@Paul.Gregory](https://forum.access-hive.org.au/u/Paul.Gregory)\ **Replies:** 8\ **Last updated:** [18 September 2024 02:08 UTC](https://forum.access-hive.org.au/t/recommended-ways-to-install-python-library-basemap-on-gadi-if-at-all-for-dynlib/3694 "2024-09-18T02:08:24Z")
Hi all. Michael Barnes from Monash would like to get the dynlib package installed on gadi: Clemens.Spensberger / dynlib · GitLab This package still uses basemap for plotting. Based on some older threads, e.g.: I th… --- ## [How to create a personal Conda environment on Gadi when you really need one?](https://forum.access-hive.org.au/t/how-to-create-a-personal-conda-environment-on-gadi-when-you-really-need-one/1727)
**Author:** [@paulleopardi](https://forum.access-hive.org.au/u/paulleopardi)\ **Replies:** 12\ **Last updated:** [19 January 2024 04:25 UTC](https://forum.access-hive.org.au/t/how-to-create-a-personal-conda-environment-on-gadi-when-you-really-need-one/1727 "2024-01-19T04:25:53Z")
Hello, I have been using a personal Conda environment on Gadi to organize and run IETF-Robose Tractive, Reposurgeon and related software to migrate Subversion repositories and Trac to GitHub. Yesterday, when I tried to … --- ## [Hh5 analysis environment in ARE](https://forum.access-hive.org.au/t/hh5-analysis-environment-in-are/1696)
**Author:** [@ChrisC28](https://forum.access-hive.org.au/u/ChrisC28)\ **Replies:** 3\ **Last updated:** [19 December 2023 22:09 UTC](https://forum.access-hive.org.au/t/hh5-analysis-environment-in-are/1696 "2023-12-19T22:09:21Z")
Hi all, Silly question, but I’ve forgotten how to access the hh5 “analysis” environment when configuring a Jupyter notebook in the ARE. In the past, under the “Advanced” tab, I’ve pointed to the relevant directory in t… --- ## [ShellCheck - A shell script static analysis tool - Can we add this to the conda environment?](https://forum.access-hive.org.au/t/shellcheck-a-shell-script-static-analysis-tool-can-we-add-this-to-the-conda-environment/1094)
**Author:** [@griff](https://forum.access-hive.org.au/u/griff)\ **Replies:** 3\ **Last updated:** [17 August 2023 03:58 UTC](https://forum.access-hive.org.au/t/shellcheck-a-shell-script-static-analysis-tool-can-we-add-this-to-the-conda-environment/1094 "2023-08-17T03:58:40Z")
Increasingly, we are trying to use pipelines for checking our code and scripts. It appears that shellcheck is available in the NCI pipeline (gitlab-ci.yml) and it would be great to be able to access this on the commandl… --- ## [Accessdev is down?](https://forum.access-hive.org.au/t/accessdev-is-down/961)
**Author:** [@Paola-CMS](https://forum.access-hive.org.au/u/Paola-CMS)\ **Replies:** 10\ **Last updated:** [7 July 2023 03:19 UTC](https://forum.access-hive.org.au/t/accessdev-is-down/961 "2023-07-07T03:19:00Z")
Looks like accessdev is down again. We were trying to add your umami package to conda and I tried to connect to Jenkins to see if it succeeded. Which reminds me that we haven’t discussed a long term plan for Jenkins onc… --- ## [Indicator for allocated storage has disappeared](https://forum.access-hive.org.au/t/indicator-for-allocated-storage-has-disappeared/394)
**Author:** [@clairecarouge](https://forum.access-hive.org.au/u/clairecarouge)\ **Replies:** 3\ **Last updated:** [3 February 2023 05:25 UTC](https://forum.access-hive.org.au/t/indicator-for-allocated-storage-has-disappeared/394 "2023-02-03T05:25:41Z")
I had a look at Grafana today for the ACCESS-NRI project on the Project Usage ALL dashboard. It looks like the line for the total allocated storage has disappeared from Grafana. I’ve checked the same board for CLEX and i… --- ## [Overview of current shared infrastructure](https://forum.access-hive.org.au/t/overview-of-current-shared-infrastructure/280)
**Author:** [@Aidan](https://forum.access-hive.org.au/u/Aidan)\ **Replies:** 0\ **Last updated:** [15 December 2022 04:45 UTC](https://forum.access-hive.org.au/t/overview-of-current-shared-infrastructure/280 "2022-12-15T04:45:33Z")
Overview of current shared infrastructure Introduction The climate modelling community relies on many services at NCI, some of which are in part provided by members of the community. Where this infrastructure is used by… [Next page](https://forum.access-hive.org.au/c/technical/infrastructure/22.md?page=1)