ACCESS-MOPPy 1.0 Beta Release Announcement

ACCESS-MOPPy (Model Output Post-Processor) is now available in beta!

We’re excited to announce the beta release of ACCESS-MOPPy, a modern Python-based CMORisation tool designed to post-process ACCESS model output and produce CMIP-compliant datasets. The beta version is now available in the ACCESS Analysis3 environment starting from analysis3-26.02.

:rocket: What is ACCESS-MOPPy?

ACCESS-MOPPy represents the next generation of CMORisation tools for the Australian climate modeling community. Building on the knowledge and experience accumulated from previous tools like APP4 and ACCESS-MOPPeR, ACCESS-MOPPy is an entirely new package that provides:

  • Modern Python API for integration into notebooks and scripts
  • Scalable batch processing system for HPC environments
  • Real-time monitoring with web-based dashboard
  • Flexible CMORisation without relying on traditional CMOR libraries
  • CMIP6 and CMIP7 FastTrack support covering most required variables
  • Cross-platform compatibility beyond NCI Gadi

ACCESS-MOPPy is designed from the ground up to be flexible and integration-ready, positioning it as a key component in the broader ACCESS-NRI ecosystem.


:warning: Beta Release Notice

This is a beta release - please read carefully:

  • The software is in a usable state and should cover most variables required for CMIP7 FastTrack
  • Development is still very active with regular updates expected
  • Expect the code to be unstable as we continue to fix bugs and add improvements
  • The batch processing system for large-scale ESGF publication is still largely untested

We appreciate your patience as we work with limited resources to rapidly improve the tool.


:hammer_and_wrench: Getting Started

Installation & Environment

ACCESS-MOPPy is available in the ACCESS Analysis3 environment from analysis3-26.02 onwards. Simply activate your environment and start using the tool.

Tutorials & Documentation

Get started quickly with our comprehensive tutorials available in the notebooks folder of the GitHub repository:

Quick Example


import glob

from access_moppy import ACCESS_ESM_CMORiser

# Select input files

files = glob.glob("/path/to/model/output/*mon.nc")

# Create and run CMORiser

cmoriser = ACCESS_ESM_CMORiser(
                              input_data=files,
                              compound_name="Amon.pr", # table.variable format
                              experiment_id="historical",
                              source_id="ACCESS-ESM1-5",
                              variant_label="r1i1p1f1",
                              grid_label="gn",
                              activity_id="CMIP",
                              output_path="/path/to/output"
                              )

cmoriser.run()
cmoriser.write()

:bullseye: Integration Goals & Future Vision

ACCESS-MOPPy is designed to be a flexible tool that integrates seamlessly with other ACCESS-NRI supported tools:

This integration approach ensures that ACCESS-MOPPy can be embedded into comprehensive data processing and evaluation pipelines, rather than operating as an isolated tool.


:memo: Important Notes

CMIP7 Vocabulary Status

Please note that the CMIP7 vocabulary is still evolving. Many designations currently remain as CMIP6 specifications and will stay that way until the CMIP7 standards are finalized. We will update the vocabulary mappings as the community standards stabilize.

Current Limitations

  • This is a beta version intended for evaluation and early adoption
  • Variable mapping is under continuous review for CMIP6/CMIP7 compliance
  • Batch system requires further testing for production-scale operations

:handshake: Community Support & Feedback

Reporting Issues & Requests

We welcome your feedback! Please submit:

  • Bug reports
  • Feature requests
  • New variable requests
  • General feedback

Via the GitHub Issues page.

Please be patient with response times as we currently have limited resources dedicated to community support.

Contributing

We welcome contributions from the community! Feel free to submit pull requests for improvements, bug fixes, or new features.


:books: Resources

ACCESS-MOPPy update: use the latest analysis3 environment

ACCESS-MOPPy continues to evolve rapidly following the initial beta release announced in February. The package is available in the ACCESS Analysis3 environment from analysis3-26.02 onward, but because development is still moving quickly, we recommend using the most recent available conda/analysis3 environment wherever possible.

On Gadi, for example:

module use /g/data/xp65/public/modules
module load conda/analysis3

or load the latest dated Analysis3 environment available to your project/session.

What has changed since the 1.0 beta release?

Since the February beta release, ACCESS-MOPPy has continued to mature as the ACCESS-NRI CMORisation workflow for ACCESS model output. Major areas of development include:

  • continued expansion of CMIP7 FastTrack variable support, including core variables and ocean-related workflows;
  • support for both CMIP6 and CMIP6Plus controlled vocabularies;
  • ongoing progress toward full CMIP7 / ACCESS-ESM1.6 support, pending official model registration details;
  • improved live CMORisation workflows in Jupyter notebooks and ARE-style interactive use;
  • beta integration with ILAMB, now being used for ACCESS-ESM1.6 historical evaluation workflows;
  • ongoing testing and development of ESMValTool integration;
  • progress on batch-processing workflows for larger experiment/publication-style CMORisation tasks;
  • prototype interactive and command-line dashboards for monitoring CMORisation workflows;
  • improved documentation, tutorials, validation checks, and examples;
  • continued work toward tighter integration with the ACCESS-NRI Intake Catalogue, so users can move more easily from data discovery to CMORisation.

Why use the latest analysis3 environment?

ACCESS-MOPPy is still under active development. Newer Analysis3 environments are likely to include:

  • newer ACCESS-MOPPy versions;
  • bug fixes for variable handling, metadata, and controlled vocabularies;
  • improved notebook and batch workflows;
  • updated dependencies used by ACCESS-MOPPy, ILAMB, ESMValTool, Intake, and related ACCESS-NRI tools.

If you started using ACCESS-MOPPy from analysis3-26.02, it is worth moving to the latest available Analysis3 environment before reporting issues or comparing results, as some problems may already have been fixed.

Reminder: beta software

ACCESS-MOPPy is usable and already supports many ACCESS evaluation and CMORisation workflows, but it should still be treated as beta software:

  • APIs and configuration may still change;
  • some variables or workflows may still need fixes;
  • large-scale ESGF/publication workflows are still being tested and refined;
  • feedback from users is very helpful while the tool is maturing.

Useful links