# Payu: a workflow manager for some ACCESS models

**URL:** <https://forum.access-hive.org.au/t/payu-a-workflow-manager-for-some-access-models/1098>\
**Category:** ACCESS-NRI Releases\
**Tags:** nci, release, payu, nri-updates\
**Created:** [17 August 2023 06:07 UTC](https://forum.access-hive.org.au/t/payu-a-workflow-manager-for-some-access-models/1098 "2023-08-17T06:07:22Z")\
**Posts on this page:** 1\
**Showing post:** 17

<div class="post-metadata">

**Author:** ![Qianhui\_Chen](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/qianhui_chen/32/4372_2.png) [@Qianhui\_Chen](https://forum.access-hive.org.au/u/Qianhui_Chen)\
**Post date:** [9 November 2026 05:31 UTC](https://forum.access-hive.org.au/t/payu-a-workflow-manager-for-some-access-models/1098/17 "2026-11-09T05:31:10Z")

</div>

# 09/11/2026

🚀 **Release:** 1.4.0

[https://github.com/payu-org/payu/releases/tag/1.4.0](https://github.com/payu-org/payu/releases/tag/1.4.0)

## Getting Started

This version of payu is now available on `gadi`:

```sh
module use /g/data/vk83/modules
module load payu/1.4.0

```

## Updates

## What’s Changed

- Use furo as ReadTheDoc theme by [@Qian-HuiChen](https://github.com/Qian-HuiChen) in [#860](https://github.com/payu-org/payu/pull/860)
- Fix reference to repeat\_run in access driver by [@aidanheerdegen](https://github.com/aidanheerdegen) in [#871](https://github.com/payu-org/payu/pull/871)
- Support flat restart directories in restart hash mapping by [@minghangli-uni](https://github.com/minghangli-uni) in [#879](https://github.com/payu-org/payu/pull/879)
- CICE5: only match restart files with the expected name format by [@anton-seaice](https://github.com/anton-seaice) in [#876](https://github.com/payu-org/payu/pull/876)
- Display “X remaining to be submitted” in payu status by [@Qian-HuiChen](https://github.com/Qian-HuiChen) in [#875](https://github.com/payu-org/payu/pull/875)
- Make intake datastores for archived/synced output by [@Qian-HuiChen](https://github.com/Qian-HuiChen) and [@anton-seaice](https://github.com/anton-seaice) in [#808](https://github.com/payu-org/payu/pull/808)
- Update `PAYU_CURRENT_RUN` for postscript job if `init_run` is configured by [@Qian-HuiChen](https://github.com/Qian-HuiChen) in [#890](https://github.com/payu-org/payu/pull/890)

For a full list of changes, please see [Payu Github 1.4.0 release](https://github.com/payu-org/payu/releases/tag/1.4.0).

## Notes

### 1. A new feature: build an intake datastore for your experiment output

Payu can now build an intake catalog datastore for model output using the builders from [access-nri-intake-catalog](https://access-nri-intake-catalog.readthedocs.io/). This makes your experiment output directly searchable and loadable with intake, without having to build the datastore by hand. The datastore is written to the archive directory by default, but if a sync enabled to a local directory, e.g. a location in `/g/data`, the datastore is generated for the data in the sync location and saved there.

The datastore is built as a separate post-processing job that runs after the sync job, so it joins the existing workflow: `run -> collate -> postscript -> sync -> catalog`.

It is disabled by default and can be enabled in `config.yaml` by:

```yaml
catalog:
    enable: true

```

You can also customise the resources allocated to the catalog generation job:

```yaml
catalog:
    enable: true
    queue: normal
    cpus: 8
    mem: 50GB
    walltime: 0:05:00

```

The values shown above are the default resource settings. It can also be run manually with:

```sh
payu catalog

```

For more details, please refer to [this section](https://payu.readthedocs.io/en/latest/usage.html#intake-catalog-generation) in payu documentation.

### 2. `payu status` tracks remaining jobs

`payu status` now shows how many runs are still waiting to be submitted after `payu run -n N`. For example:

```shell
$ payu run -n 5
$ payu status
========================================
Run: 3
  ------------- Run Info -------------
  Job ID: 1000.gadi-pbs
  Run ID: xxxx
  Stage: archive
  Total Queue Time: 0h 1m 14s
  Model Finish Time: 1951-12-01T00:00:00
  Model Exit Code: 0 (Success)
  Exit Status: 0 (Success)
  Output Log: xxxx
  Error Log: xxxx
  Job File: 1000.gadi-pbs.json
========================================
Remaining run to be submitted: 1
========================================

```

The “remaining” line is only shown when at least one run is still waiting to be submitted. If a run fails, subsequent runs won’t be submitted, accordingly the remaining line is hidden.

### 3. Bug fix: correct `PAYU_CURRENT_RUN` in postscript jobs when `runspersub` \> 1.

Thanks to the community [feedback](https://forum.access-hive.org.au/t/atmosphere-post-processing-not-triggered-in-esm1-6-experiment/7125/4), we identified an issue where `PAYU_CURRENT_RUN` was not correctly incremented in postscript jobs when `runspersub` was greater than one.

As a result, postscript jobs could reference the wrong output directory.

This is now fixed in Payu 1.4.0. `PAYU_CURRENT_RUN` is correctly updated for each run, and postscript jobs locate the corresponding output directory.

### 4. A fresh look for payu documentation

The [payu documentation](https://payu.readthedocs.io/) now uses the [furo](https://github.com/pradyunsg/furo) theme. The new layout is cleaner and easier to navigate, has a sidebar with all sections at a glance, and supports both light and dark mode.

## Support

Replies to this topic are disabled.

If you have specific questions about this release [follow the guidelines for requesting help from ACCESS-NRI](https://forum.access-hive.org.au/t/access-help-and-support/908).

If you have questions about #payu create a topic in a category that best matches the model you are using, or in the #Technical category and tag it with #payu. If you require assistance [follow the guidelines for requesting help from ACCESS-NRI](https://forum.access-hive.org.au/t/access-help-and-support/908).

## Credits

Developments by @Qianhui_Chen, @minghangli, @anton @Aidan.

Reviewers included @jo-basevi, @atteggiani, @jasmeen_kaur, @spencerwong, @CharlesTurner .

---

_[View the full topic](https://forum.access-hive.org.au/t/payu-a-workflow-manager-for-some-access-models/1098)._
