Nextflow enables scalable and reproducible scientific workflows using software containers. It allows the adaptation of pipelines written in the most common scripting languages.
Its fluent DSL simplifies the implementation and the deployment of complex parallel and reactive workflows on clouds and clusters.
Pawsey and AusBiocommons have recently rolled out Nextflow Tower which enables high level orchestration of Nextflow pipelines over heterogenous compute environments (Multi-HPC, cloud). This is something ACCESS-NRI is keeping an eye on, to see if it matches any of our use-cases.
Interestingly dupport for spack has been added to NextFlow: