Description of request: I’m new to the NCI systems, and want to find CMIP6 runs stored on gadi. Moreover, I’m not a Python user (my workflow typically uses CDO/NCO to preprocess data, then R to do any fancy analysis and statistical-based visualisation, and then NCL for any climate/geophysical vis…

Hi @pardeeppall , I’ve reached out to the CLeF developers for input, but I do have the following comments in the interim. My first thought is that the variant label flag (vl) does not support wildcard entries as expected, have you tried iterating through the desired vls to see if anything is retur…

@pardeeppall , some comments from the Clef people: If you search clef in the forum there should be a post (in answer to Will Hobbs ) about it, that should answer some of these questions, for the results it gets for the remote searches, they are limits imposed by ESGF. For example, the “temp and prec…

I assume the reply in question is this one? [image] Analysing CMIP6 models in gadi using Python? Technical Hi Will, The short answer is there’s no plan post-CLEX to maintain clef and the intake catalogues as they are don’t make comparison with the remote colelction. The…

Hi @pardeeppall , Unfortunately the CleF software is not an ACCESS-NRI supported product so your issue falls out of scope for our support model. However, I will leave this issue open and on the Hive, as there is no doubt expertise in the community that you could draw on to address your issue. Cheer…

Hi Ben, Thanks very much for your efforts in looking into this, and very sorry for my late reply. That’s fair enough that CleF software isn’t an ACCESS-NRI supported product, but thanks for keeping the issue open on the Hive. At this point I may well pivot to using the ACCESS-NRI catalogue. Neverth…

It’s more that your first query needs to be more specific to get results from the ESGF. Or you can use the local flag --local and then it won’t be limited, but it won’t make a comparison with what’s available on the ESGF nodes.

Hi Paola, Do you mean that the following query needs to be more specific? clef cmip6 -v pr --frequency day -e ssp585 Also, when I add the --local flag I get the following error: clef --local cmip6 -v pr --frequency day -e ssp585 /g/data/hh5/public/apps/miniconda3/envs/analysis3-24.04/lib/python…

About the pandas issue the answer should have been in the tagged post, briefly just use an older version to use local. And yes, be more specific maybe using the full member name r1* will match any r10 etc. there’s more than a hundred models and some have a lot of members which will have daily pr an…

OK, understood, and thanks for the advice. I’ll see how I get on.

Aloha @pardeeppall , Noting your workflow isn’t python based can I ask how you parallelize your NCO/CDO operations? Via MPI or similar? If there were python command line catalog utilities that could interrogate the ACCESS-NRI Intake catalog and output JSON files from serialized Python dictionaries…

Issues using CLeF on gadi to find CMIP6 runs

Technical

Aidan (Aidan Heerdegen, ACCESS-NRI Release Team Lead) 7 October 2024 23:22 5

I assume the reply in question is this one?

Topic		Replies	Views
Analysing CMIP6 models in gadi using Python? Technical cosima , workshop , model-evaluation , med , cmip	34	960	19 September 2024
Find the CMIP6 data not storaged locally without "Clef" package COSIMA python , intake , cmip6 , clef	0	62	8 September 2025
Clef error when searching for local data General nci , help , cmip6 , hh5 , clef	5	89	14 January 2025
How to put new CMIP data onto gadi? Technical help , model-evaluation , cmip	3	116	18 February 2025
Using intake catalog to pull CMIP models that match multiple criteria Technical python , model-evaluation , med	9	465	23 January 2023

Issues using CLeF on gadi to find CMIP6 runs

Related topics