Cookbook database on highres model, how can I run though it faster?

Technical
1

Hi there,

I am trying to use cm2 1degree and 1/4degree data:

CM2 database

session_CM2 = cc.database.create_session(‘/g/data/p73/archive/non-CMIP/ACCESS-CM2/CM2.db’)
expt_CM2_025 = ‘cj877’
expt_CM2_1 = ‘bz687’

Then I need to calculate MOC, apply EOF on the Pacific region SST and save the data. However, that took me more than an hour, and I failed. Is there a smart way to do it?

Regards,

Arnold

2

Second OM2 database-related issue:

session_OM2 = cc.database.create_session(‘/g/data/ik11/databases/cosima_master.db’)
expt_OM2_025 = ‘025deg_jra55_ryf9091_gadi’
expt_OM2_1 = ‘1deg_jra55_ryf9091_gadi’

vName=‘u’
u50_OM2_025 = cc.querying.getvar(expt=expt_OM2_025, variable=vName,
session=session_OM2, frequency=‘1 monthly’,
attrs={‘cell_methods’: ‘time: mean’},
start_time=‘1951-01-01 00:00:00’,
end_time=‘2000-12-31 00:00:00’)

somehow I got this error message:
“VariableNotFoundError: No files were found containing ‘u’ in the ‘025deg_jra55_ryf9091_gadi’ experiment”

Not sure where did wrong. I can find u is under ocean.nc …

3

There are some issues with the CM2 data that make it very slow to process, and I believe it has to do with the number and structure of the variables, but @dougiesquire knows more of the detail so he might be able to tell you more.

1 Like
4

ocean.nc is yearly output so this call won’t pick it up due to the frequency input. It looks like there might not be any monthly output for u in this run. It’s RYF, so if you want the data feel free to extend the run (or I can do it if you need it)?

2 Likes
5

Arnold, I don’t know if you know about it but the COSIMA Cookbook also has a Data Explorer that allows you to find which experiments have what outputs.

This way you can either check that the experiment you are interested in has the variables you need. Or inversely, which experiments have the variables you need.

2 Likes
6

Yes, there are issues with those CM2 files that make them very slow to process. There’s some info here. The issue is not with the cookbook.

We’re working on a way to make those files more usable, but it’s not ready yet - hopefully soon though!

2 Likes
7

Hmmmmm, the CM2 database contains CICE, ATM, and OCN. SST can be found in both CICE and ocean models. However, to obtain data from the atmosphere model, one needs to deal with the stash code and map it to the data, which can take a considerable amount of time. Thank you, guys!