Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERA5 CMORization by recipe #1432

Merged
merged 26 commits into from
Feb 13, 2020
Merged
Show file tree
Hide file tree
Changes from 24 commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
06fc583
ERA5 CMORization by recipe
bouweandela Nov 7, 2019
65f4d05
remove sum operator
Peter9192 Jan 8, 2020
908cc85
"Add documentation"
Peter9192 Jan 22, 2020
6822a6f
Merge remote-tracking branch 'origin/master' into era5_cmorizer_recipe
Peter9192 Jan 22, 2020
4cec24e
update era5 cmorizer recipe
Peter9192 Jan 22, 2020
2101f5a
Fix documentation build
Peter9192 Jan 29, 2020
3d9b118
Sort variables alphabetically and extend monthly diagnostic
Peter9192 Jan 29, 2020
6fdda20
Add renaming diagnostic
Peter9192 Jan 31, 2020
75bdb2a
Rename daily output and clean up recipe
Peter9192 Jan 31, 2020
c2a2a50
Restore recipe_check_obs
Peter9192 Feb 4, 2020
1fbdfe4
Fixed bug in loop and basename
jeromaerts Feb 4, 2020
8ca3cfa
Merge branch 'era5_cmorizer_recipe' of https://github.com/ESMValGroup…
jeromaerts Feb 4, 2020
a023879
Merge branch 'master' into era5_cmorizer_recipe
mattiarighi Feb 5, 2020
9d4f91f
Remove double entry introduced by merge
mattiarighi Feb 5, 2020
a5a6a1b
Update esmvaltool/recipes/cmorizers/recipe_era5.yml
Peter9192 Feb 5, 2020
10b9323
Remove unavailabe montly vars and uncomment
Peter9192 Feb 6, 2020
da50f54
Fix codacy issue
mattiarighi Feb 6, 2020
ef4baaf
Add entries for all supported projects
mattiarighi Feb 6, 2020
531b69e
Clean up recipe and add diag logger
Peter9192 Feb 6, 2020
7fbbb5c
Remove ERA5 cmorizer script
bouweandela Feb 6, 2020
587789a
Merge branch 'era5_cmorizer_recipe' of https://github.com/ESMValGroup…
Peter9192 Feb 7, 2020
6cb8b4e
Add first day from next year
Peter9192 Feb 7, 2020
cda6a69
Don't try to replace years in fx files
Peter9192 Feb 10, 2020
560f3b1
Lookup new mip in tables
Peter9192 Feb 12, 2020
c4d0251
Require at least v2.0.0b6 of ESMValCore
bouweandela Feb 12, 2020
d16621c
Merge branch 'master' into era5_cmorizer_recipe
bouweandela Feb 13, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions config-user-example.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,14 @@

# Rootpaths to the data from different projects (lists are also possible)
rootpath:
CMIP3: [~/cmip3_inputpath1, ~/cmip3_inputpath2]
CMIP5: [~/cmip5_inputpath1, ~/cmip5_inputpath2]
CMIP6: [~/cmip6_inputpath1, ~/cmip6_inputpath2]
OBS: ~/obs_inputpath
OBS6: ~/obs6_inputpath
obs4mips: ~/obs4mips_inputpath
ana4mips: ~/ana4mips_inputpath
native6: ~/native6_inputpath
RAWOBS: ~/rawobs_inputpath
default: ~/default_inputpath

Expand Down
8 changes: 8 additions & 0 deletions doc/sphinx/source/esmvaldiag/observations.rst
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,14 @@ data set for the use in ESMValTool.
| `6. Naming convention of the observational data files`_
| `7. Test the cmorized dataset`_

.. note::
**CMORization as a fix.** As of early 2020, we've started implementing cmorization as
*fixes*. As compared to the workflow described below, this has the advantage that
the user does not need to store a duplicate (CMORized) copy of the data. Instead, the
CMORization is performed 'on the fly' when running a recipe. **ERA5** is the first dataset
for which this 'CMORization on the fly' is supported. For more information about fixes,
see: :ref:`fixing data <esmvalcore:fixing_data>`


1. Check if your variable is CMOR standard
==========================================
Expand Down
108 changes: 0 additions & 108 deletions esmvaltool/cmorizers/obs/cmor_config/ERA5.yml

This file was deleted.

227 changes: 0 additions & 227 deletions esmvaltool/cmorizers/obs/cmorize_obs_era5.py

This file was deleted.

Loading