Topics for ESMValTool workshop in November

[axel-lauer]

Dear ESMValTool developers,

During the last monthly ESMValTool meeting (#1801), the idea came up to have another ESMValTool workshop this year. At the moment, this would probably be a remote workshop, similar to the one we had in March 2020. Here, I would like to collect possible topics for our next workshop. Ideas for topics could be (but are not limited to):

ESMValCore

• new features
• improvement of existing features
• automatisation (testing, downlading and processing of observations)
• support for native model output (e.g. EMAC, EC-Earth)
• documentation

ESMValTool

• new diagnostics
• new plot types
• new observations
• documentation

Please add the topics you would like to address / discuss at our next workshop here:

ESMValCore / ESMValTool:

• work on open pull requests
• introduce ESMValTool tutorial
• pull requests: document guidelines for scientific reviews
• status and plans for automated testing
• t.b.d.

[bouweandela]

I would like to propose that we work on getting many of the currently open pull requests merged or closed with everybody happy about the outcome. A lot of work has gone into creating these pull requests, so it would be great if we could finalize it. Having (part of) a week where we all work together, could really help to get these across the finish line!

Here is a list (authors are in no particular order):

@hb326 opened:

• added fix for WACCM ua time coordinate ESMValCore#200

@valeriupredoi opened:

• Installing esmvalcore on OSX ESMValCore#208
• Development dry run ESMValCore#307
• Test module for _main.py with different run scenarios ESMValCore#496
• Improving test coverage for _task.py ESMValCore#514
• Preprocessor module to compute and store ACSIS indicators ESMValCore#638
• set the multiprocessing distribution method from getgoing ESMValCore#786
• Replace vmprof with vprof ESMValCore#780
• Annual statistic on yearly chunks to keep memory low ESMValCore#792
• Adding relevant debug messages #874
• Python cmorizer for CSIRO #878
• Added safe environment #1255
• Install on OSX #1257
• added optimal install instructions for install from conda #1675

@BenMGeo opened:

• Check horizontal grid before regridding ESMValCore#507

@jvegasbsc opened:

• Add ocean heat transport components as derived variables ESMValCore#217
• Distinguish between out_name and var_name ESMValCore#391
• Improve variable alias managament ESMValCore#595
• Add preprocessor function to resample time and compute x-hourly statistics ESMValCore#696
• Update CMIP6 tables to 6.9.32 ESMValCore#706
• Improve command line run documentation ESMValCore#721
• Allow selection of shapes in extract_shape ESMValCore#764
• Add blocking diagnostic for PRIMAVERA #659
• Use cmor_name instead of out_name #1493
• Streamline observations download #1657 (related to Remove _obs_ from cmorizers  #1665 by @mattiarighi and Make allobsutilitiesfuncs public #1646 by @valeriupredoi)

@zklaus opened:

• WIP: Version2 preprocessor extract bottom layer ESMValCore#74
• Add SYNDA drs for CMIP5 and CMIP6 (closes #582) ESMValCore#583

@ledm opened:

• Global Total Integrated primary production derived variable ESMValCore#270
• Fix bad parent_time_units for UKESM1-0-LL ESMValCore#274
• Fix area tiling issue with fx files in area_statistics, added calculate_grid option, added several unit tests to area statistics, clarified several exceptions in area_statistics ESMValCore#446
• Added weightless_mean, weightless_sum operators to volume_statistics preprocessor ESMValCore#456
• Development ocean scalar fields #1331
• Updates of ocean diagnostics and recipes for GMD-2019-291 (ESMValTool Part II paper) #1621

@mwjury opened:

• Add possibility of custom season extraction. ESMValCore#247
• Fix for FGOALS-f3-L sftlf ESMValCore#667

@jvegasbsc and @mwjury @aperezpredictia and @zklaus worked on:

• Add general CORDEX coordinate boundary fix ESMValCore#184
• Adapt regridding to CORDEX needs ESMValCore#185

@ValerioLembo opened:

• Update recipe_thermodyn_diagtool.yml: code improvements and more user options #1391

@JaroCamphuijsen, @Peter9192, @ruthlorenz

• Implement the climwip weighting scheme in a recipe and diagnostic #1648

@schlunma opened:

• Fix units after derivation ESMValCore#754
• Add trend preprocessor ESMValCore#759
• Added preprocessor mask_multimodel ESMValCore#767
• Updated derivation test recipe #1790

@bettina-gier opened

• support for multiple model occurrence in perf main #1649 needs a review from @zklaus

@pcosbsc opened:

• Add RMS iris analysis operator to statistics preprocessor functions ESMValCore#747

@koldunovn opened:

• fix for thetao and so variables in BCC models ESMValCore#749
• Working with unstructured ocean AWI-CM data ESMValCore#752

@sloosvel opened:

• CMOR check generic level coordinates in CMIP6 ESMValCore#598
• Add ensemble statistics preprocessor and 'groupby' option for multimodel ESMValCore#673
• Add surface chlorophyll concentration as a derived variable ESMValCore#720
• Add PRIMAVERA Eady Growth Rate diagnostic #1285
• PRIMAVERA Energy budget #1286

@Peter9192 opened:

• Simplify time handling in multi-model statistics preprocessor ESMValCore#685

@egalytska opened:

• fix siconca variable in EC-Earth3 and EC-Earth3-Veg models in amip simulation ESMValCore#702

@bascrezee opened:

• Add custom variable lweGrace ESMValCore#692
• cmorizer for GRACE data #1694

@axel-lauer opened:

• Improve ACCESS-CM2 and ACCESS-ESM1-5 fixes and add CIESM and CESM2-WACCM-FV2 fixes for cl, clw and cli ESMValCore#635

@bouweandela opened:

• Clip irregular grids ESMValCore#245
• Idea for extract_levels check ESMValCore#262
• Run multiple recipes, add tmp_dir, disable stack trace for RecipeErrors ESMValCore#265
• Add support for downloading CMIP6 data with Synda ESMValCore#699
• Fix crash for FGOALS-g2 variables without longitude coordinate ESMValCore#729
• Add more info on documenting a recipe #1795
• Update esmvaltool run command everywhere in documentation #1820

@bjoernbroetz opened:

• Add cmorizer for COBE-SST2 dataset. #1784
• Add cmorizer scripts for NOAA-ERSST. #1799

@LisaBock opened:

• Update WOA cmorizer for WOA18 and WOA13v2 #1812

Could this be a plan? Does anyone have more ideas? @ESMValGroup/esmvaltool-developmentteam

[valeriupredoi]

thank you for putting this together @bouweandela 🍺 - it's a very good idea and I will be there (sad it's not near a Bavarian beer garden but such is pandemic life); I've added a couple more PR's under me name in your list - specially the dependency and solving the OSX install and portability are important!

[nielsdrost]

I really like the idea of focusing on getting PRs merged! How do we prioritize? Oldest first?

[axel-lauer]

Another topic could be a brief summary of the work done for the ESMValTool tutorial.

[axel-lauer]

A first draft agenda is now available for comments and feedback: #1866