Update Develop-ref after #1153 #1184

…on web server so develop-ref can check for new develop data

… dictionaries in GridStat (#858)

…nger used

…ip instead of custom version, added info to contrib guide about CI

Co-authored-by: George McCabe <[email protected]>

* Added section for ReadTheDocs, added basic info about the Release Guide and Verification Datasets Guide, but more information on those needs to be added later * Added information about the various versions available in the documentation * Updated the ReadTheDocs section with information on hidden branches and how to access them; Modified dtcenter.github.io references * Added section to add_use_case.rst about Accessing the Documentation and modified documentation.rst to indicate the docs can still be built manually * Modified format of list * Modified formatting * Changed GitHub Pages links to Read the Docs links * Modified formatting * Fixed typo * Updated Release Guide for Read The Docs * Took out duplicate data and consolidated sections * Update docs/Contributors_Guide/add_use_case.rst Removed sentence Co-authored-by: George McCabe <[email protected]> * Update docs/Contributors_Guide/add_use_case.rst Fixed typo Co-authored-by: George McCabe <[email protected]> * Update docs/Contributors_Guide/add_use_case.rst Removed end of previously removed sentence. Co-authored-by: George McCabe <[email protected]> Co-authored-by: George McCabe <[email protected]>

…push this change to all the METplus repos.

…ed to all the METplus-related repos.

…of OS

Co-authored-by: George McCabe <[email protected]>

Co-authored-by: johnhg <[email protected]> Co-authored-by: George McCabe <[email protected]>

Co-authored-by: George McCabe <[email protected]>

…elease notes. Updating release notes should occur before merging the release branch.

* Test latex_* settings in conf.py * Test latex_* settings in conf.py * Formatting in rst files for PDF * Formatting in rst files for PDF * Formatting in rst files for PDF * Test rst file change for PDF formatting * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Test TOC settings * Test TOC settings * Test TOC settings * Test reference section * Test reference section * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Remove local pdf build lines * Test quick search mods for PDF * Test quick search mods for PDF * Update quicksearch.rst Format HTML and PDF separately * Update quicksearch.rst Fix typo in "only" directive * Update quicksearch.rst Fix typos in latex formatting * Fix typo in quicksearch.rst * Update systemconfiguration.rst * Update conf.py Address: WARNING: The config value `latex_show_pagerefs' has type `str', defaults to `bool'. * Update conf.py Fix typo, change master_doc variable to address warning * Update conf.py * Update conf.py * Update conf.py * Update conf.py Test changing the root doc for PDF * Update conf.py Change latex_master_doc back to Users Guide Co-authored-by: Keith Searight <[email protected]>

…ges for the other repos. For each release type, after the checkout_[develop|main]_branch.rst step, add a call to the new create_release_feature_branch.rst release step.

… METcalcpy, METplotpy, METdatadb, METviewer, and METexpress.

Old configuration file

Co-authored-by: Hank Fisher <[email protected]> Co-authored-by: George McCabe <[email protected]> Co-authored-by: MET Tools Test Account <[email protected]> Co-authored-by: George McCabe <[email protected]>

Co-authored-by: Julie.Prestopnik <[email protected]>

Added entry for completion date for pull request review.

* Add a direct link for the user's guide citation and then link to it from the top-level list of authors. * Add a release_steps/rotate_authorship.rst step and update the official release instructions for MET, METcalcpy, METplotpy, and METplus. The other repos do not include a complete set of release instructions yet. * Change top-level authorship list to alphabetical order. * Define author_list in docs/conf.py and reference it in the citation. * Adding author_list to the variables to be exported.

…p to upload warnings artifact if there was a failure

…h instead of specific branch so users don't see accidental breaks in develop branch and we don't need to update it for each release

…xternals.cfg to avoid duplicate information

…ges to release branch to avoid having to change develop branch back to original content

…thing breaks!

Co-authored-by: Julie.Prestopnik <[email protected]> Co-authored-by: Lisa Goodrich <[email protected]>

* added test to recreate error, then fix it * ci-run-diff

Co-authored-by: jprestop <[email protected]> Co-authored-by: bikegeek <[email protected]>

Co-authored-by: John Halley Gotway <[email protected]>

…reporting a failure

… to remove failed check

… releases.

…_releases

…n releases.

…it is clear why it fails or if is succeeds

…ing -ref branch to generate truth data for testing

…Tcalcpy (#927)

… directory for the next upcoming release and create symbolic links to the correct files from previous releases

METexpress release guide

…when installing as a package

…develop branch.

Adding GitHub Discussions info

…s as well as one for requestor: NASA/other.

…sed in copyright

…d to run in the logs

* Modification to use NaturalEarth shapefiles that are already downloaded and saved to file in location designated by the CARTOPY_DIR environment. * Github Issue #933 Check for CARTOPY_DIR first, if unset, then proceed as before. * updated documentation for offline systems * Updated docs based on feedback Co-authored-by: Minna Win <[email protected]>

* Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo Co-authored-by: Julie.Prestopnik <[email protected]>

Co-authored-by: Daniel Adriaansen <[email protected]>

Co-authored-by: George McCabe <[email protected]>

…mbed base to a script so it can be called on a local machine to create these environments

…one on conda for a shared version

… a local machine

* Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo * Per #963, removed replace directive since it is not being used * Per #963, testing change to Note section for keywords * Per #963, Testing return in note * Per #963, removed note section under keywords and moved down the png name. * Per #963, trying out various formatting options * Per #963, trying out various formatting options * Per #963, added additional keywords headers to get a better feel for what it would actually look like * Added numbers to keywords for easier referencing * Per #963, cleaned up examples and left with the formatting the team chose * Per #963, try out adding a code block around a sphinx_gallery_thumbnail_path to see if it disappears because remove_config_comments was already set to True in the conf.py file, but this only removes configuration comments from code blocks, not from text blocks. * Per #963, trying an additonal comment to eliminate sphinx_gallery_thumbnail_path * Per #963, removing additonal comment to eliminate sphinx_gallery_thumbnail_path because it got rid of the thumbnail image * Per #963, adding py to code-block to see if it eliminates sphinx_gallery_thumbnail_path * Per #963, removing the code-block because it does not get rid of sphinx_gallery_thumbnail_path * first attempt at note update without web links * updating keywords area * updating keywords area * updating keywords area * adding quick search link * fixing quick search link * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * deleting empty spaces * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * Changed ASCII2NC to ASCII2NCToolUseCase * Modified list of keywords * Fixed typo Co-authored-by: Julie.Prestopnik <[email protected]>

* Per 1833, changing met_help references to Discussions * Per #1833, changed references to [email protected] to Discussions and updated a couple of other links. * Per #956, Fixed typo * Per #956, fixed section referring to Known Issues as suggested by John HG. * Per #956, removed [email protected] reference. Checked to ensure author_email was not being used.

…1013)

* Update Blocking.py Added some comments * Update Blocking.py * Added mpr output * Added MPR output * Updated documentation * Fixed a path * Updates to documentation * call script to populate file list, output file list to output directory instead of under input base * added env file so pytests can run easily on seneca * improved logging readability * moved functions up to parent class so they can be used by UserScript * updated logic to match change to subset_input_files function return value * in run_at_time function loop over custom list and get files for the current run time before running since this function is called only if LOOP_BY=times and does not call the function that handles this -- consider refactoring to move logic for CUSTOM_LOOP_LIST so that it is handled consistently across all wrappers instead of being handled inside each * updated logic for UserScript to use the input dir/template variables to mimic logic in GridDiag to populate a list of files that are relevant for each run time of the use case * always return True from get_all_files for UserScript because handling file lists is optional * modified examples to call a script that checks environment variables and prints out the contents of file lists if they are set -- this better demonstrates how to use UserScript and how to get lists of files into a user's script, ci-run-diff * don't loop to find files if time info is not set * rerun use case that failed * trigger other failing use cases to run * changed name of config variable because name is now a reserved config variable * skip use cases that are no longer failing * Fixed a typo * add skip times logic to function that finds all files to process * added logic to put 'missing' for files that are not found for a given run time (for UserScript) * added an extra lead time to example to demonstrate handling of missing files * added logic to specify label for each input template file list, changed env var from METPLUS_<label> to METPLUS_FILELIST_<label>, changed user script example to find all keys that start with METPLUS_FILELIST_ to print * added a label to demonstrate functionality * added new config variables, ci-run-diff * added documentation for new functionality for UserScript wrapper to find file paths * Updated to use USER_SCRIPT text files * Fixed typo * Cleanup to .conf file * Cleanup to UserScript_obsERA_obsOnly_Blocking.conf * Updates to use the new file listing for UserScript * Cleanup to old python programs * Fixed a typo * change branch for METplotpy to feature branch to test changes * change METplotpy branch to develop since required change was merged into its develop branch * changed use cases back to new = false so they don't run every workflow Co-authored-by: Christina Kalb <[email protected]>

Co-authored-by: George McCabe <[email protected]> Co-authored-by: George McCabe <[email protected]> Co-authored-by: George McCabe <[email protected]>

…contain output truth data

Co-authored-by: George McCabe <[email protected]>

* Added output MPR file for Blocking * Cleanup and edits to creating mpr output * Fixed a typo * Added mpr output * Fixed a typo * Updated to use environment vars * Updates to blocking documentation * Delete conf file that was accidentally checked in * removed unused scripts Co-authored-by: George McCabe <[email protected]>

Co-authored-by: Christina Kalb <[email protected]> Co-authored-by: Minna Win <[email protected]> Co-authored-by: bikegeek <[email protected]> Co-authored-by: Christina Kalb <[email protected]> Co-authored-by: Hank Fisher <[email protected]> Co-authored-by: George McCabe <[email protected]>

* changed version for beta1 release * added release notes for 4.1.0-beta1 * removed unnecessary arguments to run_metplus.py * removed release notes item that is pushed to next beta * added line breaks between sections * added OMI and RMM use cases

Co-authored-by: George McCabe <[email protected]>

…s removed

…mary so it is easier to find

* fixed remove_quotes logic for handling config lists to only remove quotes around each value, not every quotation mark found -- changed logic for reading climo field to remove quotes around item to properly set dictionary items, ci-run-diff * fixed unit tests to reflect actual values to set for climo field

…ting release to minimize time that development will be done with the incorrect version number

Co-authored-by: Christina Kalb <[email protected]> Co-authored-by: Minna Win <[email protected]> Co-authored-by: bikegeek <[email protected]> Co-authored-by: Christina Kalb <[email protected]> Co-authored-by: Hank Fisher <[email protected]>

…the util directory is refactored

…moved to prevent confusing errors that will result

…searched to help debugging

* Per #935, made updates to Release Guide * Per #935, made updates to Release Guide Co-authored-by: Julie Prestopnik <[email protected]>

… file

…ETplus into develop

…documentation changes have been made

* Per #874, added information for the Release Guide and Verification Dataset Guide * Per #874, change to fix Unexpected indentation warning. * Added lines to only build documentation for pull requests where only documentation changes have been made Co-authored-by: Julie Prestopnik <[email protected]>

Testing addition of new default labels

Fixing syntax issue with addition of new default labels

Reverting to original text before changes made for addition of labels.

…flags

Co-authored-by: George McCabe <[email protected]>

* Moved create_release_extra.rst into the release_steps area as all components except for METplus use the same file; Added instructions to update_dtc_website.rst * Removed text that was not supposed to be there. * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <[email protected]> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <[email protected]> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <[email protected]> * Removed specific versions of update_dtc_website since they did not differ from the version in release_steps * Added variable - otherWebsiteUpdates - and its value. Co-authored-by: Julie Prestopnik <[email protected]> Co-authored-by: johnhg <[email protected]>

…a release note step about formatting major/important changes in bold.

* Per #1067, modified installation instructions and system configuration to point to installation instructions for MET * removed RTD python package requirements since they are already installed by RTD - fixes issue where bulleted lists bullets disappeared Co-authored-by: Julie Prestopnik <[email protected]> Co-authored-by: George McCabe <[email protected]>

…e update_release_notes files

* removed config variable that is no longer used/needed * cleaned up functions that handle setting CURRENT_[FCST/OBS]_[NAME/LEVEL] * clean up * expand path of config argument to run_metplus.py for easier debugging * removed redundant logic and added comments * cleanup * added logic to move config variables that are runtime specific to a [runtime] section in the final conf that is written after the run completes * changed how config arguments are read so that order that arguments are found is preserved instead of setting explicit overrides at the end * minor change to trigger build, ci-run-all-cases * rearranged logic to save list of config inputs with full paths for easier debugging * move all config vars that start with LOG or end with BASE to runtime section * remove vars that start with CURRENT from final conf * removed confusing logic allowing override of parm base and cleaned up logging to be easier to read/understand * added METPLUS_PARM_BASE env var logic back * added old vs. new default value mismatch info for pb_report_type in PB2NC config file * renamed config var name * use PARM_BASE instead of METPLUS_BASE/parm since it will still be set * use develop version of METviewer docker image (may need to make this configurable in testing.yml in the future) * run cyclone plotter use case to test that new conda environment in docker image now contains missing cartopy map files * added dockerfile to copy cartopy shape files into run image if cartopy is listed as dependencies * download script used to download cartopy shape files and run it * added copy of conda environment * added logic to download cartopy shape files for metplotpy environment * added cartopy dependency to use cases so the shapefiles are copied into run environment * trigger 1 use case that uses metplotpy_env to test cartopy shapefiles are found properly * added instructions to create weatherregime environment that was missing * cleaned up list of packages used * removed extra use case group used for testing * removed netcdf package from env because it is already installed and version number was causing a conflict * added cartopy shapefile copy to use case that needs it * download cartopy shape files for weatherregime python environment because files were not found from base env (metplotpy) * removed debug message that fills up log files with info that is not very useful * updated input directories to use _WeatherRegime directory instead of _Blocking * updated location of input data that was not found in UserScript_fcstGFS_obsERA_WeatherRegime * updated readme with info on how to install metplotpy/metcalcpy in conda environments * added 3rd group of cartopy shapefiles to download because they are used in weatherregime use cases * try using cartopy download script from forked repo that has missing shapefile zip file added * updated input paths to match new data locations

Co-authored-by: George McCabe <[email protected]>

* files for new use case * added new use case and mod files * upping verbosity for debug * more debugging * spelling fix * testing for climo issues * readded climo, changed python3 call in script * skip docker pull because docker create command will pull if needed, print full name of data volume used for easier debugging, no longer pass docker create command output to /dev/null because logic is no longer called from shell script (previously value was passed to script via std out so any logging info would be added to content) * moved new use case to its own section for testing * fixed typo * added PyEmbedIngest to process fcst/obs/climo data and read files into grid_stat to prevent out-of-memory errors * refactored script to try to reduce the amount of unnecessary memory the script uses * created config file to use PyEmbedIngest so use case can run as is on a machine with enough memory and run a modified version to work with the automated tests * removed use case from test suite because it uses more memory than the docker environment has available * removed old info * rearranged variables for readability, removed commented out variables Co-authored-by: George McCabe <[email protected]>

Commits on Apr 28, 2021

Added argument to code-blocks

jprestop committed Apr 28, 2021

Configuration menu

View commit details

Copy full SHA for 52abfaa

Browse repository at this point

Copy the full SHA

52abfaa View commit details

Browse the repository at this point in the history

Commits on Jul 2, 2021

fixed typo in doc

georgemccabe committed Jul 2, 2021

Configuration menu

View commit details

Copy full SHA for 9d6fd0e

Browse repository at this point

Copy the full SHA

9d6fd0e View commit details

Browse the repository at this point in the history

Commits on Jul 15, 2021

feature 986 TCPairs valid time (#997 )

georgemccabe authored Jul 15, 2021

Configuration menu

View commit details

Copy full SHA for 858eca8

Browse repository at this point

Copy the full SHA

858eca8 View commit details

Browse the repository at this point in the history

Update Develop-ref after #1153 #1184

Update Develop-ref after #1153 #1184

Commits on Mar 25, 2021

Commits on Mar 30, 2021

Commits on Mar 31, 2021

Commits on Apr 1, 2021

Commits on Apr 6, 2021

Commits on Apr 7, 2021

Commits on Apr 8, 2021

Commits on Apr 12, 2021

Commits on Apr 13, 2021

Commits on Apr 14, 2021

Commits on Apr 15, 2021

Commits on Apr 19, 2021

Commits on Apr 21, 2021

Commits on Apr 23, 2021

Commits on Apr 26, 2021

Commits on Apr 27, 2021

Commits on Apr 28, 2021

Commits on Apr 29, 2021

Commits on May 3, 2021

Commits on May 4, 2021

Commits on May 5, 2021

Commits on May 6, 2021

Commits on May 7, 2021

Commits on May 10, 2021

Commits on May 11, 2021

Commits on May 12, 2021

Commits on May 17, 2021

Commits on May 18, 2021

Commits on May 19, 2021

Commits on May 20, 2021

Commits on May 24, 2021

Commits on May 27, 2021

Commits on Jun 1, 2021

Commits on Jun 2, 2021

Commits on Jun 18, 2021

Commits on Jun 23, 2021

Commits on Jun 24, 2021

Commits on Jun 25, 2021

Commits on Jun 30, 2021

Commits on Jul 1, 2021

Commits on Jul 2, 2021

Commits on Jul 6, 2021

Commits on Jul 8, 2021

Commits on Jul 15, 2021

Commits on Jul 20, 2021

Commits on Jul 21, 2021

Commits on Jul 22, 2021

Commits on Jul 26, 2021

Commits on Jul 27, 2021

Commits on Jul 29, 2021

Commits on Aug 2, 2021

Commits on Aug 10, 2021

Commits on Aug 11, 2021

Commits on Aug 12, 2021

Commits on Aug 16, 2021

Commits on Aug 20, 2021

Commits on Aug 24, 2021

Commits on Aug 25, 2021

Commits on Aug 26, 2021

Commits on Aug 30, 2021

Commits on Aug 31, 2021

Commits on Sep 1, 2021

Commits on Sep 2, 2021

Commits on Sep 10, 2021

Commits on Sep 15, 2021

Commits on Sep 16, 2021

Commits on Sep 29, 2021

Commits on Sep 30, 2021