Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature 1695 ensemble single file (ensemble_stat) #2007

Merged
merged 57 commits into from
Jan 14, 2022

Commits on Dec 28, 2021

  1. Configuration menu
    Copy the full SHA
    06b2bfb View commit details
    Browse the repository at this point in the history
  2. per #1695, added logic to replace value set in environment variable M…

    …ET_ENS_MEMBER_ID into strings that are read from the config
    georgemccabe committed Dec 28, 2021
    Configuration menu
    Copy the full SHA
    c64f718 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    02d27c0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f399191 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2021

  1. Configuration menu
    Copy the full SHA
    d779e0f View commit details
    Browse the repository at this point in the history
  2. read ens_member_ids and control_id from config file, pass number of e…

    …nsemble found into process_config to perform error checking with ens_member_ids and create list of VarInfo pointers based on number of files and member IDs to be consistent between cases that read multiple files and a single file
    georgemccabe committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    0f81e60 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    44370e1 View commit details
    Browse the repository at this point in the history
  4. per #1695, created a structs to hold field info, file info, nc_var_st…

    …r, cat_ta, and nc_info for each field to process. Loop over these structs and pass them to functions to process ensembles instead of passing indices. Added logic to read ens_member_ids and substitute values into field info to read multiple fields from a single file
    georgemccabe committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    ecc6f2f View commit details
    Browse the repository at this point in the history
  5. remove unused variable

    georgemccabe committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    a2e5ac8 View commit details
    Browse the repository at this point in the history
  6. changed return value of string_value function from ConcatString* to C…

    …oncatString (it is always dereferened) to make it easier to substitute values into strings
    georgemccabe committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    1951290 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    a7e2449 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    868e78b View commit details
    Browse the repository at this point in the history
  9. added GitHub Actions workflow to build a Docker image and push it to …

    …DockerHub to be used for testing METplus use cases
    georgemccabe committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    8071aec View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    4d7cadd View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2021

  1. renamed files to be more clear of their purpose, added groups for Git…

    …Hub Actions logs for tasks that produce a lot of output
    georgemccabe committed Dec 30, 2021
    Configuration menu
    Copy the full SHA
    3c94663 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    be60222 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    500bd08 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    fe74c21 View commit details
    Browse the repository at this point in the history
  5. changed automation logic to only trigger on develop branch (for now) …

    …and push to dtcenter/met repository
    georgemccabe committed Dec 30, 2021
    Configuration menu
    Copy the full SHA
    201aeda View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2022

  1. Configuration menu
    Copy the full SHA
    de1cedf View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1a033ae View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f2f5a46 View commit details
    Browse the repository at this point in the history
  4. create class to hold ensemble var info, use class functions to obsfus…

    …cate logic to get correct VarInfo objects, store raw name/level 'magic string' before env var substitution, store reference to file list into EnsVarInfo to get file to use easily
    georgemccabe committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    ef81fb0 View commit details
    Browse the repository at this point in the history
  5. formatting

    georgemccabe committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    c028a16 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    399f28f View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4bf7a56 View commit details
    Browse the repository at this point in the history
  8. unset MET_ENS_MEMBER_ID before reading config because otherwise value…

    …s will not be parsed properly if it is set by the user
    georgemccabe committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    afd74c6 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    a500c77 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2022

  1. Configuration menu
    Copy the full SHA
    62d38a9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    246b048 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bc084c9 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a43fac0 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2022

  1. Configuration menu
    Copy the full SHA
    be623ff View commit details
    Browse the repository at this point in the history
  2. per #1695, added unit tests for single file gen_ens_prod runs on NetC…

    …DF and GRIB2 data with and without a control member
    georgemccabe committed Jan 6, 2022
    Configuration menu
    Copy the full SHA
    4cc6492 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2f23dd0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b99b35f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    1cc8d48 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    5262be2 View commit details
    Browse the repository at this point in the history
  7. fixed typos

    georgemccabe committed Jan 6, 2022
    Configuration menu
    Copy the full SHA
    1767614 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    c0f1b8f View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2022

  1. Configuration menu
    Copy the full SHA
    164e607 View commit details
    Browse the repository at this point in the history
  2. per #1695, moved EnsVarInfo class up to library with VarInfo so it ca…

    …n also be used by EnsembleStat. Created subclass of EnsVarInfo for GenEnsProd that stores nc_info for each field
    georgemccabe committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    0b41e52 View commit details
    Browse the repository at this point in the history
  3. per #1695, changed type of fcst_info from VarInfo to EnsVarInfo to st…

    …ore var and file info for each ensemble member. This is needed to support reading all ensembles from a single file
    georgemccabe committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    600fbc3 View commit details
    Browse the repository at this point in the history
  4. per #1695, implement similar logic added to GenEnsProd to handle mult…

    …iple ensembles in a single file for ens dictionary. Added logic to fcst_info handling for each verification task in the same way
    georgemccabe committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    4acd9aa View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c6fc368 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2022

  1. per #1695, fixed logic for handling forecast data to properly include…

    …/exclude control member in verification
    georgemccabe committed Jan 11, 2022
    Configuration menu
    Copy the full SHA
    988c5a4 View commit details
    Browse the repository at this point in the history
  2. per #1695, added 4 unit tests for single input file to EnsembleStat: …

    …With GRIB and NetCDF input data, with and without using a control member
    georgemccabe committed Jan 11, 2022
    Configuration menu
    Copy the full SHA
    dbde68e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8864334 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a447732 View commit details
    Browse the repository at this point in the history
  5. changed error log for valid threshold check to be more clear what it …

    …is comparing by outputting the fraction used in the comparison
    georgemccabe committed Jan 11, 2022
    Configuration menu
    Copy the full SHA
    3c423df View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2022

  1. Configuration menu
    Copy the full SHA
    0a66129 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7be44b0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8b8bfd6 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2022

  1. per #1695, fixed bug when using Python Embedding in EnsembleStat/GenE…

    …nsProd. Function to get raw magic string (before env var is substituted) tries to read the level value which is not set when using Python Embedding
    georgemccabe committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    dde7c57 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ca4303d View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2022

  1. Configuration menu
    Copy the full SHA
    783a846 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8883b58 View commit details
    Browse the repository at this point in the history