Update the database schema to handle new columns added to the MET-11.0.0-beta1 output.

[JohnHalleyGotway]

Describe the Enhancement

Several new columns of "stat" output were added to the output of MET version 11.0.0-beta1. This issue is to update the database schema to handle these changes.

• Issue Allow 2x2 HSS calculations to include user-defined EC values MET#2147:

  • Adds EC_VALUE to the end of the CTC line type
    • Value between 0.0 and 1.0 to indicate the expected correct rate
    • Fill existing CTC tables with a default EC_VALUE of 0.5
    • Only aggregate CTC tables where the EC_VALUE remains constant
  • Adds 4 new columns to the end of the CTS line type: HSS_EC HSS_EC_BCL HSS_EC_BCU EC_VALUE
    • HSS_EC is the Heidke Skill Score using the user-configurable expected correct rate. See details in Appendix C.
    • The _BCL and _BCU columns are the bootstrap CI limits.
    • The EC_VALUE is as described in the CTC column. Don't see a need to actually plot this.

• Issue Add Anomaly Correlation Coefficient to VCNT Line Type MET#2022:

  • Adds 2 columns to the end of the VAL1L2 line type: FA_SPEED_BAR and OA_SPEED_BAR
    • These correspond to the VL1L2 line type's F_SPEED_BAR and O_SPEED_BAR columns but for the anomalies (F-C and O-C) instead
  • Adds 8 new columns to the end of the VCNT line type:
  • Centered Anomaly Correlation with normal and bootstrap CI's
    • ANOM_CORR, ANOM_CORR_NCL, ANOM_CORR_NCU, ANOM_CORR_BCL, ANOM_CORR_BCU
  • Uncentered Anomaly Correlation with bootstrap CI's
    • ANOM_CORR_UNCNTR ANOM_CORR_UNCNTR_BCL ANOM_CORR_UNCNTR_BCU

Time Estimate

Estimate the amount of work required here.
Issues should represent approximately 1 to 3 days of work.

Sub-Issues

Consider breaking the enhancement down into sub-issues.
No sub-issues needed.

Relevant Deadlines

List relevant project deadlines here or state NONE.

Funding Source

Define the source of funding and account keys here or state NONE.

Define the Metadata

Assignee

• Select engineer(s) or no engineer required: @venitahagerty
• Select scientist(s) or no scientist required: Please ask @JohnHalleyGotway if questions arise

Labels

• Select component(s)
• Select priority
• Select requestor(s)

Projects and Milestone

• Select Repository and/or Organization level Project(s) or add alert: NEED PROJECT ASSIGNMENT label
• Select Milestone as the next official version or Future Versions

Define Related Issue(s)

Consider the impact to the other METplus components.

• METplus, MET, METdatadb, METviewer, METexpress, METcalcpy, METplotpy
• METviewer issue to plot this data: Plot new columns added to the MET-11.0.0-beta1 output. METviewer#403

Enhancement Checklist

See the METplus Workflow for details.

• Complete the issue definition above, including the Time Estimate and Funding Source.
• Fork this repository or create a branch of develop.
  Branch name: feature_<Issue Number>_<Description>
• Complete the development and test your changes.
• Add/update log messages for easier debugging.
• Add/update unit tests.
• Add/update documentation.
• Push local changes to GitHub.
• Submit a pull request to merge into develop.
  Pull request: feature <Issue Number> <Description>
• Define the pull request metadata, as permissions allow.
  Select: Reviewer(s) and Linked issues
  Select: Repository level development cycle Project for the next official release
  Select: Milestone as the next official version
• Iterate until the reviewer(s) accept and merge your changes.
• Delete your fork or branch.
• Close this issue.

[JohnHalleyGotway]

Please find some recent output from the nightly build of the develop branch posted here:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/MET-11.0.0_data/NB20220706_MET_test_output.tar.gz

[venitahagerty]

Updated the schema, and also the code to read and load the new columns.