Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make signs of fields exported by ATM consistent with positive-down for CMEPS #1807

Merged
merged 49 commits into from
Aug 14, 2023
Merged
Show file tree
Hide file tree
Changes from 46 commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
59670ce
point to feature branchs
DeniseWorthen Jun 21, 2023
ea2ccb4
add HYCOM feature branch
DeniseWorthen Jun 21, 2023
ec659ec
test for tauxy sign changes
DeniseWorthen Jun 21, 2023
c8dcf4d
update CMEPS
DeniseWorthen Jun 21, 2023
91d86eb
commit changes for sensible heat flux
DeniseWorthen Jun 22, 2023
ee65372
add sensible heat changes
DeniseWorthen Jun 22, 2023
4dafbaa
update submodules and fd for evap fields
DeniseWorthen Jun 22, 2023
4dbfe67
update FV3
DeniseWorthen Jun 22, 2023
5760b5a
backup to pre-evap changes to test
DeniseWorthen Jun 22, 2023
54e3c42
update FV3
DeniseWorthen Jun 22, 2023
ceb6b90
Merge branch 'ufs-community:develop' into feature/signs_units
DeniseWorthen Jun 24, 2023
18f6e78
update FV3
DeniseWorthen Jun 26, 2023
34ca4d7
swap signs for latent heat flux used by HYCOM
DeniseWorthen Jun 26, 2023
87c7257
test latent flux change for hycom
DeniseWorthen Jun 26, 2023
fc2ab4f
update FV3
DeniseWorthen Jun 27, 2023
3ec64f9
Merge branch 'develop' into feature/signs_units
DeniseWorthen Jun 27, 2023
5b256cc
update FV3
DeniseWorthen Jun 30, 2023
90f9af0
Merge branch 'develop' into feature/signs_units
DeniseWorthen Jun 30, 2023
8b11497
update FV3, CMEPS
DeniseWorthen Jul 7, 2023
6342808
Merge branch 'develop' into feature/signs_units
DeniseWorthen Jul 7, 2023
f767818
remove temporary file
DeniseWorthen Jul 7, 2023
49a1e9f
update FV3
DeniseWorthen Jul 24, 2023
2ff0ec7
Merge remote-tracking branch 'origin/develop' into feature/signs_units
DeniseWorthen Jul 24, 2023
094de8f
update FV3
DeniseWorthen Jul 25, 2023
4a33043
Merge remote-tracking branch 'origin/develop' into feature/signs_units
DeniseWorthen Jul 25, 2023
bb9cb92
update FV3
DeniseWorthen Jul 29, 2023
6e6d092
Merge remote-tracking branch 'origin/develop' into feature/signs_units
DeniseWorthen Jul 29, 2023
c704282
update FV3
DeniseWorthen Jul 31, 2023
b660165
Merge remote-tracking branch 'origin/develop' into feature/signs_units
DeniseWorthen Jul 31, 2023
385732f
Merge branch 'ufs-community:develop' into feature/signs_units
DeniseWorthen Aug 3, 2023
3ec7eac
confirm previous test results
DeniseWorthen Aug 3, 2023
24903ab
Merge branch 'ufs-community:develop' into feature/signs_units
DeniseWorthen Aug 7, 2023
3d3b35e
Update bl_date.conf
FernandoAndrade-NOAA Aug 9, 2023
a9716d4
[AutoRT] jet Job Completed.
epic-cicd-jenkins Aug 10, 2023
0eb8d5f
Remove compare_ncfile.py, use nccmp on wcoss2/acorn
AlexanderRichert-NOAA Aug 1, 2023
52206c3
WCOSS2 RT Log
BrianCurtis-NOAA Aug 10, 2023
2c962fa
Merge branch 'feature/signs_units' of github.com:DeniseWorthen/ufs-we…
BrianCurtis-NOAA Aug 10, 2023
bae30b7
Acorn RT Log
BrianCurtis-NOAA Aug 10, 2023
5546296
Update Dockerfile to add new container image
zach1221 Aug 10, 2023
2819203
add gaea RT logs: passed
zach1221 Aug 10, 2023
5ff9436
add orion RT logs: passed
zach1221 Aug 10, 2023
06d42e5
add hera RT log: passed
FernandoAndrade-NOAA Aug 10, 2023
4d3fe89
update CMEPS
DeniseWorthen Aug 11, 2023
1150167
Revert "update CMEPS"
DeniseWorthen Aug 11, 2023
5323e96
Update rt.conf to turn off failing rrfs qr cases on Cheyenne
zach1221 Aug 14, 2023
99de218
one additional change needed to rt.conf
zach1221 Aug 14, 2023
85154a1
Update rt.conf to align column bars
zach1221 Aug 14, 2023
3165132
add cheyenne RT logs: passed
zach1221 Aug 14, 2023
9a8f089
update components and revert gitmodules
DeniseWorthen Aug 14, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 12 additions & 6 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
[submodule "FV3"]
path = FV3
url = https://github.com/NOAA-EMC/fv3atm
branch = develop
#url = https://github.com/NOAA-EMC/fv3atm
#branch = develop
url = https://github.com/DeniseWorthen/fv3atm
branch = feature/signs_units
[submodule "WW3"]
path = WW3
url = https://github.com/NOAA-EMC/WW3
Expand All @@ -16,12 +18,16 @@
branch = develop
[submodule "CMEPS"]
path = CMEPS-interface/CMEPS
url = https://github.com/NOAA-EMC/CMEPS
branch = emc/develop
#url = https://github.com/NOAA-EMC/CMEPS
#branch = emc/develop
url = https://github.com/DeniseWorthen/CMEPS
branch = feature/signs_units
[submodule "HYCOM"]
path = HYCOM-interface/HYCOM
url = https://github.com/NOAA-EMC/HYCOM-src
branch = emc/develop
#url = https://github.com/NOAA-EMC/HYCOM-src
#branch = emc/develop
url = https://github.com/DeniseWorthen/HYCOM-src
branch = feature/signs_units
[submodule "MOM6"]
path = MOM6-interface/MOM6
url = https://github.com/NOAA-EMC/MOM6
Expand Down
2 changes: 1 addition & 1 deletion FV3
Submodule FV3 updated 1 files
+10 −10 atmos_model.F90
2 changes: 1 addition & 1 deletion HYCOM-interface/HYCOM
Submodule HYCOM updated 1 files
+4 −11 NUOPC/hycom_couple.F90
2 changes: 1 addition & 1 deletion tests/bl_date.conf
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
export BL_DATE=20230804
export BL_DATE=20230809

2 changes: 1 addition & 1 deletion tests/ci/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
From noaaepic/ubuntu20.04-gnu9.3-hpc-stack:v1.2
From noaaepic/ubuntu20.04-gnu9.3-hpc-stack:v2.0

CMD ["/bin/bash"]

Expand Down
25 changes: 0 additions & 25 deletions tests/compare_ncfile.py

This file was deleted.

2,860 changes: 1,463 additions & 1,397 deletions tests/logs/RegressionTests_acorn.log

Large diffs are not rendered by default.

1,655 changes: 786 additions & 869 deletions tests/logs/RegressionTests_gaea.log

Large diffs are not rendered by default.

2,118 changes: 1,059 additions & 1,059 deletions tests/logs/RegressionTests_hera.log

Large diffs are not rendered by default.

1,318 changes: 659 additions & 659 deletions tests/logs/RegressionTests_jet.log

Large diffs are not rendered by default.

1,556 changes: 778 additions & 778 deletions tests/logs/RegressionTests_orion.log

Large diffs are not rendered by default.

3,113 changes: 1,544 additions & 1,569 deletions tests/logs/RegressionTests_wcoss2.log

Large diffs are not rendered by default.

16 changes: 8 additions & 8 deletions tests/rt.conf
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,7 @@ RUN | rrfs_v1beta |
RUN | rrfs_v1nssl | | baseline |
RUN | rrfs_v1nssl_nohailnoccn | | baseline |
RUN | rrfs_smoke_conus13km_hrrr_warm | | baseline |
RUN | rrfs_smoke_conus13km_hrrr_warm_qr | | |
RUN | rrfs_smoke_conus13km_hrrr_warm_qr | - cheyenne | |
DeniseWorthen marked this conversation as resolved.
Show resolved Hide resolved
RUN | rrfs_smoke_conus13km_hrrr_warm_2threads | | |
RUN | rrfs_conus13km_hrrr_warm | | baseline |
RUN | rrfs_smoke_conus13km_radar_tten_warm | | baseline |
Expand All @@ -141,7 +141,7 @@ RUN | rrfs_smoke_conus13km_radar_tten_warm |
#RUN | rrfs_smoke_conus13km_hrrr_warm_restart | | | rrfs_smoke_conus13km_hrrr_warm
# Just to make sure restart doesn't crash again:
RUN | rrfs_smoke_conus13km_hrrr_warm_restart_mismatch | | baseline | rrfs_smoke_conus13km_hrrr_warm
RUN | rrfs_smoke_conus13km_hrrr_warm_restart_qr_mismatch | | | rrfs_smoke_conus13km_hrrr_warm_qr
RUN | rrfs_smoke_conus13km_hrrr_warm_restart_qr_mismatch | - cheyenne | | rrfs_smoke_conus13km_hrrr_warm_qr

COMPILE | csawmg | intel | -DAPP=ATM -DCCPP_SUITES=FV3_GFS_v16_csawmg,FV3_GFS_v16_ras | | fv3 |
RUN | control_csawmg | - gaea.intel | baseline |
Expand Down Expand Up @@ -206,9 +206,9 @@ RUN | hrrr_control_restart_qr_dyn32_phy32 |

COMPILE | rrfs_dyn32_phy32_faster | intel | -DAPP=ATM -DCCPP_SUITES=FV3_RAP,FV3_HRRR -D32BIT=ON -DCCPP_32BIT=ON -DFASTER=ON | | fv3 |
RUN | rrfs_smoke_conus13km_fast_phy32 | | baseline |
RUN | rrfs_smoke_conus13km_fast_phy32_qr | | baseline |
RUN | rrfs_smoke_conus13km_fast_phy32_qr | - cheyenne | baseline |
RUN | rrfs_smoke_conus13km_fast_phy32_restart_mismatch | | baseline | rrfs_smoke_conus13km_fast_phy32
RUN | rrfs_smoke_conus13km_fast_phy32_restart_qr_mismatch | | | rrfs_smoke_conus13km_fast_phy32_qr
RUN | rrfs_smoke_conus13km_fast_phy32_restart_qr_mismatch | - cheyenne | | rrfs_smoke_conus13km_fast_phy32_qr

COMPILE | rrfs_dyn64_phy32 | intel | -DAPP=ATM -DCCPP_SUITES=FV3_RAP,FV3_HRRR -DCCPP_32BIT=ON | | fv3 |
RUN | rap_control_dyn64_phy32 | | baseline |
Expand Down Expand Up @@ -334,7 +334,7 @@ RUN | hrrr_control_restart | + hera cheyenne
RUN | hrrr_control_restart_qr | + hera cheyenne | | hrrr_control_qr
RUN | rrfs_v1beta | + hera cheyenne | baseline |
RUN | rrfs_smoke_conus13km_hrrr_warm | + hera cheyenne | baseline |
RUN | rrfs_smoke_conus13km_hrrr_warm_qr | + hera cheyenne | |
RUN | rrfs_smoke_conus13km_hrrr_warm_qr | + hera | |
RUN | rrfs_smoke_conus13km_hrrr_warm_2threads | + hera cheyenne | |
RUN | rrfs_smoke_conus13km_radar_tten_warm | + hera cheyenne | baseline |
RUN | rrfs_conus13km_hrrr_warm | + hera cheyenne | baseline |
Expand All @@ -343,7 +343,7 @@ RUN | rrfs_conus13km_hrrr_warm | + hera cheyenne
#RUN | rrfs_smoke_conus13km_hrrr_warm_restart | + hera cheyenne | | rrfs_smoke_conus13km_hrrr_warm
# Just to make sure restart doesn't crash again:
RUN | rrfs_smoke_conus13km_hrrr_warm_restart_mismatch | + hera cheyenne | baseline | rrfs_smoke_conus13km_hrrr_warm
RUN | rrfs_smoke_conus13km_hrrr_warm_restart_qr_mismatch | + hera cheyenne | | rrfs_smoke_conus13km_hrrr_warm_qr
RUN | rrfs_smoke_conus13km_hrrr_warm_restart_qr_mismatch | + hera | | rrfs_smoke_conus13km_hrrr_warm_qr

### CCPP DEBUG tests ###
# Exercise compilation without specifying suites (i.e. compile all suites) in DEBUG mode (faster than in PROD mode)
Expand Down Expand Up @@ -383,9 +383,9 @@ RUN | rap_restart_dyn32_phy32 | + hera cheyenne
RUN | hrrr_control_restart_dyn32_phy32 | + hera cheyenne | | hrrr_control_dyn32_phy32
RUN | hrrr_control_restart_qr_dyn32_phy32 | + hera cheyenne | | hrrr_control_qr_dyn32_phy32
RUN | rrfs_smoke_conus13km_phy32 | + hera cheyenne | baseline |
RUN | rrfs_smoke_conus13km_phy32_qr | + hera cheyenne | baseline |
RUN | rrfs_smoke_conus13km_phy32_qr | + hera | baseline |
RUN | rrfs_smoke_conus13km_phy32_restart_mismatch | + hera cheyenne | baseline | rrfs_smoke_conus13km_phy32
RUN | rrfs_smoke_conus13km_phy32_restart_qr_mismatch | + hera cheyenne | | rrfs_smoke_conus13km_phy32_qr
RUN | rrfs_smoke_conus13km_phy32_restart_qr_mismatch | + hera | | rrfs_smoke_conus13km_phy32_qr

COMPILE | atm_dyn64_phy32 | gnu | -DAPP=ATM -DCCPP_32BIT=ON | + hera cheyenne | fv3 |
RUN | rap_control_dyn64_phy32 | + hera cheyenne | baseline |
Expand Down
23 changes: 7 additions & 16 deletions tests/rt_utils.sh
Original file line number Diff line number Diff line change
Expand Up @@ -347,28 +347,19 @@ check_results() {
fi

if [[ $d -eq 1 && ${i##*.} == 'nc' ]] ; then
if [[ ${MACHINE_ID} =~ orion || ${MACHINE_ID} =~ hera || ${MACHINE_ID} =~ wcoss2 || ${MACHINE_ID} =~ acorn || ${MACHINE_ID} =~ cheyenne || ${MACHINE_ID} =~ gaea || ${MACHINE_ID} =~ jet || ${MACHINE_ID} =~ s4 || ${MACHINE_ID} =~ noaacloud ]] ; then
if [[ " orion hera wcoss2 acorn cheyenne gaea jet s4 noaacloud " =~ " ${MACHINE_ID} " ]]; then
printf ".......ALT CHECK.." >> ${RT_LOG}
printf ".......ALT CHECK.."
if [[ ${MACHINE_ID} =~ orion || ${MACHINE_ID} =~ hera || ${MACHINE_ID} =~ gaea || ${MACHINE_ID} =~ jet || ${MACHINE_ID} =~ cheyenne ]] ; then
if [[ $CMP_DATAONLY == false ]]; then
nccmp -d -S -q -f -g -B --Attribute=checksum --warn=format ${RTPWD}/${CNTL_DIR}_${RT_COMPILER}/${i} ${RUNDIR}/${i} > ${i}_nccmp.log 2>&1 && d=$? || d=$?
else
nccmp -d -S -q -f -B --Attribute=checksum --warn=format ${RTPWD}/${CNTL_DIR}_${RT_COMPILER}/${i} ${RUNDIR}/${i} > ${i}_nccmp.log 2>&1 && d=$? || d=$?
fi
if [[ $d -ne 0 && $d -ne 1 ]]; then
echo "....ERROR" >> ${RT_LOG}
echo "....ERROR"
exit 1
echo "....ERROR" >> ${RT_LOG}
echo "....ERROR"
exit 1
fi
else
${PATHRT}/compare_ncfile.py ${RTPWD}/${CNTL_DIR}_${RT_COMPILER}/$i ${RUNDIR}/$i > compare_ncfile.log 2>&1 && d=$? || d=$?
if [[ $d -eq 1 ]]; then
echo "....ERROR" >> ${RT_LOG}
echo "....ERROR"
exit 1
fi
fi
fi
fi

Expand Down Expand Up @@ -635,11 +626,11 @@ ecflow_run() {
echo "ecflow_server is NOT running on ${ECF_HOST}:${ECF_PORT}"
if [[ ${MACHINE_ID} == wcoss2 || ${MACHINE_ID} == acorn ]]; then
if [[ "${HOST::1}" == "a" ]]; then
export ECF_HOST=aecflow01
export ECF_HOST=aecflow01
elif [[ "${HOST::1}" == "c" ]]; then
export ECF_HOST=cdecflow01
export ECF_HOST=cdecflow01
elif [[ "${HOST::1}" == "d" ]]; then
export ECF_HOST=ddecflow01
export ECF_HOST=ddecflow01
fi
MYCOMM="bash -l -c \"module load ecflow && ecflow_start.sh -p ${ECF_PORT} \""
ssh $ECF_HOST "${MYCOMM}"
Expand Down
10 changes: 4 additions & 6 deletions tests/run_test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -96,13 +96,11 @@ cp ${PATHTR}/modulefiles/ufs_common* ./modulefiles/.
# Get the shell file that loads the "module" command and purges modules:
cp ${PATHRT}/module-setup.sh module-setup.sh

if [[ $MACHINE_ID == wcoss2 ]] || [[ $MACHINE_ID == acorn ]] ; then
# for compare_ncfile.py
module load gcc/10.3.0 python/3.8.6
fi

# load nccmp module
if [[ $MACHINE_ID == hera ]] || [[ $MACHINE_ID == orion ]] || [[ $MACHINE_ID == gaea ]] || [[ $MACHINE_ID == jet ]] || [[ $MACHINE_ID == cheyenne ]]; then
if [[ " hera orion gaea jet cheyenne acorn wcoss2 " =~ " $MACHINE_ID " ]]; then
if [[ " wcoss2 acorn " =~ " ${MACHINE_ID} " ]] ; then
module load intel/19.1.3.304 netcdf/4.7.4
fi
module load nccmp
fi

Expand Down