Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[develop] Common infrastructure for CIs and manual runs #378

Merged
merged 26 commits into from
Oct 6, 2022
Merged

[develop] Common infrastructure for CIs and manual runs #378

merged 26 commits into from
Oct 6, 2022

Commits on Oct 5, 2022

  1. Combine CI infrastructure, use get_expts_status etc to simplify Jenkins.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    9f82c3d View commit details
    Browse the repository at this point in the history

  2. Unload python in wflow_cheyenne just to be safe.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    f458da2 View commit details
    Browse the repository at this point in the history

  3. Don't do launch_wflow when checking experiment status.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    454fc08 View commit details
    Browse the repository at this point in the history

  4. Debug post test tar failures on Cheyenne

    @danielabdi-noaa
    Jesse McFarland authored and danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    e32e088 View commit details
    Browse the repository at this point in the history

  5. Disable PW AWS cluster for pipeline

    @danielabdi-noaa
    Jesse McFarland authored and danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    4a89d0a View commit details
    Browse the repository at this point in the history

  6. Fake un-launched jobs as if they are in progress.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    d9fe3f1 View commit details
    Browse the repository at this point in the history

  7. Undo last commit.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    f3bb469 View commit details
    Browse the repository at this point in the history

  8. Increase cron interval to 5 mins.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    ead683d View commit details
    Browse the repository at this point in the history

  9. Also increase initial delay to 6 min.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    7540506 View commit details
    Browse the repository at this point in the history

  10. Fix variable expansion for the srw_test.sh call

    @danielabdi-noaa
    Jesse McFarland authored and danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    8c6f63e View commit details
    Browse the repository at this point in the history

  11. Updates for build artifact handling 

    * Update tar command to create cleaner artifact
* Update path of build log for s3 upload
    @danielabdi-noaa
    Jesse McFarland authored and danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    6262ba3 View commit details
    Browse the repository at this point in the history

  12. Remove lines used for debugging

    @danielabdi-noaa
    Jesse McFarland authored and danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    063155b View commit details
    Browse the repository at this point in the history

  13. Remove custom test list.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    f92700b View commit details
    Browse the repository at this point in the history

  14. Add custom_ensemble_2mems_stoch.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    08e84b7 View commit details
    Browse the repository at this point in the history

  15. Undo unloading of python for Cheyenne.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    01ee8bc View commit details
    Browse the repository at this point in the history

  16. debug cheyenne python failures

    @danielabdi-noaa
    Jesse McFarland authored and danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    057126e View commit details
    Browse the repository at this point in the history

  17. Add more debugging code for cheyenne.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    1c77098 View commit details
    Browse the repository at this point in the history

  18. Decrease re-launch interval temporarily.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    213d004 View commit details
    Browse the repository at this point in the history

  19. Turn off check_var_valid.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    b624865 View commit details
    Browse the repository at this point in the history

  20. Add Lmod_init for Gaea.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    e9fd43a View commit details
    Browse the repository at this point in the history

  21. Clean up now that everything seems to work.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    20a5fe6 View commit details
    Browse the repository at this point in the history

  22. Fix comment about the need for conda activation for Cheyenne.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    74ec726 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Print crontab content before/after deletion.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    7d6c5fa View commit details
    Browse the repository at this point in the history

  2. Improve experiments directory clean up 

    Only remove the data directories to allow we2e cron jobs to complete
and clean up themselves correctly.
    Jesse McFarland committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    ed219b3 View commit details
    Browse the repository at this point in the history

  3. Ensure we2e cron jobs execute again before cleanup

    Jesse McFarland committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    3a04017 View commit details
    Browse the repository at this point in the history

  4. Bug fix in build.sh.

    @danielabdi-noaa
    danielabdi-noaa committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    bc32097 View commit details
    Browse the repository at this point in the history