Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update archive to handle ensembles #832

Closed
WalterKolczynski-NOAA opened this issue Jun 1, 2022 · 2 comments
Closed

Update archive to handle ensembles #832

WalterKolczynski-NOAA opened this issue Jun 1, 2022 · 2 comments
Labels
feature New feature or request
Milestone
Incorporate GEFS

Comments

@WalterKolczynski-NOAA
Copy link
Contributor

Description
As we move towards the merger of GEFS into the GFS system, global workflow needs to be updated to archive the additional output created when running a forecast ensemble.

Requirements
Need to expand the archive job to handle forecast ensemble outputs. Due to the multiplicity of the data, this may require a reevaluation of what gets archived, at least for ensemble members.

Acceptance Criteria (Definition of Done)
Given all of the workflow products, properly archive the key ensemble files to HPSS.

Dependencies
Add atm ensemble product generation (#823)
@WalterKolczynski-NOAA WalterKolczynski-NOAA added the feature New feature or request label Jun 1, 2022
@WalterKolczynski-NOAA WalterKolczynski-NOAA added this to the Incorporate GEFS milestone Jun 1, 2022
@WalterKolczynski-NOAA WalterKolczynski-NOAA self-assigned this May 22, 2023
@WalterKolczynski-NOAA WalterKolczynski-NOAA removed their assignment Aug 14, 2023
@aerorahul
Copy link
Contributor

@EricSinsky-NOAA FYI

@EricSinsky-NOAA EricSinsky-NOAA mentioned this issue Jun 20, 2024
Closed
@WalterKolczynski-NOAA
Copy link
Contributor Author

Duplicate of #2698

@WalterKolczynski-NOAA WalterKolczynski-NOAA marked this as a duplicate of #2698 Jul 15, 2024
@WalterKolczynski-NOAA WalterKolczynski-NOAA closed this as not planned Won't fix, can't repro, duplicate, stale Jul 15, 2024
@AntonMFernando-NOAA AntonMFernando-NOAA mentioned this issue Jul 25, 2024
Merged
7 tasks
WalterKolczynski-NOAA pushed a commit that referenced this issue Aug 7, 2024
@AntonMFernando-NOAA
Feature/get arch adds an empty archive job to GEFS system (#2772)
5c2e9b1 
- This feature added an archive task for GEFS system. This task will run
in the service queue with a single processor.
The task executes with success.
- Only xml is generated.

Refs #832
Refs #2698
CoryMartin-NOAA pushed a commit to CoryMartin-NOAA/global-workflow that referenced this issue Aug 7, 2024
@AntonMFernando-NOAA @CoryMartin-NOAA
Feature/get arch adds an empty archive job to GEFS system (NOAA-EMC#2772
efb7804 
)

- This feature added an archive task for GEFS system. This task will run
in the service queue with a single processor.
The task executes with success.
- Only xml is generated.

Refs NOAA-EMC#832
Refs NOAA-EMC#2698
@AntonMFernando-NOAA AntonMFernando-NOAA mentioned this issue Aug 7, 2024
Merged
7 tasks
WalterKolczynski-NOAA pushed a commit that referenced this issue Sep 7, 2024
@AntonMFernando-NOAA
Add an archive task to GEFS system to archive files locally (#2816)
2816c3b 
- This task is an extension of the empty arch job previously merged. 
- This feature adds an archive task to GEFS system to archive files
locally.
- This feature archives files in ensstat directory. 

Resolves #2698
Refs #832 #2772
@AntonMFernando-NOAA AntonMFernando-NOAA mentioned this issue Sep 23, 2024
Merged
7 tasks
aerorahul pushed a commit that referenced this issue Sep 25, 2024
@AntonMFernando-NOAA @DavidHuber-NOAA
Add an archive task to GEFS system to archive files in HPSS (#2895)
7088a91 
- This task is an extension of the arch job previously merged that
archives files in ROTDIR (#2816
AntonMFernando-NOAA@2816c3b)
- This feature adds an archive task to GEFS system to archive files in
HPSSARCH and LOCALARCH.
  Resolves #2698  
  Refs #2816 #2772 #832 
---------

Co-authored-by: David Huber <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New feature or request
Projects
None yet
Milestone
Incorporate GEFS
Development

No branches or pull requests
3 participants
@aerorahul @WalterKolczynski-NOAA @HenryRWinterbottom