Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Estimate memory usage #20

Open
mflynn-lanl opened this issue Sep 10, 2024 · 0 comments
Open

Estimate memory usage #20

mflynn-lanl opened this issue Sep 10, 2024 · 0 comments
Assignees

Comments

@mflynn-lanl
Copy link

Assembly workflows can fail due to insufficient memory requested. One solution is to increase the amount of memory requested in the runtime attribute to accommodate all samples. However, memory usage by the assembly workflow can vary depending on the sample. Requesting a lot of memory means some jobs will request more than is needed and so fewer jobs can run at the same time. Brian Foster has a python script that can estimate memory usage based on the sample. We will add this to our Assembly workflow to adjust memory requested to better reflect how much is needed.

@mflynn-lanl mflynn-lanl self-assigned this Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant