Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation (fireworks) #278

Closed
JaGeo opened this issue Mar 22, 2023 · 5 comments · Fixed by materialsproject/jobflow#338
Closed

Documentation (fireworks) #278

JaGeo opened this issue Mar 22, 2023 · 5 comments · Fixed by materialsproject/jobflow#338

Comments

@JaGeo
Copy link
Member

JaGeo commented Mar 22, 2023

I did not find any documentation on how to run jobs from atomate2 with multiple workers in fireworks. I assume this would be too hard to find out for a new user of atomate2 on their own.

@Andrew-S-Rosen
Copy link
Member

Hopefully we can add some clear documentation about this in the jobflow repo and then link to it in the Atomate2 docs. I opened an issue a while ago. It's still on my radar... materialsproject/jobflow#90

@JaGeo
Copy link
Member Author

JaGeo commented Apr 8, 2023

This would be great! Especially for workflows where more than 1 code and more than one worker are needed! Thanks!

@Andrew-S-Rosen
Copy link
Member

Andrew-S-Rosen commented Jun 5, 2023

When you say more than one worker, could you clarify what you mean? Do you mean more than one HPC machine? More generally, what kind of FireWorks info do you think you'd like to see?

While content specifically related to FireWorks should in principle go in the FireWorks docs, they are admittedly overwhelming and it could be good to have minimal working examples here (or, rather, in the Jobflow docs which Atomate2 would link to).

@JaGeo
Copy link
Member Author

JaGeo commented Jun 5, 2023

It's triggered by the Lobster workflow. VASP uses MPI parallelization. Lobster itself OpenMP. It would be great to have an example where we have one worker running, e.g., VASP jobs and the other one running, e.g., Lobster jobs with a different job script.

@Andrew-S-Rosen
Copy link
Member

Note to self:

  • Tutorial on how to dispatch jobs in a workflow across multiple FW configs (eg different SLURM scripts and resources).
  • For above, specifically need to highlight how this is done based on something like setting metadata in jobflow so the user can associate each job with a given Fireworks config.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants