Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for fully local HDF5 files and shared dumping of meep::structure #1715

Merged
merged 6 commits into from
Aug 19, 2021

Conversation

kkg4theweb
Copy link
Contributor

Add support for dumping meep:structure to sharded files where each process writes out the data for the chunks it owns to its own file (typically named after the process rank). This is useful when running with MPI but there is no proper parallel file support on the running system.

To support this, add a 'local' mode to the h5file wrapper to support writing to local files (with parallel or MPI I/O)

@codecov-commenter
Copy link

codecov-commenter commented Jul 29, 2021

Codecov Report

Merging #1715 (2af4e6e) into master (ef18156) will increase coverage by 0.07%.
The diff coverage is 95.65%.

@@            Coverage Diff             @@
##           master    #1715      +/-   ##
==========================================
+ Coverage   73.34%   73.42%   +0.07%     
==========================================
  Files          13       13              
  Lines        4528     4545      +17     
==========================================
+ Hits         3321     3337      +16     
- Misses       1207     1208       +1     
Impacted Files Coverage Δ
python/simulation.py 76.39% <95.65%> (+0.13%) ⬆️

src/structure_dump.cpp Show resolved Hide resolved
python/simulation.py Show resolved Hide resolved
python/simulation.py Show resolved Hide resolved
@oskooi oskooi self-requested a review August 12, 2021 23:54
@oskooi
Copy link
Collaborator

oskooi commented Aug 12, 2021

LGTM.

@stevengj stevengj merged commit 7f6d79a into NanoComp:master Aug 19, 2021
bencbartlett pushed a commit to bencbartlett/meep that referenced this pull request Sep 9, 2021
…ructure (NanoComp#1715)

* Add support for fully local HDF5 files and shared dumping of meep::structure

* Add support for fully local HDF5 files and shared dumping of meep::structure

* Update python func docs

* Update python API documentation
mawc2019 pushed a commit to mawc2019/meep that referenced this pull request Nov 3, 2021
…ructure (NanoComp#1715)

* Add support for fully local HDF5 files and shared dumping of meep::structure

* Add support for fully local HDF5 files and shared dumping of meep::structure

* Update python func docs

* Update python API documentation
@oskooi oskooi mentioned this pull request Dec 25, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants