Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] openPMD: variableBased IterationEncoding #1909

Closed
wants to merge 11 commits into from
Closed

Conversation

guj
Copy link
Contributor

@guj guj commented Apr 23, 2021

@guj guj requested a review from ax3l April 23, 2021 05:23
@ax3l ax3l self-assigned this Apr 23, 2021
@ax3l ax3l added component: openPMD openPMD I/O enhancement New feature or request labels Apr 23, 2021
@ax3l ax3l changed the title Added support to write to one file openPMD: variableBased IterationEncoding Apr 24, 2021
@ax3l ax3l changed the title openPMD: variableBased IterationEncoding [WIP] openPMD: variableBased IterationEncoding Apr 24, 2021
@@ -316,6 +320,13 @@ WarpXOpenPMDPlot::Init (openPMD::Access access, bool isBTD)
m_MPIRank = 1;
}

if ( m_OpenPMDFileType.compare("bp") == 0 )
Copy link
Member

@ax3l ax3l Apr 24, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should make this a user input option.
We can default to variableBased, fallback default: groupBased, but the user might want to pick fileBased for various reasons

Note that the openPMD::Series file name should not include the _%T placeholder for all but fileBased iteration encoding.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, so in addition to parameter "openpmd_backend", I will introduce another one called "openpmd_iteration". It is default to variableBased if available, otherwise, group based.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

actually, I will rename openpmd_tspf to openpmd_iteration

Copy link
Member

@ax3l ax3l May 21, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You could encode it with an enum struct so that the user can pick between all three encodings :)

@guj guj closed this May 19, 2021
@guj guj reopened this May 19, 2021
@guj guj closed this May 19, 2021
@guj guj reopened this May 19, 2021
@ax3l ax3l mentioned this pull request May 20, 2021
2 tasks
@ax3l
Copy link
Member

ax3l commented May 20, 2021

We saw in #1842 (comment) that some of the changes to the streaming API functions, i.e. Series::writeIterations(), case problems with back-transformed diagnostics (BTD) that keep an iteration open for a long time.

We need to double-check here again that this stays working.

@ax3l ax3l mentioned this pull request May 20, 2021
@guj guj closed this May 20, 2021
@guj guj reopened this May 20, 2021
@guj
Copy link
Contributor Author

guj commented May 24, 2021

opened #1979 and closing this one.

@guj guj closed this May 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component: openPMD openPMD I/O enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants