You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The actual fields in the final metadata will vary, we will only model what is needed, the above snippet is just a sample of how this could end up. The key takeaway is that :
the information is factual, fine grained and complete. All information required for deciding on tests should be present here. It's expected that the implementation that reads this meta data will have methods like bwcVersions(feature) , javaVersion(feature, version) etc so the tests don't have to make that decision locally.
provides an (also) human readable summary of which features are supported where and how we test them
allows for some level of automatic validation
Steps:
consensus on the approach and format
start consuming these from tests and extending the metadata as we go
write a task to validate that all tasks were generated and the dependency chain is correct for bwcTests the task would check the task graph and error out if bwcTests is on it but not all testing tasks are (assume consistent task naming).
write a task to generate a .dot graph to visualize the testing that is done
Discussed with @rjernst, turns out we had a more descriptive approach before and did not like the maintenance of it. Iterating on the current approach instead see #34050 for more details.
We should create a single metadata file such as for each version:
The actual fields in the final metadata will vary, we will only model what is needed, the above snippet is just a sample of how this could end up. The key takeaway is that :
bwcVersions(feature)
,javaVersion(feature, version)
etc so the tests don't have to make that decision locally.Steps:
bwcTests
the task would check the task graph and error out ifbwcTests
is on it but not all testing tasks are (assume consistent task naming)..dot
graph to visualize the testing that is doneReferences:
The text was updated successfully, but these errors were encountered: