-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve Integration and Unit Tests for Metaschema Composition Pipeline #19
Labels
enhancement
New feature or request
Comments
aj-stein-nist
changed the title
Improve Intergration and Unit Tests for Metaschema Composition Pipeline
Improve Integration and Unit Tests for Metaschema Composition Pipeline
Apr 12, 2022
3 tasks
8 tasks
wendellpiez
referenced
this issue
in wendellpiez/metaschema
Apr 12, 2022
… #201 - now everything is green or grey (pending) no pink
We know next steps for the immediate bug fix and test cleanup work, the long-term composition testing details on what is enough and good enough in terms of goals we need to discuss we can pick up in another triage session. |
This was referenced Apr 15, 2022
david-waltermire
referenced
this issue
in wendellpiez/metaschema
Apr 28, 2022
… #201 - now everything is green or grey (pending) no pink
david-waltermire
referenced
this issue
in wendellpiez/metaschema
Apr 28, 2022
… #201 - now everything is green or grey (pending) no pink
david-waltermire
referenced
this issue
in usnistgov/metaschema
Apr 28, 2022
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
david-waltermire
referenced
this issue
in usnistgov/metaschema
Jun 21, 2022
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
9 tasks
david-waltermire
referenced
this issue
in usnistgov/metaschema
Dec 7, 2022
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 9, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
david-waltermire
referenced
this issue
in usnistgov/metaschema
Mar 9, 2023
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
User Story:
As a NIST OSCAL developer, to have more confidence in the Metaschema composition pipeline for NIST's primary XSLT-based implementation as-is and when I develop for new features and fixing bugs, I would like to see unit tests to validate individual pipeline components and end-to-end integration tests for the complete pipeline of transformations from input to desired composition output.
Goals:
There are existing integration tests for the Metaschema composition to test end-to-end functionality and new unit tests to validate the phase that prunes unused definitions in usnistgov/metaschema#199. We would like to revive the existing integration tests and add MVP unit tests for other phases of the composition pipeline for MVP test coverage and confidence in the pipeline during changes.
Dependencies:
Acceptance Criteria
{The items above are general acceptance criteria for all User Stories. Please describe anything else that must be completed for this issue to be considered resolved.}
The text was updated successfully, but these errors were encountered: