-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unit testing Metaschema Composition Check Schematron #35
Labels
enhancement
New feature or request
scope: metaschema composition
scope: metaschema validation
scope: unit testing
Comments
25 tasks
This should be done as part of usnistgov/metaschema#186. |
10 tasks
david-waltermire
referenced
this issue
in wendellpiez/metaschema
Apr 28, 2022
…ow stable, addressing #47
david-waltermire
referenced
this issue
in wendellpiez/metaschema
Apr 28, 2022
…ow stable, addressing #47
david-waltermire
referenced
this issue
in usnistgov/metaschema
Apr 28, 2022
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
david-waltermire
referenced
this issue
in usnistgov/metaschema
Jun 21, 2022
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
david-waltermire
referenced
this issue
in usnistgov/metaschema
Dec 7, 2022
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 9, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
aj-stein-nist
referenced
this issue
in aj-stein-nist/metaschema
Jan 10, 2023
…tgov#199) * Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for usnistgov#198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - usnistgov#81 usnistgov#186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
david-waltermire
changed the title
Unit testing Metaschema Schematron
Unit testing Metaschema Composition Check Schematron
Feb 14, 2023
david-waltermire
referenced
this issue
in usnistgov/metaschema
Mar 9, 2023
* Metaschema composition XSpecs * Adding 'a8' prune-unused-definitions filter for comparison (most advanced yet). * Added new prune filter with slight adjustments to interface; new test for running it standalone * Removing noisy XSpec result * More tuning up v9 pruning step for #198 * Cleanup; restoring top-level compose XSLT * Updating files before merge * First draft of testing approach with current WIP prune phase transform. * Fix tests to align with Wendell exception msg check. * Move pruning tests back to their own folder. * Refactor test input XML docs into separate files * Make the tests more reusable across implementations. * Relocate input files to subdir per convo with @wendellpiez. * Slight improvement to prototype * Much cleanup and rearrangement; readme docs * Updating readme plus entry (shell) XSLT and XProc to current * Removing obsolete XSpec reports * Adding .gitignore to exclude XSpec results * More rearrangement and cleanup; adding step 4 XSpec * New filter detecting and removing unused definitions passes unit tests * Removing early copy of remedied step 4 XSLT * Updating Metaschema Schematron XSpecs to functional state: they are now stable, addressing #47 * More adjustments prepping to M4 unit tests - #81 #186 #201 - now everything is green or grey (pending) no pink * Added more clarification to pruning XSpec * Edits in response to feedback from @aj-stein-nist thanks AJ! * adding blank lines at end of files Co-authored-by: Alexander Stein <[email protected]> Co-authored-by: David Waltermire <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
enhancement
New feature or request
scope: metaschema composition
scope: metaschema validation
scope: unit testing
User Story:
In addition to XSD and JSON Schema production unit testing, we need to be unit testing the Schematron.
However, it is not only any Schematron production, but its functionality that must also be demonstrated in testing.
This is particularly the case, since these transformations implement core Metaschema semantics wrt constraints definition, and should help to expose soft areas in specification.
Goals:
XSpec provides Schematron testing support these days.
Implement XSpec unit tests for Schematron implementing a significant subset of Metaschema functionality, as being implemented under #12.
Provide a framework for further extension and maintenance of the tests. Eventually we should have Schematron tests, both pass and fail, demonstrating the full range of Metaschema semantics being expressed through Schematron, as run against either/both XML and JSON OSCAL.
Dependencies:
This depends on #12; ideally it would follow as closely as possible or in sync.
Acceptance Criteria
{The items above are general acceptance criteria for all User Stories. Please describe anything else that must be completed for this issue to be considered resolved.}
The text was updated successfully, but these errors were encountered: