Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

validate result data against output schema #20

Open
karenetheridge opened this issue Nov 25, 2020 · 1 comment
Open

validate result data against output schema #20

karenetheridge opened this issue Nov 25, 2020 · 1 comment

Comments

@karenetheridge
Copy link
Owner

There is a formal JSON Schema in the specification that describes the expected structure of the result (validity, errors, annotations etc). We should be able to pass the evaluator's output through this schema and generate a test failure when the output fails to match.

This should be a configurable option, although it might be reasonable to have it be enabled by default.

Some fixes are still needed on the output schema before this can be implemented (at least by default).

@karenetheridge
Copy link
Owner Author

A first cut of output tests are now available, via json-schema-org/JSON-Schema-Test-Suite#619.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant