You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is a formal JSON Schema in the specification that describes the expected structure of the result (validity, errors, annotations etc). We should be able to pass the evaluator's output through this schema and generate a test failure when the output fails to match.
This should be a configurable option, although it might be reasonable to have it be enabled by default.
Some fixes are still needed on the output schema before this can be implemented (at least by default).
The text was updated successfully, but these errors were encountered:
There is a formal JSON Schema in the specification that describes the expected structure of the result (validity, errors, annotations etc). We should be able to pass the evaluator's output through this schema and generate a test failure when the output fails to match.
This should be a configurable option, although it might be reasonable to have it be enabled by default.
Some fixes are still needed on the output schema before this can be implemented (at least by default).
The text was updated successfully, but these errors were encountered: