-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add 'type' field to test case format #18
Comments
I don't think this needs to be part of the general test case format as a test suite can already define whatever fields they like for a test suite. |
Adding a |
I think optional |
👍 Adding it as an optional but standardized way of distinguishing different test types seems reasonable. Not sure about |
yeah, don't think we need |
Please check #29 , it introduces a structured and efficient approach to test types and suites :) |
Proposal
Add an optional
type
field totest_case
section of test format. It might, also, make sense to add atypes
field totest_suite
header with a list of all underlying test case types.Rationale
It's a necessary thing for building heterogeneous test suites like SSZ, tree hashing , BLS and a lot more. If all test cases in the suite are of the same kind, e.g. state transition or shuffling tests, then
type
field could be omitted.Requested by https://github.com/ethereum/eth2.0-tests/issues/8, https://github.com/ethereum/eth2.0-tests/issues/11
The text was updated successfully, but these errors were encountered: