Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make tests about one ore more functions #28

Closed
piccolbo opened this issue Apr 14, 2015 · 5 comments
Closed

make tests about one ore more functions #28

piccolbo opened this issue Apr 14, 2015 · 5 comments

Comments

@piccolbo
Copy link
Collaborator

While assertions normally implement properties of certain functions that we want to test, this is fairly implicit in the qc api. A test takes an assertion, and such assertion invokes functions that need to operate properly for the assertion to succeed. Only in the argument cover can the user focus specifically on one function. This can make assertions less self documenting ("what was this assertion about"), but, more concretely, makes it harder to operate a choice of seed that makes test case selection independent between runs before and after a software fix (related to #26)

@piccolbo
Copy link
Collaborator Author

now test has argument "about", originally introduced to implement better seeding. But that doesn't answer the question: what are the tests for this function?

@piccolbo
Copy link
Collaborator Author

As a first step, return the about information with the test results. Then we need to gather that information to allow finding all the tests about a certain function.

piccolbo added a commit that referenced this issue Apr 17, 2015
piccolbo added a commit that referenced this issue Apr 17, 2015
gather all assertions about a function in a sort of spec
@piccolbo
Copy link
Collaborator Author

At this point we have a test.set function that allows people to gather tests in group and see which functions are exercised by which tests. There may be better ways of printing out this information and there may be a need for tests that span across multiple files. The heuristic for the about arg needs to be battle tested.

@piccolbo
Copy link
Collaborator Author

need also to add tests for the new features and increase coverage

@piccolbo
Copy link
Collaborator Author

And documentation

piccolbo added a commit that referenced this issue Apr 17, 2015
piccolbo added a commit that referenced this issue Apr 17, 2015
piccolbo added a commit that referenced this issue Apr 17, 2015
piccolbo added a commit that referenced this issue Apr 17, 2015
piccolbo added a commit that referenced this issue Apr 17, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant