-
-
Notifications
You must be signed in to change notification settings - Fork 682
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ignore all but first test in hello-world #139
Ignore all but first test in hello-world #139
Conversation
Introduce a new JUnit test category that lets us mark certain tests as not ready for execution. The test task in the individual project can then be configured to not run tests marked as `NotReady`. For the CI server builds, add a fullTest test task that simply runs tests as normal, and link it into the check task so it runs on builds. This is not perfect, as the class under test must still compile, so it must have at least the correct signatures of all the methods tested. Also, it may be worth finding a way to distribute the NotReady interface that doesn't require checking it into every project.
Initial POC of how to ignore all-but-first test
- in base build script, filter out @ignores so that maintainers can run the full test suites. - increase the verbosity of test logging to aide in seeing progress as tests are un@Ignored and solved. - revamped GETTING_STARTED.md to reflect new output. It is now a complete guide from start to finish with calls-to-action at the end of the instructions.
93b7188
to
ca33ebb
Compare
- in journey test, remove @ignores so that test runs exercise all tests. - increase the verbosity of test logging to aide in seeing progress as tests are un@Ignored and solved. - saving scripts used to make changes to all exercises. These are the start of a library of scripts making such changes easier. - make Gradle output more CI-friendly.
ca33ebb
to
35adc66
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I didn't read everything in detail but the approach seems solid and doesn't introduce some exercism-specific thing.
@@ -0,0 +1,21 @@ | |||
#!/usr/bin/env bash |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What are these scripts for? Just for developer use?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes. They are not at all generalized, but will be. In the meantime, a starting point to build other scripts?
Thanks for the review @sit! Yeah, I thought that the added complexity in the maintainer build (which you only have to understand if you need to modify it, at this point) was worth the trade-off of removing the complexity for the exercism programmer. There are additional benefits. By turning up test logging, the ignored tests are mentioned, signalling to the programmer there's more to do. |
👍 Thanks @jtigger ! |
Started with @sit's suggestion, but then tacked to use
@Ignore
and defined a copy with filter in the rootbuild.gradle
that removes these annotations in a maintainers' build.