Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

“Pending” test case Tag #839

Closed
jnd-au opened this issue Oct 3, 2024 · 0 comments
Closed

“Pending” test case Tag #839

jnd-au opened this issue Oct 3, 2024 · 0 comments

Comments

@jnd-au
Copy link
Contributor

jnd-au commented Oct 3, 2024

It’s useful to support a “Pending” Tag annotation for new/incomplete test cases (especially if a user-supplied ticket tracker ID can be reported in test results). This kind of feature is supported by other frameworks like ScalaTest and Specs2. In terms of JUnit / framework reporting, Pending cases are usually logged the same as the Ignored tag. However, useful advantages of “Pending”, different from “Ignored”:

  • Runs the test case instead of skipping it (can detect regressions).
  • Structured, searchable, lintable source-code documentation of new or incomplete test cases, which would otherwise be undocumented or misleadingly reported as Success coverage.
  • Annotation/listening of annotated test results, so that the reasons for ignored test cases are clear and can be reported.
  • Can be combined for “Ignored” if the test case is temporarily failing for an acceptable reason (best of both worlds).

Without pending:

==> i MyClass.newTest ignored

With pending:

==> i MyClass.newTest PENDING #999 ignored
jnd-au added a commit to jnd-au/munit that referenced this issue Oct 3, 2024
jnd-au added a commit to jnd-au/munit that referenced this issue Oct 3, 2024
Show elapsed time for JS/Native Ignored tests (may be non-zero), to be consistent with JVM
jnd-au added a commit to jnd-au/munit that referenced this issue Oct 3, 2024
- Also show elapsed time for JS/Native Ignored tests (may be non-zero), to be consistent with JVM
jnd-au added a commit to jnd-au/munit that referenced this issue Oct 3, 2024
- Also show elapsed time for JS/Native Ignored tests (may be non-zero), to be consistent with JVM
tgodzik added a commit that referenced this issue Oct 10, 2024
Support “Pending” test case Tag #839
@jnd-au jnd-au closed this as completed Oct 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant