jqwik should fail property test instead of ignoring it

[michaelmosmann]

Testing Problem

following kotlin test

class FooTest {

  @Property
  fun foo(name: String, @ForAll other: String) {
    assertNull(name)
  }
}

should fail, but is ignored (guess: name is not annotated but other is).

Suggested Solution

jqwik should fail such a test.

[jlink]

Well, the test will be marked as ignored together with an ignore message "All parameters must have @forall annotation". Depending on your IDE / build tool configuration this can be as obvious as a test failure. What additional information would a test failure provide?

[michaelmosmann]

For me it would be ok to fail this test with this message. AFAIK gradle reports an skipped test (if reporting) is enabled. But if i want gradle to fail the build i must distinguish between this case and a disabled junit test.

For me this is some kind of configuration error.. like @forall for a type without an known Arbitrary. It should fail, because i would not expect, that the test will be skipped.

[jlink]

Hm. You're right, the behaviour is inconsistent. I'll put it on the TODO list. Should be done in next release.

[michaelmosmann]

Thanks a lot:)

[jlink]

Fixed in d1f899c

[jlink]

Available in 1.1.3-SNAPSHOT

[jlink]

Released in 1.1.3