-
-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Core] Default to --strict mode #1960
Conversation
snippets are printed as part of the exception
The title of this PR (and the comment in the Changelog) imply only a change of default. It looks like the whole idea of non-strict has been removed - although the help text still says: Am I missing something? |
Internally the implementation is gone. However we're still in the process of phasing out the user facing part. cucumber-jvm/core/src/main/java/io/cucumber/core/options/CucumberPropertiesParser.java Lines 137 to 142 in d3f7956
|
The teamcity plugin communicates test results to IntelliJ IDEA using teamcity service messages[1]. Currently the teamcity plugin marks pending steps as skipped rather then failed. This is inconsistent with the changes from #1960 in which pending steps are considered a test failure.
The teamcity plugin communicates test results to IntelliJ IDEA using teamcity service messages[1]. Currently the teamcity plugin marks pending steps as skipped rather then failed. This is inconsistent with the changes from #1960 in which pending steps are considered a test failure. 1: https://www.jetbrains.com/help/teamcity/service-messages.html
The teamcity plugin communicates test results to IntelliJ IDEA using teamcity service messages[1]. Currently the teamcity plugin marks pending steps as skipped rather then failed. This is inconsistent with the changes from #1960 in which pending steps are considered a test failure. 1: https://www.jetbrains.com/help/teamcity/service-messages.html
The teamcity plugin communicates test results to IntelliJ IDEA using teamcity service messages[1]. Currently the teamcity plugin marks pending steps as skipped rather then failed. This is inconsistent with the changes from #1960 in which pending steps are considered a test failure. 1: https://www.jetbrains.com/help/teamcity/service-messages.html
* [Core] Mark pending steps as failed in teamcity plugin The teamcity plugin communicates test results to IntelliJ IDEA using teamcity service messages[1]. Currently the teamcity plugin marks pending steps as skipped rather then failed. This is inconsistent with the changes from #1960 in which pending steps are considered a test failure. 1: https://www.jetbrains.com/help/teamcity/service-messages.html * [Core] Fix teamcity link for cucumber-java8 hooks The teamcity plugin communicates test results to IntelliJ IDEA using teamcity service messages[1]. These messages can link to files using a url-like protocol. The code use to convert code locations from cucumber-java8 step definitions did not correctly extract the method from this string representation.
Hi, wondering if someone can verify something for me? We're using Cucumber at the moment and a test will not fail, if a feature is not found. Shouldn't that happen if strict mode is now the default? Or has strict functionality just been stripped out for some reason? |
Strict mode only affects translating PENDING, UNDEFINED, AMBIGUOUS steps results into a pass or fail. It does not do anything w.r.t to features being discovered. If you have a feature request, please create a new issue though. |
Unlike other implementations Cucumber-JVM defaults to
--non-strict
mode. By defaulting to--strict
Cucumber follows the same standards as other implementations.Additionally the option to set strict mode adds complexity for consumers of Cucumbers output. They have to interpret Cucumbers 6 scenario outcomes with this in mind. By removing
--strict/--non-strict
mode we remove this complexity all together.With PR Cucumber will:
--strict
--non-strict
.--strict
is used.Partial fix for #1788, cucumber/common#714
Types of changes
Checklist: