jest-circus runs children in shuffled order #12922
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
|
|
@@ -28,6 +28,18 @@ Run tests related to changed files based on hg/git (uncommitted files): | |||||
| jest -o | ||||||
| ``` | ||||||
|
|
||||||
| Run tests in a file in a random order (this will print the seed used for random number generation): | ||||||
|
There was a problem hiding this comment. I get the idea, but what if this would be moved to There was a problem hiding this comment. I've copied what I've written here to be part of the CLI description of the Was this what you were looking for? There was a problem hiding this comment. Thanks. I was trying to say that this usage information could be more useful, if placed next to There was a problem hiding this comment. ahh gotcha. Yeah that makes sense. |
||||||
|
|
||||||
| ```bash | ||||||
| jest --randomize | ||||||
| ``` | ||||||
|
|
||||||
| Run tests in a file in an order determined by a seed: | ||||||
|
|
||||||
| ```bash | ||||||
| jest --randomize --seed 1234 | ||||||
| ``` | ||||||
|
|
||||||
| Run tests related to `path/to/fileA.js` and `path/to/fileB.js`: | ||||||
|
|
||||||
| ```bash | ||||||
|
|
@@ -311,6 +323,11 @@ Allows the test suite to pass when no files are found. | |||||
|
|
||||||
| Run tests from one or more projects, found in the specified paths; also takes path globs. This option is the CLI equivalent of the [`projects`](configuration#projects-arraystring--projectconfig) configuration option. Note that if configuration files are found in the specified paths, _all_ projects specified within those configuration files will be run. | ||||||
|
|
||||||
| ### `--randomize` | ||||||
|
|
||||||
| Shuffle the order of the tests within a file. The seed used to generate the new order will be printed to stdout. | ||||||
|
There was a problem hiding this comment. Add something along the lines of "passing the same |
||||||
| In order to determine the seed refer to the `--seed` CLI option. | ||||||
jhwang98 marked this conversation as resolved.
Show resolved
Hide resolved
|
||||||
|
|
||||||
| ### `--reporters` | ||||||
|
|
||||||
| Run tests with specified reporters. [Reporter options](configuration#reporters-arraymodulename--modulename-options) are not available via CLI. Example with multiple reporters: | ||||||
|
|
@@ -343,6 +360,10 @@ The default regex matching works fine on small runs, but becomes slow if provide | |||||
|
|
||||||
| ::: | ||||||
|
|
||||||
| ### `--seed` | ||||||
|
There was a problem hiding this comment.
Suggested change
might need to tweak the anchor in |
||||||
|
|
||||||
| Run the tests in the order specified by the seed value. Must be used with the `--randomize` flag. | ||||||
jhwang98 marked this conversation as resolved.
Show resolved
Hide resolved
|
||||||
|
|
||||||
| ### `--selectProjects <project1> ... <projectN>` | ||||||
|
|
||||||
| Run the tests of the specified projects. Jest uses the attribute `displayName` in the configuration to identify each project. If you use this option, you should provide a `displayName` to all your projects. | ||||||
|
|
||||||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,344 @@ | ||
| // Jest Snapshot v1, https://goo.gl/fbAQLP | ||
|
|
||
| exports[`works with each 1`] = ` | ||
| "PASS __tests__/each.test.js | ||
| ✓ test1 | ||
| ✓ test2 | ||
| ✓ test3 | ||
| describe1 | ||
| ✓ test4 | ||
| ✓ test6 | ||
| ✓ test5 | ||
| describe3 | ||
| ✓ test11 | ||
| ✓ test12 | ||
| ✓ test10 | ||
| describe4 | ||
| ✓ test14 | ||
| ✓ test13 | ||
| ✓ test15 | ||
| describe2 | ||
| ✓ test4 | ||
| ✓ test5 | ||
| ✓ test6" | ||
| `; | ||
|
|
||
| exports[`works with hooks 1`] = ` | ||
| "Seed is 123 | ||
| console.log | ||
| This is before all | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:2:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test4 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:31:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test6 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:39:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test5 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:35:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test1 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:18:11) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| This is before each describe3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:63:13) | ||
|
|
||
| console.log | ||
| test11 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:71:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| This is before each describe3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:63:13) | ||
|
|
||
| console.log | ||
| test12 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:75:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| This is before each describe3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:63:13) | ||
|
|
||
| console.log | ||
| test14 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:84:15) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| This is before each describe3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:63:13) | ||
|
|
||
| console.log | ||
| test13 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:80:15) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| This is before each describe3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:63:13) | ||
|
|
||
| console.log | ||
| test15 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:88:15) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| This is before each describe3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:63:13) | ||
|
|
||
| console.log | ||
| test10 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:67:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test7 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:49:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test8 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:53:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test9 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:57:13) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is after all describe2 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:45:13) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test2 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:22:11) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is before each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:6:11) | ||
|
|
||
| console.log | ||
| test3 | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:26:11) | ||
|
|
||
| console.log | ||
| This is after each | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:10:11) | ||
|
|
||
| console.log | ||
| This is after all | ||
|
|
||
| at Object.log (__tests__/hooks.test.js:14:11) | ||
| " | ||
| `; | ||
|
|
||
| exports[`works with passing tests 1`] = ` | ||
| "PASS __tests__/success.test.js | ||
| ✓ test1 | ||
| ✓ test2 | ||
| ✓ test3 | ||
| describe1 | ||
| ✓ test4 | ||
| ✓ test6 | ||
| ✓ test5 | ||
| describe3 | ||
| ✓ test11 | ||
| ✓ test12 | ||
| ✓ test10 | ||
| describe4 | ||
| ✓ test14 | ||
| ✓ test13 | ||
| ✓ test15 | ||
| describe2 | ||
| ✓ test7 | ||
| ✓ test8 | ||
| ✓ test9" | ||
| `; | ||
|
|
||
| exports[`works with snapshots 1`] = ` | ||
| "PASS __tests__/snapshots.test.js | ||
| ✓ test1 | ||
| ✓ test2 | ||
| ✓ test3 | ||
| describe1 | ||
| ✓ test4 | ||
| ✓ test6 | ||
| ✓ test5 | ||
| describe3 | ||
| ✓ test11 | ||
| ✓ test12 | ||
| ✓ test10 | ||
| describe4 | ||
| ✓ test14 | ||
| ✓ test13 | ||
| ✓ test15 | ||
| describe2 | ||
| ✓ test4 | ||
| ✓ test5 | ||
| ✓ test6" | ||
| `; |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we can probably split this up into multiple entries. One for "new arguments
seedandrandomize" underchoreand one for circus with the randomizing underfeatures