Run tests in parallel in many detection_engine_api_integration data_types suites

[brianseeders]

CI Group 24 is currently one of that longest parts of CI, clocking in at about 56 minutes. 50 minutes of that is just the Detection exceptions data types and operators tests. Rather than just breaking them out into multiple new CI Groups, I took a peek at them to see why they were taking so long. I noticed that it appeared that a lot of them could be run in parallel, so I refactored the two longest suites to run many of the test cases in parallel. The two of them together went from 17 minutes to about 3 minutes.

The entire CI Group would probably only be about 10 minutes long if the other suites were refactored in a similar way.

This is what a failure now looks like:

00:01:37 1)    detection engine api security and spaces enabled
00:01:37
00:01:37          Detection exceptions data types and operators
00:01:37
00:01:37              Rule exception operators for data type long
00:01:37                "is" operator:
00:01:37
00:01:37       Error: during should find all the long from the data set when no exceptions are set on the rule:
00:01:37  Error: expected [ 1, 2, 3, 4 ] to sort of equal [ '1', '2', '3', '4', 'TEST_ERROR' ]

Inside x-pack/test/detection_engine_api_integration/security_and_spaces/tests/exception_operators_data_types tests:

• Modify helpers to use unique IDs/filenames on each invocation
• Do less cleanup after every single test run
• Parallelize exception deletion during cleanup
• Add a new helper for running multiple async test cases in parallel
• In two suites, for tests that were previously grouped together inside describe() blocks, run them in parallel together

Let me know what you folks think about this approach to these tests.

[elasticmachine]

Pinging @elastic/kibana-operations (Team:Operations)

[elasticmachine]

Pinging @elastic/security-solution (Team: SecuritySolution)

[kibana-ci]

💚 Build Succeeded

• Buildkite Build
• Commit: e1c3ba5
• Storybooks Preview
• Webpack Bundle Analyzer

Metrics [docs]

✅ unchanged

History

• 💚 Build #40254 succeeded 1097ca5
• 💚 Build #39872 succeeded 5e38866
• 💔 Build #39853 failed f95fcb0
• 💚 Build #39619 succeeded 755b8c5
• 💔 Build #39582 failed 25ed42f
• 💔 Build #39528 failed c655315

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream