[Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI #78004

FrankHassanabad · 2020-09-21T12:22:38Z

Summary

Bubbles up error messages from ES queries that have _shards.failures in them. For example if you have errors in your exceptions list you will need to see them bubbled up.

Steps to reproduce:
Go to a detections rule and add an invalid value within the exceptions such as this one below:

Notice that rsa.internal.level value is not a numeric but a text string. You should now see this error message where before you could not:

Checklist

Unit or functional tests were updated or added to match the most common scenarios

elasticmachine · 2020-09-21T20:29:28Z

Pinging @elastic/siem (Team:SIEM)

dhurley14

LGTM! Accumulating these failures will help us out a lot going forward with users debugging issues and bringing some "self - service" to the detection engine. Also, thanks for cleaning up the code with those merge functions!

rylnd

Desk tested and saw these lovely new errors!

I had a suggestion for a minor refactor that might clean things up and obviate some of the test permutations, but feel free to take it or leave it!

rylnd · 2020-09-22T18:29:12Z

x-pack/plugins/security_solution/server/lib/detection_engine/signals/types.ts

+  success: boolean;
+  searchAfterTimes: string[];
+  bulkCreateTimes: string[];
+  lastLookBackDate: Date | null | undefined;


What's the semantic distinction between null and undefined for this value? Looking at the implementation of createSearchAfterReturnType it seems like it'll never be undefined

It is a bit weird. It sometimes can be undefined if it has never been set before. I think we used null as setting it for another type of value. But yeah, it can be either of those three states.

rylnd · 2020-09-22T18:35:27Z

...ck/plugins/security_solution/server/lib/detection_engine/signals/search_after_bulk_create.ts

-          logger.debug(buildRuleMessage(`created ${createdCount} signals`));
-          toReturn.createdSignalsCount += createdCount;
+          toReturn = mergeSearchAfterAndBulkCreate({
+            prev: toReturn,


Nit: the prev and next arguments are a little odd to me, I would expect this kind of function to instead operate on a uniform array, e.g. (A[]) => A

Oh that's interesting. An ordered array. That's a good idea. I can try to add that and see if it makes sense and then commit it if it does.

rylnd · 2020-09-22T19:02:14Z

x-pack/plugins/security_solution/server/lib/detection_engine/signals/utils.ts

+  const searchReturn = createSearchAfterReturnType({
+    success: searchResult._shards.failed === 0,
+    lastLookBackDate:
+      searchResult.hits.hits.length > 0
+        ? new Date(searchResult.hits.hits[searchResult.hits.hits.length - 1]?._source['@timestamp'])
+        : undefined,
+  });


Suggested change

const searchReturn = createSearchAfterReturnType({

success: searchResult._shards.failed === 0,

lastLookBackDate:

searchResult.hits.hits.length > 0

? new Date(searchResult.hits.hits[searchResult.hits.hits.length - 1]?._source['@timestamp'])

: undefined,

});

const searchReturn = createSearchAfterReturnTypeFromResponse(searchResult);

Ha! Thank you. Pure 🥇 gold here. Appreciate the eyes. Will fix.

rylnd · 2020-09-22T19:15:42Z

x-pack/plugins/security_solution/server/lib/detection_engine/signals/utils.ts

+        ? new Date(searchResult.hits.hits[searchResult.hits.hits.length - 1]?._source['@timestamp'])
+        : undefined,
+  });
+  const partialMerge = mergeSearchAfterAndBulkCreate({


I have a suggestion to normalize these merging functions, but I realize it might cause a bunch of churn so feel free to ignore it. The basic idea is to decompose into the following functions:

function to merge two SearchAfterAndBulkCreateReturnTypes into one (e.g.(a: A, b: A) => A)

function to reduce n SearchAfterAndBulkCreateReturnTypes via the above function, using createSearchAfterReturnType() as the starting value

That would eliminate the need for these prev/next parameters and the partialMerge stuff. Again, just a suggestion, take it or leave it!

rylnd · 2020-09-22T19:26:19Z

...ck/plugins/security_solution/server/lib/detection_engine/signals/search_after_bulk_create.ts

+        toReturn = mergeSearchAfterReturnTypeFromResponse({
          searchResult,
-          searchDuration,
-        }: { searchResult: SignalSearchResponse; searchDuration: string } = await singleSearchAfter(
-          {
-            searchAfterSortId: sortId,
-            index: inputIndexPattern,
-            from: tuple.from.toISOString(),
-            to: tuple.to.toISOString(),
-            services,
-            logger,
-            filter,
-            pageSize: tuple.maxSignals < pageSize ? Math.ceil(tuple.maxSignals) : pageSize, // maximum number of docs to receive per search result.
-            timestampOverride: ruleParams.timestampOverride,
-          }
-        );
-        toReturn.searchAfterTimes.push(searchDuration);
+          prev: toReturn,
+          next: createSearchAfterReturnType({
+            searchAfterTimes: [searchDuration],
+            errors: searchErrors,
+          }),
+        });


With those suggested changes this could be:

toReturn = mergeReturns([ toReturn, createSearchAfterReturnFromResponse(searchResult), createSearchAfterReturnType(), ]);

I think with the changes where I was able to utilize an N array of items for the merge which respect the order I was able to do this:

toReturn = mergeReturns([ toReturn, createSearchAfterReturnTypeFromResponse({ searchResult }), createSearchAfterReturnType({ searchAfterTimes: [searchDuration], errors: searchErrors, }), ]);

And then remove that specific function. So I think this is all cleaning up nicely. I will update and make sure all the unit tests work and then re-do the ad-hoc tests again and push this all up.

Really really appreciate the thoughts you give to the API's in these places. Really makes things a lot better.

kibanamachine · 2020-09-23T00:51:07Z

💚 Build Succeeded

continuous-integration/kibana-ci/pull-request
Commit: 8215f29

Build metrics

✅ unchanged

History

💚 Build #76376 succeeded 48e790a
💚 Build #75983 succeeded 600b695
💚 Build #75832 succeeded e4134a6

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

…from ES queries to the UI (elastic#78004) ## Summary Fixes: elastic#77254 Bubbles up error messages from ES queries that have _shards.failures in them. For example if you have errors in your exceptions list you will need to see them bubbled up. Steps to reproduce: Go to a detections rule and add an invalid value within the exceptions such as this one below: <img width="1523" alt="Screen Shot 2020-09-21 at 7 52 59 AM" src="https://user-images.githubusercontent.com/1151048/93817197-d1a53780-fc15-11ea-8cf2-4dd7fd5a3c13.png"> Notice that rsa.internal.level value is not a numeric but a text string. You should now see this error message where before you could not: <img width="1503" alt="Screen Shot 2020-09-21 at 7 52 44 AM" src="https://user-images.githubusercontent.com/1151048/93817231-e1bd1700-fc15-11ea-9038-99668233191a.png"> ### Checklist - [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios

* master: (31 commits) skip tests for old pacakge (elastic#78194) [Ingest Pipelines] Add url generator for ingest pipelines app (elastic#77872) [Lens] Rename "telemetry" to "stats" (elastic#78125) [CSM] Url search (elastic#77516) [Drilldowns] Config to disable URL Drilldown (elastic#77887) [Lens] Combined histogram/range aggregation for numbers (elastic#76121) Remove legacy plugins support (elastic#77599) 'Auto' interval must be correctly calculated for natural numbers (elastic#77995) [CSM] fix ingest data retry order messed up (elastic#78163) Add response status helpers (elastic#78006) Bump react-beautiful-dnd (elastic#78028) [Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI (elastic#78004) Index pattern - refactor constructor (elastic#77791) Add `xpack.security.sameSiteCookies` to docker allow list (elastic#78192) Remove [key: string]: any; from IIndexPattern (elastic#77968) Remove requirement for manage_index_templates privilege for Index Management (elastic#77377) [Ingest Manager] Agent bulk actions UI (elastic#77690) [Metrics UI] Add inventory view timeline (elastic#77804) Reporting/Docs: Updates for setting to enable CSV Download (elastic#78101) Update to latest rum-react (elastic#78193) ...

…from ES queries to the UI (#78004) (#78244) ## Summary Fixes: #77254 Bubbles up error messages from ES queries that have _shards.failures in them. For example if you have errors in your exceptions list you will need to see them bubbled up. Steps to reproduce: Go to a detections rule and add an invalid value within the exceptions such as this one below: <img width="1523" alt="Screen Shot 2020-09-21 at 7 52 59 AM" src="https://user-images.githubusercontent.com/1151048/93817197-d1a53780-fc15-11ea-8cf2-4dd7fd5a3c13.png"> Notice that rsa.internal.level value is not a numeric but a text string. You should now see this error message where before you could not: <img width="1503" alt="Screen Shot 2020-09-21 at 7 52 44 AM" src="https://user-images.githubusercontent.com/1151048/93817231-e1bd1700-fc15-11ea-9038-99668233191a.png"> ### Checklist - [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios

elasticmachine · 2021-09-23T14:25:02Z

Pinging @elastic/security-solution (Team: SecuritySolution)

Bubbles up error messages from ES queries to the front end

e4134a6

FrankHassanabad self-assigned this Sep 21, 2020

FrankHassanabad added v8.0.0 v7.11.0 v7.10.0 labels Sep 21, 2020

FrankHassanabad added 2 commits September 21, 2020 13:49

Unit tests added

0b734b5

Merge branch 'master' into bubble-up-errors-from-query

600b695

FrankHassanabad marked this pull request as ready for review September 21, 2020 20:24

FrankHassanabad requested review from a team as code owners September 21, 2020 20:24

FrankHassanabad added the release_note:fix label Sep 21, 2020

FrankHassanabad changed the title ~~Bubbles up error messages from ES queries to the front end~~ [Security Solution][Detection Engine] Bubbles up error messages from ES queries to the UI Sep 21, 2020

FrankHassanabad changed the title ~~[Security Solution][Detection Engine] Bubbles up error messages from ES queries to the UI~~ [Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI Sep 21, 2020

FrankHassanabad added the Team:SIEM label Sep 21, 2020

FrankHassanabad added the Feature:Detection Rules Anything related to Security Solution's Detection Rules label Sep 21, 2020

dhurley14 approved these changes Sep 22, 2020

View reviewed changes

rylnd approved these changes Sep 22, 2020

View reviewed changes

FrankHassanabad added 3 commits September 22, 2020 14:50

Merge branch 'master' into bubble-up-errors-from-query

1b94cd2

Refactored from suggestions from PR review

48e790a

Renamed to be shorter and more consumable

8215f29

FrankHassanabad merged commit d79fbb3 into elastic:master Sep 23, 2020

FrankHassanabad deleted the bubble-up-errors-from-query branch September 23, 2020 01:19

FrankHassanabad mentioned this pull request Sep 23, 2020

[7.x] [Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI (#78004) #78244

Merged

MindyRS added the Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. label Sep 23, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI #78004

[Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI #78004

FrankHassanabad commented Sep 21, 2020 •

edited

Loading

elasticmachine commented Sep 21, 2020

dhurley14 left a comment

rylnd left a comment

rylnd Sep 22, 2020

FrankHassanabad Sep 22, 2020

rylnd Sep 22, 2020

FrankHassanabad Sep 22, 2020

rylnd Sep 22, 2020

FrankHassanabad Sep 22, 2020

rylnd Sep 22, 2020

rylnd Sep 22, 2020

FrankHassanabad Sep 22, 2020 •

edited

Loading

kibanamachine commented Sep 23, 2020

elasticmachine commented Sep 23, 2021

[Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI #78004

[Security Solution][Detection Engine] Bubbles up more error messages from ES queries to the UI #78004

Conversation

FrankHassanabad commented Sep 21, 2020 • edited Loading

Summary

Checklist

elasticmachine commented Sep 21, 2020

dhurley14 left a comment

Choose a reason for hiding this comment

rylnd left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

FrankHassanabad Sep 22, 2020 • edited Loading

Choose a reason for hiding this comment

kibanamachine commented Sep 23, 2020

💚 Build Succeeded

Build metrics

History

elasticmachine commented Sep 23, 2021

FrankHassanabad commented Sep 21, 2020 •

edited

Loading

FrankHassanabad Sep 22, 2020 •

edited

Loading