Fixed a bug impacting data filter configuration through the visual editor.

[AWSHurneyt]

Description

1. Fixed a bug impacting data filter configuration through the visual editor.
2. Added integration test.
3. Reduced cypress test flakiness.

Issues Resolved

1. Bug issue [BUG] Cannot add data filter when creating monitor in alerting #558
2. Flaky test tracking issue [BUG] Tracking issue for known flaky tests #415

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[AWSHurneyt]

Created a separate PR to resolve the unit test failure, as it seems unrelated to these changes.
#576

[codecov]

Codecov Report

Merging #574 (5d6da94) into main (353aa25) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #574   +/-   ##
=======================================
  Coverage   52.86%   52.86%           
=======================================
  Files         212      212           
  Lines        5594     5594           
  Branches      782      782           
=======================================
  Hits         2957     2957           
  Misses       2635     2635           
  Partials        2        2           

see 2 files with indirect coverage changes

[AWSHurneyt]

Created a separate PR to resolve the unit test failure, as it seems unrelated to these changes. #576

That PR was merged. Pulled those changes into the dev branch for this PR, and now the unit tests are passing.

[AWSHurneyt]

The cypress tests are expected to fail on main branch at the moment. They succeed locally, and in this dummy PR that runs the tests against the 2.x branch AWSHurneyt#11

[getsaurabh02]

LGTM

[zakisaad]

Hello

This is impacting us on production: we cannot create new monitors (we are using Amazon OS version OpenSearch_2_7_R20230706). When could we expect this to be made available to upgrade to (I note your username has an AWS affilication, @AWSHurneyt - hope you have some insight).

[AWSHurneyt]

Hi @zakisaad ,
We don't have a scheduled date for 2.7 patch at the moment. This fix is present in OpenSearch 2.9.
https://opensearch.org/releases.html

As a workaround, data filters can be configured using the extraction query editor UI. Here's an example of what it would look like if you wanted to add products.product_id is 123 and user is steph filters to the opensearch_dashboards_sample_data_ecommerce index.

{
  "size": 0,
  "aggregations": {
    "composite_agg": {
      "composite": {
        "sources": [
          {
            "user": {
              "terms": {
                "field": "user"
              }
            }
          }
        ]
      },
      "aggs": {}
    }
  },
  "query": {
    "bool": {
      "filter": [
        {
          "range": {
            "order_date": {
              "gte": "{{period_end}}||-1h",
              "lte": "{{period_end}}",
              "format": "epoch_millis"
            }
          }
        },
        {
          "term": {
            "products.product_id": 123
          }
        },
        {
          "term": {
            "user": "steph"
          }
        }
      ]
    }
  }
}