Failing ES Promotion: x-pack/test/api_integration/apis/ml/job_validation/cardinality·ts.apis Machine Learning job validation ValidateCardinality should recognize a high model plot cardinality

[spalger]

A failing ML test is preventing the promotion of a new 7.11 and master snapshot of ES.

Stacktrace

{ Error: expected [ { id: 'cardinality_model_plot_high',
    modelPlotCardinality: 4675 },
  { id: 'cardinality_partition_field',
    fieldName: 'order_id' } ] to sort of equal [ { id: 'cardinality_model_plot_high',
    modelPlotCardinality: 4711 },
  { id: 'cardinality_partition_field',
    fieldName: 'order_id' } ]
    at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.it (test/api_integration/apis/ml/job_validation/cardinality.ts:97:23)
  actual:
   '[\n  {\n    "id": "cardinality_model_plot_high"\n    "modelPlotCardinality": 4675\n  }\n  {\n    "fieldName": "order_id"\n    "id": "cardinality_partition_field"\n  }\n]',
  expected:
   '[\n  {\n    "id": "cardinality_model_plot_high"\n    "modelPlotCardinality": 4711\n  }\n  {\n    "fieldName": "order_id"\n    "id": "cardinality_partition_field"\n  }\n]',
  showDiff: true }

7.x/7.11: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/1586/testReport//junit/X-Pack%20API%20Integration%20Tests/x-pack_test_api_integration_apis_ml_job_validation_cardinality%C2%B7ts/Kibana_Pipeline___kibana_xpack_agent___apis_Machine_Learning_job_validation_ValidateCardinality_should_recognize_a_high_model_plot_cardinality
master: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/1587/testReport//junit/X-Pack%20API%20Integration%20Tests/x-pack_test_api_integration_apis_ml_job_validation_cardinality%C2%B7ts/Kibana_Pipeline___kibana_xpack_agent___apis_Machine_Learning_job_validation_ValidateCardinality_should_recognize_a_high_model_plot_cardinality

[elasticmachine]

Pinging @elastic/kibana-test-triage (failed-test)

[elasticmachine]

Pinging @elastic/ml-ui (:ml)

[pheyos]

I've looked into this and tracked it down to some changing numbers of the ES cardinality aggregation. It seems there was an issue in the past where sometimes the numbers were not accurate and the new numbers look correct.

I've disabled the failing tests for now and will re-enable them with updated numbers after the ES snapshot promotion is done.

master: f6b01f5
7.x/7.11: 5281926

[pheyos]

Turns out that there's another test that fails for the same reason and needs to be disabled.

master: 681c6ab
7.x/7.11: c0f7264