[ML] Fixes anomaly detection validation when using advanced properties in the analysis config #82703

jgowdyelastic · 2020-11-05T11:10:50Z

Fixes validation of anomaly detection jobs in the advanced job wizard when the configuration has been edited to include one of the following properties in the analysis_config:

categorization_analyzer
categorization_filters
latency
multivariate_by_fields

This has been done by adding items which were in the analysis_config interface but not the schema.

Fixes #82698

This was checked for breaking API changes and was labeled appropriately

elasticmachine · 2020-11-05T11:10:52Z

Pinging @elastic/ml-ui (:ml)

peteharverson

LGTM

walterra

LGTM

* [ML] Updating analyss config schema * better schema order

kibanamachine · 2020-12-01T17:19:53Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request
Commit: ab4dc8f
Pipeline Steps (look for red circles / failed steps)
Interpreting CI Failures

Failed CI Steps

Test Failures

X-Pack Accessibility Tests.x-pack/test/accessibility/apps/dashboard_edit_panel·ts.Dashboard Edit Panel "before all" hook for " A11y test on dashboard edit panel menu options"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:03:25]         └-: Dashboard Edit Panel
[00:03:25]           └-> "before all" hook
[00:03:25]           └-> "before all" hook
[00:03:25]             │ info [dashboard/drilldowns] Loading "mappings.json"
[00:03:25]             │ info [dashboard/drilldowns] Loading "data.json"
[00:03:25]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_1/_N6zk1sQSjqMn9FdUIjUFw] deleting index
[00:03:25]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2/EMpyFv9QRqCJDw7EzUcuQg] deleting index
[00:03:25]             │ info [dashboard/drilldowns] Deleted existing index [".kibana_2",".kibana_1"]
[00:03:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:03:25]             │ info [dashboard/drilldowns] Created index ".kibana"
[00:03:25]             │ debg [dashboard/drilldowns] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:03:25]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana/lQJjXX-1Qh-0isOPyrabbQ] update_mapping [_doc]
[00:03:25]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana/lQJjXX-1Qh-0isOPyrabbQ] update_mapping [_doc]
[00:03:25]             │ info [dashboard/drilldowns] Indexed 12 docs into ".kibana"
[00:03:25]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana/lQJjXX-1Qh-0isOPyrabbQ] update_mapping [_doc]
[00:03:25]             │ debg Migrating saved objects
[00:03:25]             │ proc [kibana]   log   [17:22:19.606] [info][savedobjects-service] Creating index .kibana_2.
[00:03:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:03:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] updating number_of_replicas to [0] for indices [.kibana_2]
[00:03:26]             │ proc [kibana]   log   [17:22:19.680] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:03:26]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:03:26]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] updating number_of_replicas to [0] for indices [.kibana_1]
[00:03:26]             │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] 6492 finished with response BulkByScrollResponse[took=39.6ms,timed_out=false,sliceId=null,updated=0,created=12,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:03:26]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana/lQJjXX-1Qh-0isOPyrabbQ] deleting index
[00:03:26]             │ proc [kibana]   log   [17:22:20.038] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:03:26]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2/kpudNpV_SBKEXHuF_mZyPg] update_mapping [_doc]
[00:03:26]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2/kpudNpV_SBKEXHuF_mZyPg] update_mapping [_doc]
[00:03:26]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2/kpudNpV_SBKEXHuF_mZyPg] update_mapping [_doc]
[00:03:26]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2/kpudNpV_SBKEXHuF_mZyPg] update_mapping [_doc]
[00:03:26]             │ proc [kibana]   log   [17:22:20.307] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:03:26]             │ proc [kibana]   log   [17:22:20.351] [info][savedobjects-service] Finished in 747ms.
[00:03:26]             │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:03:26]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] [.kibana_2/kpudNpV_SBKEXHuF_mZyPg] update_mapping [_doc]
[00:03:28]             │ info [logstash_functional] Loading "mappings.json"
[00:03:28]             │ info [logstash_functional] Loading "data.json.gz"
[00:03:28]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] failed on parsing mappings on index creation [logstash-2015.09.22]
[00:03:28]             │      org.elasticsearch.index.mapper.MapperParsingException: Failed to parse mapping: No handler for type [runtime] declared on field [runtime_number]
[00:03:28]             │      	at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:304) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:277) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.updateIndexMappingsAndBuildSortOrder(MetadataCreateIndexService.java:915) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.lambda$applyCreateIndexWithTemporaryService$2(MetadataCreateIndexService.java:409) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.indices.IndicesService.withTempIndexService(IndicesService.java:621) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexWithTemporaryService(MetadataCreateIndexService.java:407) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequestWithV1Templates(MetadataCreateIndexService.java:485) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:370) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:377) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService$1.execute(MetadataCreateIndexService.java:300) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:59) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:697) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:319) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:214) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:674) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]
[00:03:28]             │      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]
[00:03:28]             │      	at java.lang.Thread.run(Thread.java:832) [?:?]
[00:03:28]             │      Caused by: org.elasticsearch.index.mapper.MapperParsingException: No handler for type [runtime] declared on field [runtime_number]
[00:03:28]             │      	at org.elasticsearch.index.mapper.ObjectMapper$TypeParser.parseProperties(ObjectMapper.java:311) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.index.mapper.ObjectMapper$TypeParser.parseObjectOrDocumentTypeProperties(ObjectMapper.java:232) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.index.mapper.RootObjectMapper$TypeParser.parse(RootObjectMapper.java:150) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:93) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:82) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:302) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:28]             │      	... 22 more
[00:03:28]             │ info Taking screenshot "/dev/shm/workspace/parallel/12/kibana/x-pack/test/functional/screenshots/failure/Dashboard Edit Panel _before all_ hook.png"
[00:03:28]             │ info Current URL is: http://localhost:61121/app/management/kibana/settings
[00:03:28]             │ info Saving page source to: /dev/shm/workspace/parallel/12/kibana/x-pack/test/functional/failure_debug/html/Dashboard Edit Panel _before all_ hook.html
[00:03:28]             └- ✖ fail: Dashboard Edit Panel "before all" hook for " A11y test on dashboard edit panel menu options"
[00:03:28]             │      Error: [mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_number]
[00:03:28]             │       at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:03:28]             │       at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:03:28]             │       at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:03:28]             │       at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4949:19)
[00:03:28]             │       at endReadableNT (_stream_readable.js:1145:12)
[00:03:28]             │       at process._tickCallback (internal/process/next_tick.js:63:19)
[00:03:28]             │ 
[00:03:28]             │

Stack Trace

{ Error: [mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_number]
    at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
    at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
    at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
    at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4949:19)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)
  status: 400,
  displayName: 'BadRequest',
  message:
   '[mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_number]',
  path: '/logstash-2015.09.22',
  query: {},
  body:
   { error:
      { root_cause: [Array],
        type: 'mapper_parsing_exception',
        reason:
         'Failed to parse mapping: No handler for type [runtime] declared on field [runtime_number]',
        caused_by: [Object] },
     status: 400 },
  statusCode: 400,
  response:
   '{"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"No handler for type [runtime] declared on field [runtime_number]"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping: No handler for type [runtime] declared on field [runtime_number]","caused_by":{"type":"mapper_parsing_exception","reason":"No handler for type [runtime] declared on field [runtime_number]"}},"status":400}',
  toString: [Function],
  toJSON: [Function] }

X-Pack API Integration Tests (Security Basic).x-pack/test/api_integration/apis/security/index_fields·ts.security (basic license) Index Fields "before all" hook in "Index Fields"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: security (basic license)
[00:00:00]           └-> "before all" hook
[00:00:15]           └-: Index Fields
[00:00:15]             └-> "before all" hook
[00:00:15]             └-> "before all" hook
[00:00:15]               │ info [security/flstest/data] Loading "mappings.json"
[00:00:15]               │ info [security/flstest/data] Loading "data.json.gz"
[00:00:15]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] failed on parsing mappings on index creation [flstest]
[00:00:15]               │      org.elasticsearch.index.mapper.MapperParsingException: Failed to parse mapping: No handler for type [runtime] declared on field [runtime_customer_ssn]
[00:00:15]               │      	at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:304) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:277) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.updateIndexMappingsAndBuildSortOrder(MetadataCreateIndexService.java:915) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.lambda$applyCreateIndexWithTemporaryService$2(MetadataCreateIndexService.java:409) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.indices.IndicesService.withTempIndexService(IndicesService.java:621) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexWithTemporaryService(MetadataCreateIndexService.java:407) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequestWithV1Templates(MetadataCreateIndexService.java:485) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:370) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:377) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService$1.execute(MetadataCreateIndexService.java:300) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:59) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:697) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:319) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:214) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:674) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]
[00:00:15]               │      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]
[00:00:15]               │      	at java.lang.Thread.run(Thread.java:832) [?:?]
[00:00:15]               │      Caused by: org.elasticsearch.index.mapper.MapperParsingException: No handler for type [runtime] declared on field [runtime_customer_ssn]
[00:00:15]               │      	at org.elasticsearch.index.mapper.ObjectMapper$TypeParser.parseProperties(ObjectMapper.java:311) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.index.mapper.ObjectMapper$TypeParser.parseObjectOrDocumentTypeProperties(ObjectMapper.java:232) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.index.mapper.RootObjectMapper$TypeParser.parse(RootObjectMapper.java:150) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:93) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:82) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:302) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:00:15]               │      	... 22 more
[00:00:15]               └- ✖ fail: security (basic license) Index Fields "before all" hook in "Index Fields"
[00:00:15]               │      Error: [mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_customer_ssn]
[00:00:15]               │       at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:00:15]               │       at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:00:15]               │       at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:00:15]               │       at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4949:19)
[00:00:15]               │       at endReadableNT (_stream_readable.js:1145:12)
[00:00:15]               │       at process._tickCallback (internal/process/next_tick.js:63:19)
[00:00:15]               │ 
[00:00:15]               │

Stack Trace

{ Error: [mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_customer_ssn]
    at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
    at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
    at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
    at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4949:19)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)
  status: 400,
  displayName: 'BadRequest',
  message:
   '[mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_customer_ssn]',
  path: '/flstest',
  query: {},
  body:
   { error:
      { root_cause: [Array],
        type: 'mapper_parsing_exception',
        reason:
         'Failed to parse mapping: No handler for type [runtime] declared on field [runtime_customer_ssn]',
        caused_by: [Object] },
     status: 400 },
  statusCode: 400,
  response:
   '{"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"No handler for type [runtime] declared on field [runtime_customer_ssn]"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping: No handler for type [runtime] declared on field [runtime_customer_ssn]","caused_by":{"type":"mapper_parsing_exception","reason":"No handler for type [runtime] declared on field [runtime_customer_ssn]"}},"status":400}',
  toString: [Function],
  toJSON: [Function] }

Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/security/secure_roles_perm·js.security app secure roles and permissions "before all" hook for "should add new role logstash_reader"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: security app
[00:00:00]           └-> "before all" hook
[00:03:08]           └-: secure roles and permissions
[00:03:08]             └-> "before all" hook
[00:03:08]             └-> "before all" hook
[00:03:08]               │ debg users
[00:03:08]               │ info [logstash_functional] Loading "mappings.json"
[00:03:08]               │ info [logstash_functional] Loading "data.json.gz"
[00:03:08]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1606841254859814255] failed on parsing mappings on index creation [logstash-2015.09.22]
[00:03:08]               │      org.elasticsearch.index.mapper.MapperParsingException: Failed to parse mapping: No handler for type [runtime] declared on field [runtime_number]
[00:03:08]               │      	at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:304) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:277) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.updateIndexMappingsAndBuildSortOrder(MetadataCreateIndexService.java:915) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.lambda$applyCreateIndexWithTemporaryService$2(MetadataCreateIndexService.java:409) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.indices.IndicesService.withTempIndexService(IndicesService.java:621) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexWithTemporaryService(MetadataCreateIndexService.java:407) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequestWithV1Templates(MetadataCreateIndexService.java:485) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:370) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:377) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService$1.execute(MetadataCreateIndexService.java:300) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:59) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:697) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:319) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:214) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:674) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]
[00:03:08]               │      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]
[00:03:08]               │      	at java.lang.Thread.run(Thread.java:832) [?:?]
[00:03:08]               │      Caused by: org.elasticsearch.index.mapper.MapperParsingException: No handler for type [runtime] declared on field [runtime_number]
[00:03:08]               │      	at org.elasticsearch.index.mapper.ObjectMapper$TypeParser.parseProperties(ObjectMapper.java:311) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.index.mapper.ObjectMapper$TypeParser.parseObjectOrDocumentTypeProperties(ObjectMapper.java:232) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.index.mapper.RootObjectMapper$TypeParser.parse(RootObjectMapper.java:150) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:93) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:82) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:302) ~[elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT]
[00:03:08]               │      	... 22 more
[00:03:08]               │ info Taking screenshot "/dev/shm/workspace/parallel/15/kibana/x-pack/test/functional/screenshots/failure/security app secure roles and permissions _before all_ hook.png"
[00:03:09]               │ info Current URL is: http://localhost:61151/app/management/security/roles
[00:03:09]               │ info Saving page source to: /dev/shm/workspace/parallel/15/kibana/x-pack/test/functional/failure_debug/html/security app secure roles and permissions _before all_ hook.html
[00:03:09]               └- ✖ fail: security app secure roles and permissions "before all" hook for "should add new role logstash_reader"
[00:03:09]               │      Error: [mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_number]
[00:03:09]               │       at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:03:09]               │       at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:03:09]               │       at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:03:09]               │       at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4949:19)
[00:03:09]               │       at endReadableNT (_stream_readable.js:1145:12)
[00:03:09]               │       at process._tickCallback (internal/process/next_tick.js:63:19)
[00:03:09]               │ 
[00:03:09]               │

Stack Trace

{ Error: [mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_number]
    at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
    at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
    at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
    at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/lodash/lodash.js:4949:19)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)
  status: 400,
  displayName: 'BadRequest',
  message:
   '[mapper_parsing_exception] No handler for type [runtime] declared on field [runtime_number]',
  path: '/logstash-2015.09.22',
  query: {},
  body:
   { error:
      { root_cause: [Array],
        type: 'mapper_parsing_exception',
        reason:
         'Failed to parse mapping: No handler for type [runtime] declared on field [runtime_number]',
        caused_by: [Object] },
     status: 400 },
  statusCode: 400,
  response:
   '{"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"No handler for type [runtime] declared on field [runtime_number]"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping: No handler for type [runtime] declared on field [runtime_number]","caused_by":{"type":"mapper_parsing_exception","reason":"No handler for type [runtime] declared on field [runtime_number]"}},"status":400}',
  toString: [Function],
  toJSON: [Function] }

and 9 more failures, only showing the first 3.

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
`infra`	1145	1144	-1

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
`infra`	2.6MB	2.6MB	-8.9KB

Saved Objects .kibana field count

Every field in each saved object type adds overhead to Elasticsearch. Kibana needs to keep the total field count below Elasticsearch's default limit of 1000 fields. Only specify field mappings for the fields you wish to search on or query. See https://www.elastic.co/guide/en/kibana/master/development-plugin-saved-objects.html#_mappings

id	before	after	diff
`fleet-agents`	25	23	-2
`ingest-outputs`	11	10	-1
`ingest-package-policies`	35	30	-5
`lens`	7	6	-1
total			-9

History

💚 Build #86073 succeeded ab4dc8f

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[ML] Updating analyss config schema

5ee21a2

jgowdyelastic added review release_note:fix backport pending :ml Feature:Anomaly Detection ML anomaly detection v8.0.0 v7.11.0 v7.10.1 labels Nov 5, 2020

jgowdyelastic requested review from walterra and peteharverson November 5, 2020 11:10

jgowdyelastic requested a review from a team as a code owner November 5, 2020 11:10

jgowdyelastic self-assigned this Nov 5, 2020

jgowdyelastic changed the title ~~[ML] Updating analyss config schema~~ [ML] Updating analysis config schema Nov 5, 2020

better schema order

ab4dc8f

peteharverson approved these changes Nov 5, 2020

View reviewed changes

walterra approved these changes Nov 5, 2020

View reviewed changes

jgowdyelastic merged commit f4386fc into elastic:master Nov 5, 2020

jgowdyelastic deleted the upating-analysis-config-schema branch November 5, 2020 13:41

jgowdyelastic mentioned this pull request Nov 5, 2020

[7.x] [ML] Updating analysis config schema (#82703) #82714

Merged

jgowdyelastic added a commit that referenced this pull request Nov 5, 2020

[ML] Updating analysis config schema (#82703) (#82714)

3d3d3bc

* [ML] Updating analyss config schema * better schema order

jgowdyelastic mentioned this pull request Nov 12, 2020

[7.10] [ML] Updating analysis config schema (#82703) #83258

Merged

jgowdyelastic added a commit that referenced this pull request Nov 12, 2020

[ML] Updating analysis config schema (#82703) (#83258)

679645f

* [ML] Updating analyss config schema * better schema order

jgowdyelastic removed the backport pending label Nov 17, 2020

peteharverson changed the title ~~[ML] Updating analysis config schema~~ [ML] Fixes anomaly detection validation when using advanced props in the analysis config Dec 1, 2020

peteharverson changed the title ~~[ML] Fixes anomaly detection validation when using advanced props in the analysis config~~ [ML] Fixes anomaly detection validation when using advanced properties in the analysis config Dec 1, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ML] Fixes anomaly detection validation when using advanced properties in the analysis config #82703

[ML] Fixes anomaly detection validation when using advanced properties in the analysis config #82703

jgowdyelastic commented Nov 5, 2020 •

edited by peteharverson

Loading

elasticmachine commented Nov 5, 2020

peteharverson left a comment

walterra left a comment

kibanamachine commented Dec 1, 2020 •

edited

Loading

Standard Out

Stack Trace

Standard Out

Stack Trace

Standard Out

Stack Trace

[ML] Fixes anomaly detection validation when using advanced properties in the analysis config #82703

[ML] Fixes anomaly detection validation when using advanced properties in the analysis config #82703

Conversation

jgowdyelastic commented Nov 5, 2020 • edited by peteharverson Loading

elasticmachine commented Nov 5, 2020

peteharverson left a comment

Choose a reason for hiding this comment

walterra left a comment

Choose a reason for hiding this comment

kibanamachine commented Dec 1, 2020 • edited Loading

💔 Build Failed

Failed CI Steps

Test Failures

Standard Out

Stack Trace

Standard Out

Stack Trace

Standard Out

Stack Trace

Metrics [docs]

Module Count

Async chunks

Saved Objects .kibana field count

History

jgowdyelastic commented Nov 5, 2020 •

edited by peteharverson

Loading

kibanamachine commented Dec 1, 2020 •

edited

Loading