[CI] Add error steps and help links to PR comments

[brianseeders]

Add links to CI help page and directly to failed pipeline steps to PR comments.

I considered limiting the number of failed steps that will show up in the comment, but am currently choosing to let them all through and change it later if it ends up being an issue.

I'm filtering out git checkout errors, since those happen on so many jobs and aren't useful.

See below for example.

[brianseeders]

Example for posterity

💔 Build Failed

• continuous-integration/kibana-ci/pull-request
• Commit: 20cd78e
• Pipeline Steps (look for red circles / failed steps)
• Interpreting CI Failures

Failed CI Steps

• Test Script #1
• Test Script #2
• Test Script #3
• Test Script #4
• Test Script #5
• Test Script #6
• Test Script #7
• Test Script #8
• Test Script #9
• Test Script #10
• Error signal

History

• 💔 Build #34970 failed 14c21b0
• 💔 Build #34961 failed 8096d08
• 💔 Build #34960 failed 9c21f71

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[elasticmachine]

Pinging @elastic/kibana-operations (Team:Operations)

[brianseeders]

Creating URLs with proper tools looks like this:

def builder = new URIBuilder(env.BUILD_URL)
def url = builder
    .setPathSegments(builder.getPathSegments() + ['api', 'json'])
    .setParameter('tree', 'actions[nodes[iconColor,running,displayName,id,parents]]')
    .toString()

and actually produces incorrectly-formatted URLs, e.g.
https://kibana-ci.elastic.co/job/elastic+kibana+pipeline-pull-request/34782//api/json?tree=actions%5Bnodes%5BiconColor%2Crunning%2CdisplayName%2Cid%2Cparents%5D%5D

(notice the double //)

[spalger]

LGTM

[brianseeders]

@elasticmachine merge upstream

[kibanamachine]

💛 Build succeeded, but was flaky

• continuous-integration/kibana-ci/pull-request
• Commit: f51f811
• Flaky suites:
  • xpack-kibana-ciGroup6

---

Test Failures

Kibana Pipeline / kibana-xpack-agent / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/uptime/settings·ts.Uptime app with generated data uptime settings page changing index pattern setting is reflected elsewhere in UI

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 10 times on tracked branches: https://github.com/elastic/kibana/issues/60863

[00:00:00]       │
[00:00:00]         └-: Uptime app
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: with generated data
[00:00:00]             └-> "before all" hook
[00:00:32]             └-: uptime settings page
[00:00:32]               └-> "before all" hook
[00:00:32]               └-> loads the default settings
[00:00:32]                 └-> "before each" hook: global before each
[00:00:32]                 └-> "before each" hook: delete settings
[00:00:32]                   │ debg Deleting saved object [object Object]/%s
[00:00:33]                 └-> "before each" hook: load heartbeat data
[00:00:33]                   │ info [uptime/blank] Loading "mappings.json"
[00:00:33]                   │ info [uptime/blank] Loading "data.json"
[00:00:33]                   │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xl-1584907627037808851] [heartbeat-8-generated-test] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:00:33]                   │ info [uptime/blank] Created index "heartbeat-8-generated-test"
[00:00:33]                   │ debg [uptime/blank] "heartbeat-8-generated-test" settings {"index":{"mapping":{"total_fields":{"limit":"10000"}},"number_of_replicas":"1","number_of_shards":"1","query":{"default_field":["message","tags","agent.ephemeral_id","agent.id","agent.name","agent.type","agent.version","as.organization.name","client.address","client.as.organization.name","client.domain","client.geo.city_name","client.geo.continent_name","client.geo.country_iso_code","client.geo.country_name","client.geo.name","client.geo.region_iso_code","client.geo.region_name","client.mac","client.user.domain","client.user.email","client.user.full_name","client.user.group.id","client.user.group.name","client.user.hash","client.user.id","client.user.name","cloud.account.id","cloud.availability_zone","cloud.instance.id","cloud.instance.name","cloud.machine.type","cloud.provider","cloud.region","container.id","container.image.name","container.image.tag","container.name","container.runtime","destination.address","destination.as.organization.name","destination.domain","destination.geo.city_name","destination.geo.continent_name","destination.geo.country_iso_code","destination.geo.country_name","destination.geo.name","destination.geo.region_iso_code","destination.geo.region_name","destination.mac","destination.user.domain","destination.user.email","destination.user.full_name","destination.user.group.id","destination.user.group.name","destination.user.hash","destination.user.id","destination.user.name","dns.answers.class","dns.answers.data","dns.answers.name","dns.answers.type","dns.header_flags","dns.id","dns.op_code","dns.question.class","dns.question.name","dns.question.registered_domain","dns.question.type","dns.response_code","dns.type","ecs.version","error.code","error.id","error.message","event.action","event.category","event.code","event.dataset","event.hash","event.id","event.kind","event.module","event.original","event.outcome","event.provider","event.timezone","event.type","file.device","file.directory","file.extension","file.gid","file.group","file.hash.md5","file.hash.sha1","file.hash.sha256","file.hash.sha512","file.inode","file.mode","file.name","file.owner","file.path","file.target_path","file.type","file.uid","geo.city_name","geo.continent_name","geo.country_iso_code","geo.country_name","geo.name","geo.region_iso_code","geo.region_name","group.id","group.name","hash.md5","hash.sha1","hash.sha256","hash.sha512","host.architecture","host.geo.city_name","host.geo.continent_name","host.geo.country_iso_code","host.geo.country_name","host.geo.name","host.geo.region_iso_code","host.geo.region_name","host.hostname","host.id","host.mac","host.name","host.os.family","host.os.full","host.os.kernel","host.os.name","host.os.platform","host.os.version","host.type","host.user.domain","host.user.email","host.user.full_name","host.user.group.id","host.user.group.name","host.user.hash","host.user.id","host.user.name","http.request.body.content","http.request.method","http.request.referrer","http.response.body.content","http.version","log.level","log.logger","log.original","network.application","network.community_id","network.direction","network.iana_number","network.name","network.protocol","network.transport","network.type","observer.geo.city_name","observer.geo.continent_name","observer.geo.country_iso_code","observer.geo.country_name","observer.geo.name","observer.geo.region_iso_code","observer.geo.region_name","observer.hostname","observer.mac","observer.os.family","observer.os.full","observer.os.kernel","observer.os.name","observer.os.platform","observer.os.version","observer.serial_number","observer.type","observer.vendor","observer.version","organization.id","organization.name","os.family","os.full","os.kernel","os.name","os.platform","os.version","process.args","process.executable","process.hash.md5","process.hash.sha1","process.hash.sha256","process.hash.sha512","process.name","process.thread.name","process.title","process.working_directory","server.address","server.as.organization.name","server.domain","server.geo.city_name","server.geo.continent_name","server.geo.country_iso_code","server.geo.country_name","server.geo.name","server.geo.region_iso_code","server.geo.region_name","server.mac","server.user.domain","server.user.email","server.user.full_name","server.user.group.id","server.user.group.name","server.user.hash","server.user.id","server.user.name","service.ephemeral_id","service.id","service.name","service.state","service.type","service.version","source.address","source.as.organization.name","source.domain","source.geo.city_name","source.geo.continent_name","source.geo.country_iso_code","source.geo.country_name","source.geo.name","source.geo.region_iso_code","source.geo.region_name","source.mac","source.user.domain","source.user.email","source.user.full_name","source.user.group.id","source.user.group.name","source.user.hash","source.user.id","source.user.name","tracing.trace.id","tracing.transaction.id","url.domain","url.fragment","url.full","url.original","url.password","url.path","url.query","url.scheme","url.username","user.domain","user.email","user.full_name","user.group.id","user.group.name","user.hash","user.id","user.name","user_agent.device.name","user_agent.name","user_agent.original","user_agent.os.family","user_agent.os.full","user_agent.os.kernel","user_agent.os.name","user_agent.os.platform","user_agent.os.version","user_agent.version","agent.hostname","error.type","timeseries.instance","cloud.project.id","cloud.image.id","host.os.build","host.os.codename","kubernetes.pod.name","kubernetes.pod.uid","kubernetes.namespace","kubernetes.node.name","kubernetes.replicaset.name","kubernetes.deployment.name","kubernetes.statefulset.name","kubernetes.container.name","kubernetes.container.image","jolokia.agent.version","jolokia.agent.id","jolokia.server.product","jolokia.server.version","jolokia.server.vendor","jolokia.url","monitor.type","monitor.name","monitor.id","monitor.status","monitor.check_group","http.response.body.hash","fields.*"]},"refresh_interval":"5s"}}
[00:00:33]                 └-> "before each" hook: navigate to clean app root
[00:00:33]                   │ debg navigating to uptime url: http://localhost:6161/app/uptime
[00:00:33]                   │ debg Navigate to: http://localhost:6161/app/uptime
[00:00:33]                   │ debg ... sleep(700) start
[00:00:33]                   │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909742306 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:33]                   │
[00:00:33]                   │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:34]                   │ debg ... sleep(700) end
[00:00:34]                   │ debg returned from get, calling refresh
[00:00:35]                   │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909742306 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:35]                   │
[00:00:35]                   │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:36]                   │ debg currentUrl = http://localhost:6161/app/uptime
[00:00:36]                   │          appUrl = http://localhost:6161/app/uptime
[00:00:36]                   │ debg TestSubjects.find(kibanaChrome)
[00:00:36]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:00:42]                   │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 96:139970 "INFO: 2020-03-22T20:42:29Z
[00:00:42]                   │        Adding connection to http://localhost:6161/elasticsearch
[00:00:42]                   │
[00:00:42]                   │      "
[00:00:42]                   │ debg ... sleep(501) start
[00:00:43]                   │ debg ... sleep(501) end
[00:00:43]                   │ debg in navigateTo url = http://localhost:6161/app/uptime#/
[00:00:43]                   │ debg TestSubjects.exists(statusPageContainer)
[00:00:43]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:00:45]                   │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:00:46]                 │ debg TestSubjects.click(settings-page-link)
[00:00:46]                 │ debg Find.clickByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:00:46]                 │ debg Find.findByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:00:46]                 │ debg TestSubjects.find(heartbeat-indices-input)
[00:00:46]                 │ debg Find.findByCssSelector('[data-test-subj="heartbeat-indices-input"]') with timeout=5000
[00:00:46]                 └- ✓ pass  (292ms) "Uptime app with generated data uptime settings page loads the default settings"
[00:00:46]               └-> "after each" hook: unload
[00:00:46]                 │ info [uptime/blank] Unloading indices from "mappings.json"
[00:00:46]                 │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xl-1584907627037808851] [heartbeat-8-generated-test/RmCgfalVSNGLVfgfmDeTfw] deleting index
[00:00:46]                 │ info [uptime/blank] Deleted existing index "heartbeat-8-generated-test"
[00:00:46]                 │ info [uptime/blank] Unloading indices from "data.json"
[00:00:46]               └-> should disable the apply button when invalid or unchanged
[00:00:46]                 └-> "before each" hook: global before each
[00:00:46]                 └-> "before each" hook: delete settings
[00:00:46]                   │ debg Deleting saved object [object Object]/%s
[00:00:47]                 └-> "before each" hook: load heartbeat data
[00:00:47]                   │ info [uptime/blank] Loading "mappings.json"
[00:00:47]                   │ info [uptime/blank] Loading "data.json"
[00:00:47]                   │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xl-1584907627037808851] [heartbeat-8-generated-test] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:00:47]                   │ info [uptime/blank] Created index "heartbeat-8-generated-test"
[00:00:47]                   │ debg [uptime/blank] "heartbeat-8-generated-test" settings {"index":{"mapping":{"total_fields":{"limit":"10000"}},"number_of_replicas":"1","number_of_shards":"1","query":{"default_field":["message","tags","agent.ephemeral_id","agent.id","agent.name","agent.type","agent.version","as.organization.name","client.address","client.as.organization.name","client.domain","client.geo.city_name","client.geo.continent_name","client.geo.country_iso_code","client.geo.country_name","client.geo.name","client.geo.region_iso_code","client.geo.region_name","client.mac","client.user.domain","client.user.email","client.user.full_name","client.user.group.id","client.user.group.name","client.user.hash","client.user.id","client.user.name","cloud.account.id","cloud.availability_zone","cloud.instance.id","cloud.instance.name","cloud.machine.type","cloud.provider","cloud.region","container.id","container.image.name","container.image.tag","container.name","container.runtime","destination.address","destination.as.organization.name","destination.domain","destination.geo.city_name","destination.geo.continent_name","destination.geo.country_iso_code","destination.geo.country_name","destination.geo.name","destination.geo.region_iso_code","destination.geo.region_name","destination.mac","destination.user.domain","destination.user.email","destination.user.full_name","destination.user.group.id","destination.user.group.name","destination.user.hash","destination.user.id","destination.user.name","dns.answers.class","dns.answers.data","dns.answers.name","dns.answers.type","dns.header_flags","dns.id","dns.op_code","dns.question.class","dns.question.name","dns.question.registered_domain","dns.question.type","dns.response_code","dns.type","ecs.version","error.code","error.id","error.message","event.action","event.category","event.code","event.dataset","event.hash","event.id","event.kind","event.module","event.original","event.outcome","event.provider","event.timezone","event.type","file.device","file.directory","file.extension","file.gid","file.group","file.hash.md5","file.hash.sha1","file.hash.sha256","file.hash.sha512","file.inode","file.mode","file.name","file.owner","file.path","file.target_path","file.type","file.uid","geo.city_name","geo.continent_name","geo.country_iso_code","geo.country_name","geo.name","geo.region_iso_code","geo.region_name","group.id","group.name","hash.md5","hash.sha1","hash.sha256","hash.sha512","host.architecture","host.geo.city_name","host.geo.continent_name","host.geo.country_iso_code","host.geo.country_name","host.geo.name","host.geo.region_iso_code","host.geo.region_name","host.hostname","host.id","host.mac","host.name","host.os.family","host.os.full","host.os.kernel","host.os.name","host.os.platform","host.os.version","host.type","host.user.domain","host.user.email","host.user.full_name","host.user.group.id","host.user.group.name","host.user.hash","host.user.id","host.user.name","http.request.body.content","http.request.method","http.request.referrer","http.response.body.content","http.version","log.level","log.logger","log.original","network.application","network.community_id","network.direction","network.iana_number","network.name","network.protocol","network.transport","network.type","observer.geo.city_name","observer.geo.continent_name","observer.geo.country_iso_code","observer.geo.country_name","observer.geo.name","observer.geo.region_iso_code","observer.geo.region_name","observer.hostname","observer.mac","observer.os.family","observer.os.full","observer.os.kernel","observer.os.name","observer.os.platform","observer.os.version","observer.serial_number","observer.type","observer.vendor","observer.version","organization.id","organization.name","os.family","os.full","os.kernel","os.name","os.platform","os.version","process.args","process.executable","process.hash.md5","process.hash.sha1","process.hash.sha256","process.hash.sha512","process.name","process.thread.name","process.title","process.working_directory","server.address","server.as.organization.name","server.domain","server.geo.city_name","server.geo.continent_name","server.geo.country_iso_code","server.geo.country_name","server.geo.name","server.geo.region_iso_code","server.geo.region_name","server.mac","server.user.domain","server.user.email","server.user.full_name","server.user.group.id","server.user.group.name","server.user.hash","server.user.id","server.user.name","service.ephemeral_id","service.id","service.name","service.state","service.type","service.version","source.address","source.as.organization.name","source.domain","source.geo.city_name","source.geo.continent_name","source.geo.country_iso_code","source.geo.country_name","source.geo.name","source.geo.region_iso_code","source.geo.region_name","source.mac","source.user.domain","source.user.email","source.user.full_name","source.user.group.id","source.user.group.name","source.user.hash","source.user.id","source.user.name","tracing.trace.id","tracing.transaction.id","url.domain","url.fragment","url.full","url.original","url.password","url.path","url.query","url.scheme","url.username","user.domain","user.email","user.full_name","user.group.id","user.group.name","user.hash","user.id","user.name","user_agent.device.name","user_agent.name","user_agent.original","user_agent.os.family","user_agent.os.full","user_agent.os.kernel","user_agent.os.name","user_agent.os.platform","user_agent.os.version","user_agent.version","agent.hostname","error.type","timeseries.instance","cloud.project.id","cloud.image.id","host.os.build","host.os.codename","kubernetes.pod.name","kubernetes.pod.uid","kubernetes.namespace","kubernetes.node.name","kubernetes.replicaset.name","kubernetes.deployment.name","kubernetes.statefulset.name","kubernetes.container.name","kubernetes.container.image","jolokia.agent.version","jolokia.agent.id","jolokia.server.product","jolokia.server.version","jolokia.server.vendor","jolokia.url","monitor.type","monitor.name","monitor.id","monitor.status","monitor.check_group","http.response.body.hash","fields.*"]},"refresh_interval":"5s"}}
[00:00:47]                 └-> "before each" hook: navigate to clean app root
[00:00:47]                   │ debg navigating to uptime url: http://localhost:6161/app/uptime
[00:00:47]                   │ debg Navigate to: http://localhost:6161/app/uptime
[00:00:47]                   │ debg ... sleep(700) start
[00:00:47]                   │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909756300 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:47]                   │
[00:00:47]                   │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:48]                   │ debg ... sleep(700) end
[00:00:48]                   │ debg returned from get, calling refresh
[00:00:48]                   │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909756300 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:48]                   │
[00:00:48]                   │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:49]                   │ debg currentUrl = http://localhost:6161/app/uptime
[00:00:49]                   │          appUrl = http://localhost:6161/app/uptime
[00:00:49]                   │ debg TestSubjects.find(kibanaChrome)
[00:00:49]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:00:55]                   │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 96:139970 "INFO: 2020-03-22T20:42:43Z
[00:00:55]                   │        Adding connection to http://localhost:6161/elasticsearch
[00:00:55]                   │
[00:00:55]                   │      "
[00:00:55]                   │ debg ... sleep(501) start
[00:00:56]                   │ debg ... sleep(501) end
[00:00:56]                   │ debg in navigateTo url = http://localhost:6161/app/uptime#/
[00:00:56]                   │ debg TestSubjects.exists(statusPageContainer)
[00:00:56]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:00:58]                   │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:00:59]                 │ debg TestSubjects.click(settings-page-link)
[00:00:59]                 │ debg Find.clickByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:00:59]                 │ debg Find.findByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:00:59]                 │ debg TestSubjects.find(apply-settings-button)
[00:00:59]                 │ debg Find.findByCssSelector('[data-test-subj="apply-settings-button"]') with timeout=10000
[00:00:59]                 │ debg TestSubjects.find(heartbeat-indices-input)
[00:00:59]                 │ debg Find.findByCssSelector('[data-test-subj="heartbeat-indices-input"]') with timeout=5000
[00:00:59]                 │ debg TestSubjects.find(apply-settings-button)
[00:00:59]                 │ debg Find.findByCssSelector('[data-test-subj="apply-settings-button"]') with timeout=10000
[00:00:59]                 │ debg TestSubjects.find(heartbeat-indices-input)
[00:00:59]                 │ debg Find.findByCssSelector('[data-test-subj="heartbeat-indices-input"]') with timeout=5000
[00:00:59]                 │ debg TestSubjects.find(apply-settings-button)
[00:00:59]                 │ debg Find.findByCssSelector('[data-test-subj="apply-settings-button"]') with timeout=10000
[00:00:59]                 └- ✓ pass  (491ms) "Uptime app with generated data uptime settings page should disable the apply button when invalid or unchanged"
[00:00:59]               └-> "after each" hook: unload
[00:00:59]                 │ info [uptime/blank] Unloading indices from "mappings.json"
[00:00:59]                 │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xl-1584907627037808851] [heartbeat-8-generated-test/Yonh3K2xR86JDJ2VLx2KHg] deleting index
[00:00:59]                 │ info [uptime/blank] Deleted existing index "heartbeat-8-generated-test"
[00:00:59]                 │ info [uptime/blank] Unloading indices from "data.json"
[00:00:59]               └-> changing index pattern setting is reflected elsewhere in UI
[00:00:59]                 └-> "before each" hook: global before each
[00:00:59]                 └-> "before each" hook: delete settings
[00:00:59]                   │ debg Deleting saved object [object Object]/%s
[00:01:00]                 └-> "before each" hook: load heartbeat data
[00:01:00]                   │ info [uptime/blank] Loading "mappings.json"
[00:01:00]                   │ info [uptime/blank] Loading "data.json"
[00:01:00]                   │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xl-1584907627037808851] [heartbeat-8-generated-test] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:01:00]                   │ info [uptime/blank] Created index "heartbeat-8-generated-test"
[00:01:00]                   │ debg [uptime/blank] "heartbeat-8-generated-test" settings {"index":{"mapping":{"total_fields":{"limit":"10000"}},"number_of_replicas":"1","number_of_shards":"1","query":{"default_field":["message","tags","agent.ephemeral_id","agent.id","agent.name","agent.type","agent.version","as.organization.name","client.address","client.as.organization.name","client.domain","client.geo.city_name","client.geo.continent_name","client.geo.country_iso_code","client.geo.country_name","client.geo.name","client.geo.region_iso_code","client.geo.region_name","client.mac","client.user.domain","client.user.email","client.user.full_name","client.user.group.id","client.user.group.name","client.user.hash","client.user.id","client.user.name","cloud.account.id","cloud.availability_zone","cloud.instance.id","cloud.instance.name","cloud.machine.type","cloud.provider","cloud.region","container.id","container.image.name","container.image.tag","container.name","container.runtime","destination.address","destination.as.organization.name","destination.domain","destination.geo.city_name","destination.geo.continent_name","destination.geo.country_iso_code","destination.geo.country_name","destination.geo.name","destination.geo.region_iso_code","destination.geo.region_name","destination.mac","destination.user.domain","destination.user.email","destination.user.full_name","destination.user.group.id","destination.user.group.name","destination.user.hash","destination.user.id","destination.user.name","dns.answers.class","dns.answers.data","dns.answers.name","dns.answers.type","dns.header_flags","dns.id","dns.op_code","dns.question.class","dns.question.name","dns.question.registered_domain","dns.question.type","dns.response_code","dns.type","ecs.version","error.code","error.id","error.message","event.action","event.category","event.code","event.dataset","event.hash","event.id","event.kind","event.module","event.original","event.outcome","event.provider","event.timezone","event.type","file.device","file.directory","file.extension","file.gid","file.group","file.hash.md5","file.hash.sha1","file.hash.sha256","file.hash.sha512","file.inode","file.mode","file.name","file.owner","file.path","file.target_path","file.type","file.uid","geo.city_name","geo.continent_name","geo.country_iso_code","geo.country_name","geo.name","geo.region_iso_code","geo.region_name","group.id","group.name","hash.md5","hash.sha1","hash.sha256","hash.sha512","host.architecture","host.geo.city_name","host.geo.continent_name","host.geo.country_iso_code","host.geo.country_name","host.geo.name","host.geo.region_iso_code","host.geo.region_name","host.hostname","host.id","host.mac","host.name","host.os.family","host.os.full","host.os.kernel","host.os.name","host.os.platform","host.os.version","host.type","host.user.domain","host.user.email","host.user.full_name","host.user.group.id","host.user.group.name","host.user.hash","host.user.id","host.user.name","http.request.body.content","http.request.method","http.request.referrer","http.response.body.content","http.version","log.level","log.logger","log.original","network.application","network.community_id","network.direction","network.iana_number","network.name","network.protocol","network.transport","network.type","observer.geo.city_name","observer.geo.continent_name","observer.geo.country_iso_code","observer.geo.country_name","observer.geo.name","observer.geo.region_iso_code","observer.geo.region_name","observer.hostname","observer.mac","observer.os.family","observer.os.full","observer.os.kernel","observer.os.name","observer.os.platform","observer.os.version","observer.serial_number","observer.type","observer.vendor","observer.version","organization.id","organization.name","os.family","os.full","os.kernel","os.name","os.platform","os.version","process.args","process.executable","process.hash.md5","process.hash.sha1","process.hash.sha256","process.hash.sha512","process.name","process.thread.name","process.title","process.working_directory","server.address","server.as.organization.name","server.domain","server.geo.city_name","server.geo.continent_name","server.geo.country_iso_code","server.geo.country_name","server.geo.name","server.geo.region_iso_code","server.geo.region_name","server.mac","server.user.domain","server.user.email","server.user.full_name","server.user.group.id","server.user.group.name","server.user.hash","server.user.id","server.user.name","service.ephemeral_id","service.id","service.name","service.state","service.type","service.version","source.address","source.as.organization.name","source.domain","source.geo.city_name","source.geo.continent_name","source.geo.country_iso_code","source.geo.country_name","source.geo.name","source.geo.region_iso_code","source.geo.region_name","source.mac","source.user.domain","source.user.email","source.user.full_name","source.user.group.id","source.user.group.name","source.user.hash","source.user.id","source.user.name","tracing.trace.id","tracing.transaction.id","url.domain","url.fragment","url.full","url.original","url.password","url.path","url.query","url.scheme","url.username","user.domain","user.email","user.full_name","user.group.id","user.group.name","user.hash","user.id","user.name","user_agent.device.name","user_agent.name","user_agent.original","user_agent.os.family","user_agent.os.full","user_agent.os.kernel","user_agent.os.name","user_agent.os.platform","user_agent.os.version","user_agent.version","agent.hostname","error.type","timeseries.instance","cloud.project.id","cloud.image.id","host.os.build","host.os.codename","kubernetes.pod.name","kubernetes.pod.uid","kubernetes.namespace","kubernetes.node.name","kubernetes.replicaset.name","kubernetes.deployment.name","kubernetes.statefulset.name","kubernetes.container.name","kubernetes.container.image","jolokia.agent.version","jolokia.agent.id","jolokia.server.product","jolokia.server.version","jolokia.server.vendor","jolokia.url","monitor.type","monitor.name","monitor.id","monitor.status","monitor.check_group","http.response.body.hash","fields.*"]},"refresh_interval":"5s"}}
[00:01:00]                 └-> "before each" hook: navigate to clean app root
[00:01:00]                   │ debg navigating to uptime url: http://localhost:6161/app/uptime
[00:01:00]                   │ debg Navigate to: http://localhost:6161/app/uptime
[00:01:00]                   │ debg ... sleep(700) start
[00:01:00]                   │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909769325 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:01:00]                   │
[00:01:00]                   │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:01:01]                   │ debg ... sleep(700) end
[00:01:01]                   │ debg returned from get, calling refresh
[00:01:01]                   │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909769325 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:01:01]                   │
[00:01:01]                   │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:01:02]                   │ debg currentUrl = http://localhost:6161/app/uptime
[00:01:02]                   │          appUrl = http://localhost:6161/app/uptime
[00:01:02]                   │ debg TestSubjects.find(kibanaChrome)
[00:01:02]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:01:07]                   │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 96:139970 "INFO: 2020-03-22T20:42:55Z
[00:01:07]                   │        Adding connection to http://localhost:6161/elasticsearch
[00:01:07]                   │
[00:01:07]                   │      "
[00:01:07]                   │ debg ... sleep(501) start
[00:01:08]                   │ debg ... sleep(501) end
[00:01:08]                   │ debg in navigateTo url = http://localhost:6161/app/uptime#/
[00:01:08]                   │ debg TestSubjects.exists(statusPageContainer)
[00:01:08]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:01:10]                   │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:01:11]                 │ debg TestSubjects.getVisibleText(xpack.uptime.snapshot.donutChart.up)
[00:01:11]                 │ debg TestSubjects.find(xpack.uptime.snapshot.donutChart.up)
[00:01:11]                 │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.snapshot.donutChart.up"]') with timeout=10000
[00:01:11]                 │ debg TestSubjects.getVisibleText(xpack.uptime.snapshot.donutChart.down)
[00:01:11]                 │ debg TestSubjects.find(xpack.uptime.snapshot.donutChart.down)
[00:01:11]                 │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.snapshot.donutChart.down"]') with timeout=10000
[00:01:11]                 │ debg TestSubjects.click(settings-page-link)
[00:01:11]                 │ debg Find.clickByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:01:11]                 │ debg Find.findByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:01:11]                 │ debg TestSubjects.find(heartbeat-indices-input)
[00:01:11]                 │ debg Find.findByCssSelector('[data-test-subj="heartbeat-indices-input"]') with timeout=5000
[00:01:11]                 │ debg TestSubjects.find(apply-settings-button)
[00:01:11]                 │ debg Find.findByCssSelector('[data-test-subj="apply-settings-button"]') with timeout=10000
[00:01:12]                 │ debg Waiting up to 20000ms for submit to succeed...
[00:01:12]                 │ debg TestSubjects.find(heartbeat-indices-input)
[00:01:12]                 │ debg Find.findByCssSelector('[data-test-subj="heartbeat-indices-input"]') with timeout=5000
[00:01:12]                 │ debg browser[INFO] http://localhost:6161/app/uptime?#/settings 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:01:12]                 │
[00:01:12]                 │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:01:18]                 │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 96:139970 "INFO: 2020-03-22T20:43:06Z
[00:01:18]                 │        Adding connection to http://localhost:6161/elasticsearch
[00:01:18]                 │
[00:01:18]                 │      "
[00:01:18]                 │ debg navigating to uptime url: http://localhost:6161/app/uptime
[00:01:18]                 │ debg Navigate to: http://localhost:6161/app/uptime
[00:01:18]                 │ debg ... sleep(700) start
[00:01:18]                 │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909787343 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:01:18]                 │
[00:01:18]                 │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:01:19]                 │ debg ... sleep(700) end
[00:01:19]                 │ debg returned from get, calling refresh
[00:01:19]                 │ debg browser[INFO] http://localhost:6161/app/uptime?_t=1584909787343 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:01:19]                 │
[00:01:19]                 │ debg browser[INFO] http://localhost:6161/bundles/app/uptime/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:01:19]                 │ debg currentUrl = http://localhost:6161/app/uptime
[00:01:19]                 │          appUrl = http://localhost:6161/app/uptime
[00:01:19]                 │ debg TestSubjects.find(kibanaChrome)
[00:01:19]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:01:24]                 │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 96:139970 "INFO: 2020-03-22T20:43:12Z
[00:01:24]                 │        Adding connection to http://localhost:6161/elasticsearch
[00:01:24]                 │
[00:01:24]                 │      "
[00:01:24]                 │ debg ... sleep(501) start
[00:01:25]                 │ debg ... sleep(501) end
[00:01:25]                 │ debg in navigateTo url = http://localhost:6161/app/uptime#/
[00:01:25]                 │ debg TestSubjects.exists(statusPageContainer)
[00:01:25]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:01:27]                 │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:01:28]                 │ debg TestSubjects.find(data-missing)
[00:01:28]                 │ debg Find.findByCssSelector('[data-test-subj="data-missing"]') with timeout=5000
[00:01:28]                 │ debg TestSubjects.click(settings-page-link)
[00:01:28]                 │ debg Find.clickByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:01:28]                 │ debg Find.findByCssSelector('[data-test-subj="settings-page-link"]') with timeout=5000
[00:01:28]                 │ debg TestSubjects.find(heartbeat-indices-input)
[00:01:28]                 │ debg Find.findByCssSelector('[data-test-subj="heartbeat-indices-input"]') with timeout=5000
[00:01:28]                 │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/Uptime app with generated data uptime settings page changing index pattern setting is reflected elsewhere in UI.png"
[00:01:28]                 │ info Current URL is: http://localhost:6161/app/uptime#/settings
[00:01:28]                 │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/Uptime app with generated data uptime settings page changing index pattern setting is reflected elsewhere in UI.html
[00:01:28]                 └- ✖ fail: "Uptime app with generated data uptime settings page changing index pattern setting is reflected elsewhere in UI"
[00:01:28]                 │

Stack Trace

{ Error: expected { heartbeatIndices: 'heartbeat-8new*' } to sort of equal { heartbeatIndices: 'new*' }
    at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.it (test/functional/apps/uptime/settings.ts:68:25)
    at process._tickCallback (internal/process/next_tick.js:68:7)
  actual: '{\n  "heartbeatIndices": "heartbeat-8new*"\n}',
  expected: '{\n  "heartbeatIndices": "new*"\n}',
  showDiff: true }

---

History

• 💚 Build #34997 succeeded dcf6649
• 💔 Build #34995 failed 20cd78e
• 💔 Build #34970 failed 14c21b0
• 💔 Build #34961 failed 8096d08
• 💔 Build #34960 failed 9c21f71

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream