Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

feat: support creating (and removing) a policy for each scenario (#279) | fix: remove references to the default policy (#281) backport for 7.9.x #283

Merged
merged 3 commits into from
Sep 10, 2020
Merged

feat: support creating (and removing) a policy for each scenario (#279) | fix: remove references to the default policy (#281) backport for 7.9.x #283

merged 3 commits into from
Sep 10, 2020

Conversation

mdelapenya
Copy link
Contributor

Backports the following commits to 7.9.x:

@mdelapenya
feat: support creating (and removing) a policy for each scenario (ela…
27b9e87 
…stic#279)

* feat: support creating a policy per scenario, not reusing default one

* chore: extract tear down code to afterScenario methods

* fix: move creation of the policy to the before scenario hook

* fix: use proper URL after bad copy&paste

* chore: add debug logs for removals
# Conflicts:
#	e2e/_suites/ingest-manager/fleet.go
#	e2e/_suites/ingest-manager/ingest-manager_test.go
@mdelapenya
fix: remove references to the default policy (elastic#281)
380086a 
Internally, we were using the ID, so it should work as expected, but the
specs were not in sync
# Conflicts:
#	e2e/_suites/ingest-manager/features/agent_endpoint_integration.feature
#	e2e/_suites/ingest-manager/fleet.go
@mdelapenya mdelapenya self-assigned this Sep 10, 2020
@elasticmachine
Copy link
Contributor

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #283 opened]

  • Start Time: 2020-09-10T19:28:55.784+0000

  • Duration: 20 min 19 sec

Test stats 🧪

Test Results
Failed 2
Passed 69
Skipped 9
Total 80

Test errors

Expand to view the tests failures

  • Name: Initializing / End-To-End Tests / ingest-manager_agent_endpoint_integration / Changing an Agent policy is reflected in the Security App – Agent Endpoint Integration

    • Age: 1
    • Duration: 151.74553
    • Error Details: Step the policy will reflect the change in the Security App: No endpoint-security events where found for the agent in the b6b40e90-f39d-11ea-b551-fda7fa36e1bc configuration

  • Name: Initializing / Pre-Submit / Sanity checks / checkgherkinlint – pre_commit.lint

    • Age: 1
    • Duration: 0
    • Error Details: error

Steps errors

Expand to view the steps failures

  • Name: Run functional tests for ingest-manager:agent_endpoint_integration

    • Description:

    • Duration: 12 min 13 sec

    • Start Time: 2020-09-10T19:34:53.473+0000

    • log

  • Name: Error signal

    • Description:

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-10T19:47:06.473+0000

    • log

  • Name: General Build Step

    • Description: [2020-09-10T19:47:07.014Z] Archiving artifacts
      hudson.AbortException: script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-10T19:47:07.001+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-09-10T19:48:39.160Z] time="2020-09-10T19:48:39Z" level=debug msg="Docker compose executed." cmd="[exec -T debian-systemd apt install /elastic-agent-7.9.0-linux-amd64.deb -y]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:40.130Z] Synchronizing state of elastic-agent.service with SysV service script with /lib/systemd/systemd-sysv-install.
[2020-09-10T19:48:40.130Z] Executing: /lib/systemd/systemd-sysv-install enable elastic-agent
[2020-09-10T19:48:40.392Z] time="2020-09-10T19:48:40Z" level=debug msg="Docker compose executed." cmd="[exec -T debian-systemd systemctl enable elastic-agent]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:40.392Z] time="2020-09-10T19:48:40Z" level=info msg="Hostname retrieved from the Docker client" containerName=ingest-manager_debian-systemd_elastic-agent_1 hostname=84ea7afcb5fe
[2020-09-10T19:48:40.970Z] time="2020-09-10T19:48:40Z" level=debug msg="Fleet token created" apiKeyId=tVeQeXQBpHkw0BhkFw1c tokenId=3db49796-d387-46eb-8ec0-58614103ce05
[2020-09-10T19:48:41.546Z] The Elastic Agent is currently in BETA and should not be used in production
[2020-09-10T19:48:41.817Z] 2020-09-10T19:48:41.594Z	DEBUG	kibana/client.go:170	Request method: POST, path: /api/ingest_manager/fleet/agents/enroll
[2020-09-10T19:48:43.220Z] Successfully enrolled the Agent.
[2020-09-10T19:48:43.220Z] time="2020-09-10T19:48:42Z" level=debug msg="Docker compose executed." cmd="[exec -T debian-systemd elastic-agent enroll http://kibana:5601 dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ== -f --insecure]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:44.172Z] time="2020-09-10T19:48:43Z" level=debug msg="Docker compose executed." cmd="[exec -T debian-systemd systemctl start elastic-agent]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_elastic-agent_1 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:45.133Z] time="2020-09-10T19:48:44Z" level=debug msg="The token was deleted" tokenID=3db49796-d387-46eb-8ec0-58614103ce05
[2020-09-10T19:48:45.134Z] time="2020-09-10T19:48:44Z" level=debug msg="Token was revoked" token="dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ==" tokenID=3db49796-d387-46eb-8ec0-58614103ce05
[2020-09-10T19:48:46.087Z] ingest-manager_package-registry_1 is up-to-date
[2020-09-10T19:48:46.087Z] ingest-manager_elasticsearch_1 is up-to-date
[2020-09-10T19:48:46.087Z] Recreating ingest-manager_debian-systemd_elastic-agent_1 ... 
[2020-09-10T19:48:46.087Z] ingest-manager_kibana_1 is up-to-date
[2020-09-10T19:48:48.025Z] 
Recreating ingest-manager_debian-systemd_elastic-agent_1 ... done
time="2020-09-10T19:48:47Z" level=debug msg="Docker compose executed." cmd="[up -d]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_debian-systemd_2 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:48.613Z] 
[2020-09-10T19:48:48.613Z] WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
[2020-09-10T19:48:48.613Z] 
[2020-09-10T19:48:48.613Z] Reading package lists...
[2020-09-10T19:48:48.613Z] Building dependency tree...
[2020-09-10T19:48:48.613Z] Reading state information...
[2020-09-10T19:48:48.613Z] The following NEW packages will be installed:
[2020-09-10T19:48:48.613Z]   elastic-agent
[2020-09-10T19:48:50.013Z] 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
[2020-09-10T19:48:50.013Z] Need to get 0 B/76.5 MB of archives.
[2020-09-10T19:48:50.013Z] After this operation, 89.1 MB of additional disk space will be used.
[2020-09-10T19:48:50.013Z] Get:1 /elastic-agent-7.9.0-linux-amd64.deb elastic-agent amd64 7.9.0 [76.5 MB]
[2020-09-10T19:48:50.274Z] debconf: delaying package configuration, since apt-utils is not installed
[2020-09-10T19:48:50.275Z] Selecting previously unselected package elastic-agent.
[2020-09-10T19:48:50.275Z] (Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 7400 files and directories currently installed.)
[2020-09-10T19:48:50.275Z] Preparing to unpack .../elastic-agent-7.9.0-linux-amd64.deb ...
[2020-09-10T19:48:50.275Z] Unpacking elastic-agent (7.9.0) ...
[2020-09-10T19:48:51.235Z] Setting up elastic-agent (7.9.0) ...
[2020-09-10T19:48:51.235Z] Processing triggers for systemd (232-25+deb9u12) ...
[2020-09-10T19:48:51.498Z] time="2020-09-10T19:48:51Z" level=debug msg="Docker compose executed." cmd="[exec -T debian-systemd apt install /elastic-agent-7.9.0-linux-amd64.deb -y]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_debian-systemd_2 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:52.083Z] Synchronizing state of elastic-agent.service with SysV service script with /lib/systemd/systemd-sysv-install.
[2020-09-10T19:48:52.083Z] Executing: /lib/systemd/systemd-sysv-install enable elastic-agent
[2020-09-10T19:48:52.668Z] time="2020-09-10T19:48:52Z" level=debug msg="Docker compose executed." cmd="[exec -T debian-systemd systemctl enable elastic-agent]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_debian-systemd_2 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:53.245Z] The Elastic Agent is currently in BETA and should not be used in production
[2020-09-10T19:48:54.192Z] 2020-09-10T19:48:53.898Z	DEBUG	kibana/client.go:170	Request method: POST, path: /api/ingest_manager/fleet/agents/enroll
[2020-09-10T19:48:54.192Z] fail to enroll: fail to execute request to Kibana: Status code: 401, Kibana returned an error: Unauthorized, message: [security_exception] missing authentication credentials for REST request [/_security/_authenticate], with { header={ WWW-Authenticate={ 0="ApiKey" & 1="Basic realm=\"security\" charset=\"UTF-8\"" } } }
[2020-09-10T19:48:54.192Z] time="2020-09-10T19:48:54Z" level=error msg="Could not execute command in container" command="[elastic-agent enroll http://kibana:5601 dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ== -f --insecure]" error="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent enroll http://kibana:5601 dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ== -f --insecure]. exit status 1" service=debian-systemd
[2020-09-10T19:48:54.193Z] time="2020-09-10T19:48:54Z" level=error msg="Could not enroll the agent with the token" command="[elastic-agent enroll http://kibana:5601 dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ== -f --insecure]" error="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent enroll http://kibana:5601 dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ== -f --insecure]. exit status 1" image=debian-systemd service=debian-systemd tag=stretch token="dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ=="
[2020-09-10T19:48:54.193Z] time="2020-09-10T19:48:54Z" level=debug msg="As expected, it's not possible to enroll an agent with a revoked token" err="Could not run compose file: [/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml] - Local Docker compose exited abnormally whilst running docker-compose: [exec -T debian-systemd elastic-agent enroll http://kibana:5601 dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ== -f --insecure]. exit status 1" token="dFZlUWVYUUJwSGt3MEJoa0Z3MWM6Y0txMjJ6UkxSVTZnWDFMa0tua05GQQ=="
[2020-09-10T19:48:54.193Z] time="2020-09-10T19:48:54Z" level=debug msg="Un-enrolling agent in Fleet" agentID=ec4414ad-54be-4e3e-8750-406262937758 hostname=84ea7afcb5fe
[2020-09-10T19:48:55.139Z] time="2020-09-10T19:48:54Z" level=debug msg="Fleet agent was unenrolled" agentID=ec4414ad-54be-4e3e-8750-406262937758
[2020-09-10T19:48:55.729Z] Stopping ingest-manager_debian-systemd_debian-systemd_2 ... 
[2020-09-10T19:48:56.678Z] 
Stopping ingest-manager_debian-systemd_debian-systemd_2 ... done
Removing ingest-manager_debian-systemd_debian-systemd_2 ... 
[2020-09-10T19:48:56.942Z] 
Removing ingest-manager_debian-systemd_debian-systemd_2 ... done
Going to remove ingest-manager_debian-systemd_debian-systemd_2
[2020-09-10T19:48:56.943Z] time="2020-09-10T19:48:56Z" level=debug msg="Docker compose executed." cmd="[rm -fvs debian-systemd]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/services/debian-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_debian-systemd_2 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:48:56.943Z] time="2020-09-10T19:48:56Z" level=debug msg="Service removed from compose" profile=ingest-manager service=debian-systemd
[2020-09-10T19:48:56.943Z] time="2020-09-10T19:48:56Z" level=debug msg="The token was deleted" tokenID=3db49796-d387-46eb-8ec0-58614103ce05
[2020-09-10T19:48:57.207Z] time="2020-09-10T19:48:56Z" level=info msg="Integration deleted from the configuration" configurationID=99a79320-f39e-11ea-ae35-51f6f8ccb7df integration= packageConfigId= version=
[2020-09-10T19:49:03.816Z] time="2020-09-10T19:49:03Z" level=debug msg="The configuration was deleted" configurationID=99a79320-f39e-11ea-ae35-51f6f8ccb7df
[2020-09-10T19:49:03.816Z] time="2020-09-10T19:49:03Z" level=debug msg="Destroying ingest-manager runtime dependencies"
[2020-09-10T19:49:03.816Z] Stopping ingest-manager_kibana_1           ... 
[2020-09-10T19:49:03.816Z] Stopping ingest-manager_elasticsearch_1    ... 
[2020-09-10T19:49:03.816Z] Stopping ingest-manager_package-registry_1 ... 
[2020-09-10T19:49:09.208Z] 
Stopping ingest-manager_kibana_1           ... done

Stopping ingest-manager_package-registry_1 ... done

Stopping ingest-manager_elasticsearch_1    ... done
Removing ingest-manager_kibana_1           ... 
[2020-09-10T19:49:09.208Z] Removing ingest-manager_elasticsearch_1    ... 
[2020-09-10T19:49:09.208Z] Removing ingest-manager_package-registry_1 ... 
[2020-09-10T19:49:09.208Z] 
Removing ingest-manager_package-registry_1 ... done

Removing ingest-manager_kibana_1           ... done

Removing ingest-manager_elasticsearch_1    ... done
Removing network ingest-manager_default
[2020-09-10T19:49:09.471Z] time="2020-09-10T19:49:09Z" level=debug msg="Docker compose executed." cmd="[down]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/.op/compose/profiles/ingest-manager/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-x86_64.rpm500286386 centos_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-x86_64.rpm centos_systemdContainerName:ingest-manager_centos-systemd_centos-systemd_2 centos_systemdTag:latest debian_systemdAgentBinarySrcPath:/tmp/elastic-agent-7.9.0-amd64.deb720941929 debian_systemdAgentBinaryTargetPath:/elastic-agent-7.9.0-linux-amd64.deb debian_systemdContainerName:ingest-manager_debian-systemd_debian-systemd_2 debian_systemdTag:stretch kibanaConfigPath:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing/e2e/_suites/ingest-manager/configurations/kibana.config.yml stackVersion:7.9.0]" profile=ingest-manager
[2020-09-10T19:49:09.471Z] time="2020-09-10T19:49:09Z" level=debug msg="Elastic Agent binary was removed." installer=centos-systemd path=/tmp/elastic-agent-7.9.0-x86_64.rpm500286386
[2020-09-10T19:49:09.471Z] time="2020-09-10T19:49:09Z" level=debug msg="Elastic Agent binary was removed." installer=debian-systemd path=/tmp/elastic-agent-7.9.0-amd64.deb720941929
[2020-09-10T19:49:09.471Z] <?xml version="1.0" encoding="UTF-8"?>
[2020-09-10T19:49:09.471Z] <testsuites name="main" tests="14" skipped="0" failures="0" errors="0" time="819.459849811">
[2020-09-10T19:49:09.471Z]   <testsuite name="Fleet Mode Agent" tests="14" skipped="0" failures="0" errors="0" time="617.211137421">
[2020-09-10T19:49:09.471Z]     <testcase name="Deploying the centos agent" status="passed" time="31.609326003"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Deploying the debian agent" status="passed" time="35.551612166"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Starting the centos agent starts backend processes" status="passed" time="21.128459292"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Starting the debian agent starts backend processes" status="passed" time="20.369010261"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Stopping the centos agent stops backend processes" status="passed" time="12.69340685"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Stopping the debian agent stops backend processes" status="passed" time="14.572593738"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Restarting the centos host with persistent agent restarts backend processes" status="passed" time="23.782859688"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Restarting the debian host with persistent agent restarts backend processes" status="passed" time="28.850736983"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Un-enrolling the centos agent" status="passed" time="12.316973618"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Un-enrolling the debian agent" status="passed" time="13.331937102"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Re-enrolling the centos agent" status="passed" time="27.30855681"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Re-enrolling the debian agent" status="passed" time="33.804067022"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Revoking the enrollment token for the centos agent" status="passed" time="31.74036237"></testcase>
[2020-09-10T19:49:09.471Z]     <testcase name="Revoking the enrollment token for the debian agent" status="passed" time="20.360543124"></testcase>
[2020-09-10T19:49:09.471Z]   </testsuite>
[2020-09-10T19:49:09.471Z] </testsuites>+ grep -E '^<.*>$'
[2020-09-10T19:49:09.471Z] + sed -e 's/^[ \t]*//; s#>.*failed$#>#g' outputs/TEST-ingest-manager-fleet_mode
[2020-09-10T19:49:09.471Z] + exit 0
[2020-09-10T19:49:09.609Z] Recording test results
[2020-09-10T19:49:10.175Z] Archiving artifacts
[2020-09-10T19:49:11.974Z] Stage "Release" skipped due to earlier failure(s)
[2020-09-10T19:49:13.904Z] Running on worker-1244230 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283
[2020-09-10T19:49:13.987Z] [INFO] getVaultSecret: Getting secrets
[2020-09-10T19:49:14.069Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-09-10T19:49:16.262Z] + chmod 755 generate-build-data.sh
[2020-09-10T19:49:16.262Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/1 FAILURE 1219061
[2020-09-10T19:49:16.263Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/1/steps/?limit=10000 -o steps-info.json
[2020-09-10T19:49:20.388Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-09-10T19:49:21.093Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/1/log/ -o pipeline-log.txt

mdelapenya
mdelapenya commented Sep 10, 2020
View reviewed changes
e2e/go.mod Outdated Show resolved Hide resolved
@mdelapenya mdelapenya merged commit 7604826 into elastic:7.9.x Sep 10, 2020
@elasticmachine
Copy link
Contributor

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #283 updated]

  • Start Time: 2020-09-10T20:13:28.700+0000

  • Duration: 2 min 41 sec

Steps errors

Expand to view the steps failures

  • Name: Git fetch

    • Description:

    • Duration: 0 min 2 sec

    • Start Time: 2020-09-10T20:15:05.960+0000

    • log

  • Name: Archive the artifacts

    • Description: fetch.log

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-10T20:15:07.969+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-09-10T20:13:30.825Z]  > git --version # 'git version 2.7.4'
[2020-09-10T20:13:30.825Z]  > git config --get remote.origin.url # timeout=10
[2020-09-10T20:13:30.833Z] using GIT_SSH to set credentials GitHub user @elasticmachine SSH key
[2020-09-10T20:13:30.842Z]  > git fetch --tags --progress origin +refs/heads/*:refs/remotes/origin/* # timeout=10
[2020-09-10T20:13:31.474Z]  > git rev-parse current^{commit} # timeout=10
[2020-09-10T20:13:31.483Z]  > git branch -a -v --no-abbrev --contains 7c624e9405957f2f839c3ba032dd90afbbb164e0 # timeout=10
[2020-09-10T20:13:31.509Z] Selected match: master revision 7c624e9405957f2f839c3ba032dd90afbbb164e0
[2020-09-10T20:13:31.511Z] using credential f6c7695a-671e-4f4f-a331-acdce44ff9ba
[2020-09-10T20:13:31.555Z]  > git rev-parse --is-inside-work-tree # timeout=10
[2020-09-10T20:13:31.563Z] Fetching changes from the remote Git repository
[2020-09-10T20:13:31.563Z]  > git config remote.origin.url [email protected]:elastic/apm-pipeline-library.git # timeout=10
[2020-09-10T20:13:31.571Z] Fetching without tags
[2020-09-10T20:13:31.571Z] Fetching upstream changes from [email protected]:elastic/apm-pipeline-library.git
[2020-09-10T20:13:31.572Z]  > git --version # timeout=10
[2020-09-10T20:13:31.579Z]  > git --version # 'git version 2.7.4'
[2020-09-10T20:13:31.579Z] using GIT_SSH to set credentials GitHub user @elasticmachine SSH key
[2020-09-10T20:13:31.586Z]  > git fetch --no-tags --progress [email protected]:elastic/apm-pipeline-library.git +refs/heads/*:refs/remotes/origin/* # timeout=10
[2020-09-10T20:13:32.172Z] Checking out Revision 7c624e9405957f2f839c3ba032dd90afbbb164e0 (master)
[2020-09-10T20:13:32.172Z]  > git config core.sparsecheckout # timeout=10
[2020-09-10T20:13:32.179Z]  > git checkout -f 7c624e9405957f2f839c3ba032dd90afbbb164e0 # timeout=10
[2020-09-10T20:13:32.237Z] Commit message: "docs: update CHANGELOG.md"
[2020-09-10T20:13:32.825Z] Excluding src/test/ from checkout of git [email protected]:elastic/apm-pipeline-library.git so that shared library test code cannot be accessed by Pipelines.
[2020-09-10T20:13:32.825Z] To remove this log message, move the test code outside of src/. To restore the previous behavior that allowed access to files in src/test/, pass -Dorg.jenkinsci.plugins.workflow.libs.SCMSourceRetriever.INCLUDE_SRC_TEST_IN_LIBRARIES=true to the java command used to start Jenkins.
[2020-09-10T20:13:41.322Z] Running on Jenkins in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283
[2020-09-10T20:13:41.514Z] �[39;49m[INFO] Override default checkout�[0m
[2020-09-10T20:13:41.572Z] Sleeping for 10 sec
[2020-09-10T20:13:51.592Z] using credential f6c7695a-671e-4f4f-a331-acdce44ff9ba
[2020-09-10T20:13:51.641Z] Wiping out workspace first.
[2020-09-10T20:13:51.661Z] Cloning the remote Git repository
[2020-09-10T20:13:51.661Z] Using shallow clone with depth 3
[2020-09-10T20:13:51.661Z] Avoid fetching tags
[2020-09-10T20:13:51.661Z] Cloning repository [email protected]:elastic/e2e-testing.git
[2020-09-10T20:13:51.661Z]  > git init /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283 # timeout=10
[2020-09-10T20:13:51.674Z] Fetching upstream changes from [email protected]:elastic/e2e-testing.git
[2020-09-10T20:13:51.674Z]  > git --version # timeout=10
[2020-09-10T20:13:51.681Z]  > git --version # 'git version 2.7.4'
[2020-09-10T20:13:51.681Z] using GIT_SSH to set credentials GitHub user @elasticmachine SSH key
[2020-09-10T20:13:51.689Z]  > git fetch --no-tags --progress [email protected]:elastic/e2e-testing.git +refs/heads/*:refs/remotes/origin/* # timeout=15
[2020-09-10T20:13:52.528Z]  > git config remote.origin.url [email protected]:elastic/e2e-testing.git # timeout=10
[2020-09-10T20:13:52.536Z]  > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
[2020-09-10T20:13:52.543Z]  > git config remote.origin.url [email protected]:elastic/e2e-testing.git # timeout=10
[2020-09-10T20:13:52.550Z] Cleaning workspace
[2020-09-10T20:13:52.550Z]  > git rev-parse --verify HEAD # timeout=10
[2020-09-10T20:13:52.559Z] No valid HEAD. Skipping the resetting
[2020-09-10T20:13:52.559Z]  > git clean -fdx # timeout=10
[2020-09-10T20:13:52.567Z] Using shallow fetch with depth 3
[2020-09-10T20:13:52.567Z] Pruning obsolete local branches
[2020-09-10T20:13:52.567Z] Fetching upstream changes from [email protected]:elastic/e2e-testing.git
[2020-09-10T20:13:52.567Z] using GIT_SSH to set credentials GitHub user @elasticmachine SSH key
[2020-09-10T20:13:52.574Z]  > git fetch --no-tags --progress --prune [email protected]:elastic/e2e-testing.git +refs/pull/283/head:refs/remotes/origin/PR-283 +refs/heads/7.9.x:refs/remotes/origin/7.9.x # timeout=15
[2020-09-10T20:13:53.165Z] Merging remotes/origin/7.9.x commit 7654aa436840975166cf9a000543f561052c3185 into PR head commit 1f65cc9e0f3865acb27f53d279abd8c38e505843
[2020-09-10T20:13:53.165Z]  > git config core.sparsecheckout # timeout=10
[2020-09-10T20:13:53.173Z]  > git checkout -f 1f65cc9e0f3865acb27f53d279abd8c38e505843 # timeout=15
[2020-09-10T20:13:53.207Z]  > git remote # timeout=10
[2020-09-10T20:13:53.214Z]  > git config --get remote.origin.url # timeout=10
[2020-09-10T20:13:53.222Z] using GIT_SSH to set credentials GitHub user @elasticmachine SSH key
[2020-09-10T20:13:53.228Z]  > git merge 7654aa436840975166cf9a000543f561052c3185 # timeout=10
[2020-09-10T20:13:53.238Z]  > git rev-parse HEAD^{commit} # timeout=10
[2020-09-10T20:13:53.245Z] Merge succeeded, producing 1f65cc9e0f3865acb27f53d279abd8c38e505843
[2020-09-10T20:13:53.246Z] Checking out Revision 1f65cc9e0f3865acb27f53d279abd8c38e505843 (PR-283)
[2020-09-10T20:13:53.246Z]  > git config core.sparsecheckout # timeout=10
[2020-09-10T20:13:53.253Z]  > git checkout -f 1f65cc9e0f3865acb27f53d279abd8c38e505843 # timeout=15
[2020-09-10T20:13:53.277Z] Commit message: "chore: remove dependency added by mistake"
[2020-09-10T20:13:53.277Z]  > git rev-list --no-walk 380086a930f3e039d614493b63c322328324241f # timeout=10
[2020-09-10T20:13:53.294Z] Cleaning workspace
[2020-09-10T20:13:53.294Z]  > git rev-parse --verify HEAD # timeout=10
[2020-09-10T20:13:53.301Z] Resetting working tree
[2020-09-10T20:13:53.301Z]  > git reset --hard # timeout=10
[2020-09-10T20:13:53.323Z]  > git clean -fdx # timeout=10
[2020-09-10T20:13:53.947Z] Masking supported pattern matches of $JOB_GCS_BUCKET or $NOTIFY_TO
[2020-09-10T20:13:53.984Z] Timeout set to expire in 1 hr 0 min
[2020-09-10T20:13:53.997Z] The timestamps step is unnecessary when timestamps are enabled for all Pipeline builds.
[2020-09-10T20:14:09.068Z] Still waiting to schedule task
[2020-09-10T20:14:09.068Z] ‘beats-ci-immutable-ubuntu-1804-1599767926545616923’ is offline
[2020-09-10T20:14:55.250Z] Running on beats-ci-immutable-ubuntu-1804-1599768844448324088 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283
[2020-09-10T20:14:55.560Z] [INFO] 'shallow' is forced to be disabled when running on PullRequests
[2020-09-10T20:14:55.575Z] Running in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283/src/github.com/elastic/e2e-testing
[2020-09-10T20:14:55.593Z] [INFO] gitCheckout: Checkout SCM PR-283 with default customisation from the Item.
[2020-09-10T20:14:55.615Z] [INFO] Override default checkout
[2020-09-10T20:14:55.650Z] Sleeping for 10 sec
[2020-09-10T20:15:05.942Z] Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD
[2020-09-10T20:15:07.897Z] + git fetch https://****:****@github.com/elastic/e2e-testing.git +refs/pull/*/head:refs/remotes/origin/pr/*
[2020-09-10T20:15:07.966Z] [WARN] gitCmd failed, further details in the archived file 'fetch.log'
[2020-09-10T20:15:07.977Z] Archiving artifacts
[2020-09-10T20:15:08.457Z] Stage "Pre-Submit" skipped due to earlier failure(s)
[2020-09-10T20:15:08.491Z] Stage "Sanity checks" skipped due to earlier failure(s)
[2020-09-10T20:15:08.493Z] Stage "Unit Tests" skipped due to earlier failure(s)
[2020-09-10T20:15:08.521Z] Failed in branch Sanity checks
[2020-09-10T20:15:08.522Z] Failed in branch Unit Tests
[2020-09-10T20:15:08.577Z] Stage "Build Docs" skipped due to earlier failure(s)
[2020-09-10T20:15:08.613Z] Stage "End-To-End Tests" skipped due to earlier failure(s)
[2020-09-10T20:15:08.648Z] Stage "Release" skipped due to earlier failure(s)
[2020-09-10T20:15:09.242Z] Running on worker-1244230 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-283
[2020-09-10T20:15:09.351Z] [INFO] getVaultSecret: Getting secrets
[2020-09-10T20:15:09.424Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-09-10T20:15:11.390Z] + chmod 755 generate-build-data.sh
[2020-09-10T20:15:11.390Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/2 FAILURE 101284
[2020-09-10T20:15:11.390Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/2/steps/?limit=10000 -o steps-info.json
[2020-09-10T20:15:12.093Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-09-10T20:15:12.797Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-283/runs/2/log/ -o pipeline-log.txt

@mdelapenya mdelapenya deleted the backport/7.9.x/pr-279_pr-281 branch September 23, 2020 07:12
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees

@mdelapenya mdelapenya

Labels
backport
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@mdelapenya @elasticmachine