Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

chore: add debug traces for the webhook payload #1043

Merged
merged 1 commit into from
Apr 14, 2021

Conversation

mdelapenya
Copy link
Contributor

@mdelapenya mdelapenya commented Apr 14, 2021

What does this PR do?

It updates the buid cause string including HEAD_SHA, BASE_REF and PR_ID

I'd like to verify that the pull_request JSON object is returned in the weebhook payload.

Why is it important?

We found the original error:

hudson.AbortException: No item named e2e-tests/e2e-testing-mbp/null.x found

So this groovy block always evals to true, appending '.x' to the branch name, in this case null:

def branchName = "${env.GT_BASE_REF}"
if (env.GT_BASE_REF != "master") {
  branchName = "${env.GT_BASE_REF}.x"
}

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have run the Unit tests for the CLI, and they are passing locally
  • I have run the End-2-End tests for the suite I'm working on, and they are passing locally
  • I have noticed new Go dependencies (run make notice in the proper directory)

@mdelapenya mdelapenya self-assigned this Apr 14, 2021
@mdelapenya mdelapenya requested a review from a team April 14, 2021 19:13
@mdelapenya mdelapenya marked this pull request as ready for review April 14, 2021 19:24
@elasticmachine
Copy link
Contributor

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #1043 opened

  • Start Time: 2021-04-14T19:13:50.223+0000

  • Duration: 27 min 6 sec

  • Commit: 2254bac

Test stats 🧪

Test Results
Failed 1
Passed 140
Skipped 0
Total 141

Trends 🧪

Image of Build Times

Image of Tests

Test errors 1

Expand to view the tests failures

Initializing / End-To-End Tests / ubuntu-18.04_fleet_agent_endpoint_integration / Deploying an Endpoint makes policies to appear in the Security App – Agent Endpoint Integration
    Expand to view the error details

     Step the policy response will be shown in the Security App: The policy response is not listed as 'success' in the Administration view in the Security App yet 
    

  • no stacktrace

Steps errors 1

Expand to view the steps failures

Run functional tests for fleet:agent_endpoint_integration && ~@nightly && ~debian
  • Took 20 min 14 sec . View more details on here
  • Description: .ci/scripts/functional-test.sh "fleet" "agent_endpoint_integration && ~@nightly && ~debian" "8.0.0-SNAPSHOT" "8.0.0-SNAPSHOT"

Log output

Expand to view the last 100 lines of log output

[2021-04-14T19:40:17.252Z] time="2021-04-14T19:40:17Z" level=info msg="Integration added to the configuration" integration=endpoint integrationConfigurationID=7c0f990d-7a73-4567-9407-603c1b95ab02 policyID=b7cac680-9d56-11eb-96db-c5303f83076b version=0.18.0
[2021-04-14T19:40:17.252Z] time="2021-04-14T19:40:17Z" level=debug msg="Package policy found in the configuration" package="{7c0f990d-7a73-4567-9407-603c1b95ab02 endpoint Endpoint Security 0.18.0 0xc00025b240}" policyID=b7cac680-9d56-11eb-96db-c5303f83076b
[2021-04-14T19:40:20.562Z] time="2021-04-14T19:40:20Z" level=info msg="Integration deleted from the configuration" integration=endpoint packageConfigId=7c0f990d-7a73-4567-9407-603c1b95ab02 policyID=b7cac680-9d56-11eb-96db-c5303f83076b version=0.18.0
[2021-04-14T19:40:20.563Z] time="2021-04-14T19:40:20Z" level=debug msg="Agent listed in Fleet with online status" agentID=e5196e82-0f0a-49c8-bf09-0b8e5932f289 hostname=5aaf1438611d
[2021-04-14T19:40:20.563Z] time="2021-04-14T19:40:20Z" level=info msg="The Agent is in the desired status" elapsedTime=72.89342ms hostname=5aaf1438611d isAgentInStatus=true retries=1 status=online
[2021-04-14T19:40:20.563Z] time="2021-04-14T19:40:20Z" level=info msg="The Agent is not listed in the Administration view in the Security App" elapsedTime=30.265126ms hostname=5aaf1438611d retries=1
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.255Z","log.origin":{"file.name":"warn/warn.go","file.line":18},"message":"The Elastic Agent is currently in BETA and should not be used in production","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.256Z","log.origin":{"file.name":"application/application.go","file.line":68},"message":"Detecting execution mode","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.256Z","log.origin":{"file.name":"application/application.go","file.line":93},"message":"Agent is managed by Fleet","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.256Z","log.origin":{"file.name":"capabilities/capabilities.go","file.line":59},"message":"capabilities file not found in /opt/Elastic/Agent/capabilities.yml","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.484Z","log.logger":"composable","log.origin":{"file.name":"composable/controller.go","file.line":46},"message":"EXPERIMENTAL - Inputs with variables are currently experimental and should not be used in production","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.588Z","log.logger":"composable.providers.docker","log.origin":{"file.name":"docker/docker.go","file.line":43},"message":"Docker provider skipped, unable to connect: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.589Z","log.logger":"api","log.origin":{"file.name":"api/server.go","file.line":62},"message":"Starting stats endpoint","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.589Z","log.origin":{"file.name":"application/managed_mode.go","file.line":289},"message":"Agent is starting","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:49.589Z","log.logger":"api","log.origin":{"file.name":"api/server.go","file.line":64},"message":"Metrics endpoint listening on: /opt/Elastic/Agent/data/tmp/elastic-agent.sock (configured: unix:///opt/Elastic/Agent/data/tmp/elastic-agent.sock)","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"warn","@timestamp":"2021-04-14T19:39:49.690Z","log.origin":{"file.name":"application/managed_mode.go","file.line":302},"message":"failed to ack update open /opt/Elastic/Agent/data/.update-marker: no such file or directory","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:52.070Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":48},"message":"New State ID is XLTnvNA4","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:52.070Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":49},"message":"Converging state requires execution of 3 step(s)","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.136Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:52.070Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:52.070Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:55.392Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:39:55Z: type: 'STATE': sub_type: 'STARTING' message: Application: metricbeat--8.0.0-SNAPSHOT[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to STARTING: Starting","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:55.394Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:55.394Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:39:56.698Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:39:56Z: type: 'STATE': sub_type: 'RUNNING' message: Application: metricbeat--8.0.0-SNAPSHOT[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to RUNNING: Running","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.267Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:40:00Z: type: 'STATE': sub_type: 'STARTING' message: Application: filebeat--8.0.0-SNAPSHOT[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to STARTING: Starting","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.268Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.137Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.268Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.478Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-install' skipped for filebeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.880Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:40:00Z: type: 'STATE': sub_type: 'STARTING' message: Application: filebeat--8.0.0-SNAPSHOT--36643631373035623733363936343635[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to STARTING: Starting","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.881Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:00.882Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:01.118Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-install' skipped for metricbeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:01.479Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:40:01Z: type: 'STATE': sub_type: 'RUNNING' message: Application: filebeat--8.0.0-SNAPSHOT[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to RUNNING: Running","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:01.497Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:40:01Z: type: 'STATE': sub_type: 'STARTING' message: Application: metricbeat--8.0.0-SNAPSHOT--36643631373035623733363936343635[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to STARTING: Starting","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:01.498Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":66},"message":"Updating internal state","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:02.054Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:40:02Z: type: 'STATE': sub_type: 'RUNNING' message: Application: filebeat--8.0.0-SNAPSHOT--36643631373035623733363936343635[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to RUNNING: Running","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:02.748Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2021-04-14T19:40:02Z: type: 'STATE': sub_type: 'RUNNING' message: Application: metricbeat--8.0.0-SNAPSHOT--36643631373035623733363936343635[e5196e82-0f0a-49c8-bf09-0b8e5932f289]: State changed to RUNNING: Running","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.035Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":48},"message":"New State ID is KyX4-a3E","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.035Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":49},"message":"Converging state requires execution of 3 step(s)","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.138Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.035Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.035Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.263Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-install' skipped for metricbeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.263Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-start' skipped for metricbeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.264Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.264Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.453Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-install' skipped for filebeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.453Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-start' skipped for filebeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.454Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.454Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"filebeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/filebeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.647Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-install' skipped for filebeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.647Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-start' skipped for filebeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.139Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.648Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.140Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.649Z","log.origin":{"file.name":"operation/operation_fetch.go","file.line":61},"message":"metricbeat.8.0.0-SNAPSHOT already exists in /opt/Elastic/Agent/data/elastic-agent-53d75c/downloads/metricbeat-8.0.0-SNAPSHOT-linux-x86_64.tar.gz. Skipping operation operation-fetch","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.140Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.886Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-install' skipped for metricbeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.140Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.887Z","log.origin":{"file.name":"operation/operator.go","file.line":259},"message":"operation 'operation-start' skipped for metricbeat.8.0.0-SNAPSHOT","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.140Z] {"log.level":"info","@timestamp":"2021-04-14T19:40:20.887Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":66},"message":"Updating internal state","ecs.version":"1.6.0"}
[2021-04-14T19:40:21.140Z] time="2021-04-14T19:40:21Z" level=debug msg="Docker compose executed." cmd="[exec -T centos-systemd cat /opt/Elastic/Agent/data/elastic-agent-53d75c/logs//elastic-agent-json.log]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/services/centos-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz486565645 centos_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-04-14T19:40:23.060Z] Elastic Agent has been uninstalled.
[2021-04-14T19:40:23.060Z] time="2021-04-14T19:40:23Z" level=debug msg="Docker compose executed." cmd="[exec -T centos-systemd elastic-agent uninstall -f]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/services/centos-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz486565645 centos_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-04-14T19:40:23.061Z] time="2021-04-14T19:40:23Z" level=debug msg="Un-enrolling agent in Fleet" agentID=e5196e82-0f0a-49c8-bf09-0b8e5932f289 hostname=5aaf1438611d
[2021-04-14T19:40:24.447Z] time="2021-04-14T19:40:24Z" level=debug msg="Fleet agent was unenrolled" agentID=e5196e82-0f0a-49c8-bf09-0b8e5932f289
[2021-04-14T19:40:25.024Z] Stopping fleet_centos-systemd_elastic-agent_1 ... 
[2021-04-14T19:40:26.415Z] {"level":"debug","time":"2021-04-14T19:40:26Z","message":"gathering metrics"}
[2021-04-14T19:40:36.429Z] 
Stopping fleet_centos-systemd_elastic-agent_1 ... done
Removing fleet_centos-systemd_elastic-agent_1 ... 
[2021-04-14T19:40:36.429Z] 
Removing fleet_centos-systemd_elastic-agent_1 ... done
Going to remove fleet_centos-systemd_elastic-agent_1
[2021-04-14T19:40:36.429Z] time="2021-04-14T19:40:36Z" level=debug msg="Docker compose executed." cmd="[rm -fvs centos-systemd]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/services/centos-systemd/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz486565645 centos_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-04-14T19:40:36.429Z] time="2021-04-14T19:40:36Z" level=debug msg="Service removed from compose" profile=fleet service=centos-systemd
[2021-04-14T19:40:36.692Z] {"level":"debug","time":"2021-04-14T19:40:36Z","message":"sent request with 0 transactions, 0 spans, 0 errors, 1 metricset"}
[2021-04-14T19:40:36.692Z] time="2021-04-14T19:40:36Z" level=debug msg="The token was deleted" tokenID=90fbf58f-bf33-4577-ac9a-29f876a845cc
[2021-04-14T19:40:36.692Z] time="2021-04-14T19:40:36Z" level=info msg="Integration deleted from the configuration" integration=endpoint packageConfigId=7c0f990d-7a73-4567-9407-603c1b95ab02 policyID=b7cac680-9d56-11eb-96db-c5303f83076b version=0.18.0
[2021-04-14T19:40:36.692Z] time="2021-04-14T19:40:36Z" level=debug msg="Destroying Fleet runtime dependencies"
[2021-04-14T19:40:37.635Z] Stopping fleet_kibana_1           ... 
[2021-04-14T19:40:37.635Z] Stopping fleet_package-registry_1 ... 
[2021-04-14T19:40:37.635Z] Stopping fleet_elasticsearch_1    ... 
[2021-04-14T19:40:39.599Z] 
Stopping fleet_kibana_1           ... done

Stopping fleet_package-registry_1 ... done

Stopping fleet_elasticsearch_1    ... done
Removing fleet_kibana_1           ... 
[2021-04-14T19:40:39.599Z] Removing fleet_package-registry_1 ... 
[2021-04-14T19:40:39.599Z] Removing fleet_elasticsearch_1    ... 
[2021-04-14T19:40:39.599Z] 
Removing fleet_kibana_1           ... done

Removing fleet_package-registry_1 ... done

Removing fleet_elasticsearch_1    ... done
Removing network fleet_default
[2021-04-14T19:40:39.870Z] time="2021-04-14T19:40:39Z" level=debug msg="Docker compose executed." cmd="[down --remove-orphans]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/.op/compose/profiles/fleet/docker-compose.yml]" env="map[centos_systemdAgentBinarySrcPath:/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz486565645 centos_systemdAgentBinaryTargetPath:/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz centos_systemdContainerName:fleet_centos-systemd_elastic-agent_1 centos_systemdTag:latest kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-04-14T19:40:39.870Z] time="2021-04-14T19:40:39Z" level=debug msg="Elastic Agent binary was removed." installer=centos-tar-8.0.0-SNAPSHOT path=/tmp/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz486565645
[2021-04-14T19:40:39.870Z] Makefile:73: recipe for target 'functional-test' failed
[2021-04-14T19:40:39.870Z] make: *** [functional-test] Error 1
[2021-04-14T19:40:40.822Z] [INFO] Stopping Filebeat Docker container
[2021-04-14T19:40:41.150Z] + docker exec -t bff030159340b8b882e18be5120af072a95ee8cea2bb01f08826448ed3ba1b5c chmod -R ugo+rw /output
[2021-04-14T19:40:41.411Z] + docker stop --time 30 bff030159340b8b882e18be5120af072a95ee8cea2bb01f08826448ed3ba1b5c
[2021-04-14T19:40:41.984Z] bff030159340b8b882e18be5120af072a95ee8cea2bb01f08826448ed3ba1b5c
[2021-04-14T19:40:42.038Z] Archiving artifacts
[2021-04-14T19:40:42.812Z] Recording test results
[2021-04-14T19:40:43.179Z] [Checks API] No suitable checks publisher found.
[2021-04-14T19:40:43.234Z] Archiving artifacts
[2021-04-14T19:40:43.381Z] Running in /var/lib/jenkins/workspace/PR-1043-1-0b5b1f46-05e7-4c0e-84d9-f4edeadd15ea/src/github.com/elastic/e2e-testing
[2021-04-14T19:40:43.763Z] + go clean -modcache
[2021-04-14T19:40:45.268Z] Failed in branch ubuntu-18.04_fleet_agent_endpoint_integration
[2021-04-14T19:40:47.610Z] Stage "Release" skipped due to earlier failure(s)
[2021-04-14T19:40:54.328Z] Running on Jenkins in /var/lib/jenkins/workspace/2e-tests_e2e-testing-mbp_PR-1043
[2021-04-14T19:40:54.541Z] [INFO] getVaultSecret: Getting secrets
[2021-04-14T19:40:54.734Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-04-14T19:40:56.042Z] + chmod 755 generate-build-data.sh
[2021-04-14T19:40:56.042Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1043/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1043/runs/1 FAILURE 1625526
[2021-04-14T19:40:56.292Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1043/runs/1/steps/?limit=10000 -o steps-info.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test Results
Failed 1
Passed 140
Skipped 0
Total 141

Genuine test errors 1

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

  • Name: Initializing / End-To-End Tests / ubuntu-18.04_fleet_agent_endpoint_integration / Deploying an Endpoint makes policies to appear in the Security App – Agent Endpoint Integration

@mdelapenya mdelapenya merged commit 6fee879 into elastic:master Apr 14, 2021
@mdelapenya
Copy link
Contributor Author

It's weird that it's not interpolating the variables properly:

This cause string:

causeString: 'Triggered on #$GT_PR (baseRef:$GT_BASE_REF, sha:$GT_PR_HEAD_SHA), via comment: $GT_BODY',

is generating this message:

Triggered on #97041 (baseRef:$GT_BASE_REF, sha:97041_HEAD_SHA), via comment: /run-fleet-e2e-tests

Where it's not evaluating "$GT_PR_HEAD_SHA" entirely, as it detected "$GT_PR" already exists as a variable.

@kuisathaverat are you familiar with that?

On the other hand $GT_BASE_REF was defined with $.pull_request.base.ref, which I'm not sure it's part of the payload. Is there a way to know the payload sent by kibana repo to this job?

@mdelapenya mdelapenya deleted the fix-run-e2-tests branch April 15, 2021 10:20
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Apr 15, 2021
* master:
  chore: add debug info for the payload (elastic#1044)
  chore: add debug traces for the webhook payload (elastic#1043)
  fix: wrong interpolation (elastic#1042)
  Update Elastic Agent to not use Kibana (elastic#1036)
  fix: apply X version for non-master branches (elastic#1037)
  fix: add NodeJS to PATH (elastic#1035)
  fix: use an agent when building kibana (elastic#1030)
  fix(jjb): use a branch that exists (elastic#1029)
  remove uninstall step (elastic#1017)
  fix: delay checking stale agent version until it's used (elastic#1016)
  fix: use same JJB than in custom kibana (elastic#1010)
  chore: simplify PR template (elastic#1011)
  feat: support passing KIBANA_VERSION (elastic#905)
  [mergify] assign the original author (elastic#1009)
  Remove the agent config file parameters for stand alone (elastic#983)
  Uniquify the stand-alone step for checking agent status (elastic#993)
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Apr 19, 2021
* master:
  fix: check if kibana version is a commit (elastic#1047)
  fix: incorrect variable name (elastic#1046)
  fix: typo in parameters (elastic#1045)
  chore: add debug info for the payload (elastic#1044)
  chore: add debug traces for the webhook payload (elastic#1043)
  fix: wrong interpolation (elastic#1042)
  Update Elastic Agent to not use Kibana (elastic#1036)
  fix: apply X version for non-master branches (elastic#1037)
  fix: add NodeJS to PATH (elastic#1035)
  fix: use an agent when building kibana (elastic#1030)
  fix(jjb): use a branch that exists (elastic#1029)
  remove uninstall step (elastic#1017)
  fix: delay checking stale agent version until it's used (elastic#1016)
  fix: use same JJB than in custom kibana (elastic#1010)
  chore: simplify PR template (elastic#1011)
  feat: support passing KIBANA_VERSION (elastic#905)
  [mergify] assign the original author (elastic#1009)
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Apr 20, 2021
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Apr 20, 2021
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Apr 20, 2021
mdelapenya added a commit that referenced this pull request Apr 20, 2021
…bhook payload (#1043) | chore: add debug info for the payload (#1044) | fix: typo in parameters (#1045) | fix: incorrect variable name (#1046) | fix: do not use GT_REPO va (#1057)

* fix: wrong interpolation (#1042)

* chore: add debug traces for the webhook payload (#1043)

* chore: add debug info for the payload (#1044)

* fix: do not use variable names as variable prefix

* chore: print payload

* fix: perform another API call to fetch PR data

We need a second API request, as the issue_comment API does not retrieve
data about the pull request. See
https://docs.github.com/en/developers/webhooks-and-events/webhook-events-and-payloads#issue_comment

* fix: typo in parameters (#1045)

* fix: incorrect variable name (#1046)

* fix: do not use GT_REPO variable, use fixed repo name instead (#1049)

* fix: do not use GT_REPO variable, use fixed repo name

Because the repo is always Kibana, let's use it

* chore: remove unused echo
mdelapenya added a commit that referenced this pull request Apr 20, 2021
…bhook payload (#1043) | chore: add debug info for the payload (#1044) | fix: typo in parameters (#1045) | fix: incorrect variable name (#1046) | fix: do not use GT_REPO va (#1058)

* fix: wrong interpolation (#1042)

* chore: add debug traces for the webhook payload (#1043)

* chore: add debug info for the payload (#1044)

* fix: do not use variable names as variable prefix

* chore: print payload

* fix: perform another API call to fetch PR data

We need a second API request, as the issue_comment API does not retrieve
data about the pull request. See
https://docs.github.com/en/developers/webhooks-and-events/webhook-events-and-payloads#issue_comment

* fix: typo in parameters (#1045)

* fix: incorrect variable name (#1046)

* fix: do not use GT_REPO variable, use fixed repo name instead (#1049)

* fix: do not use GT_REPO variable, use fixed repo name

Because the repo is always Kibana, let's use it

* chore: remove unused echo
mdelapenya added a commit that referenced this pull request Apr 20, 2021
…bhook payload (#1043) | chore: add debug info for the payload (#1044) | fix: typo in parameters (#1045) | fix: incorrect variable name (#1046) | fix: do not use GT_REPO va (#1059)

* fix: wrong interpolation (#1042)

* chore: add debug traces for the webhook payload (#1043)

* chore: add debug info for the payload (#1044)

* fix: do not use variable names as variable prefix

* chore: print payload

* fix: perform another API call to fetch PR data

We need a second API request, as the issue_comment API does not retrieve
data about the pull request. See
https://docs.github.com/en/developers/webhooks-and-events/webhook-events-and-payloads#issue_comment

* fix: typo in parameters (#1045)

* fix: incorrect variable name (#1046)

* fix: do not use GT_REPO variable, use fixed repo name instead (#1049)

* fix: do not use GT_REPO variable, use fixed repo name

Because the repo is always Kibana, let's use it

* chore: remove unused echo
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants