chore: rename ingest_manager endpoints to fleet #348

mdelapenya · 2020-10-05T16:01:44Z

Please do not merge until Kibana 8.0.0-SNAPSHOT contains elastic/kibana#79193

What does this PR do?

It renames all HTTP endpoints from "/ingest_manager" to "/fleet/"

Why is it important?

This PR is preparing the code for upcoming changes on Kibana side.

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have run the Unit tests for the CLI, and they are passing locally
I have run the End-2-End tests for the suite I'm working on, and they are passing locally
I have noticed new Go dependencies (run make notice in the proper directory)

Related issues

Follow-ups

As described in the Kibana PR, this must not be backported to 7.9.x

elasticmachine · 2020-10-05T16:06:09Z

💔 Tests Failed

Expand to view the summary

Build stats

Build Cause: [Started by user Manuel de la Peña, Replayed #8]
Start Time: 2020-10-08T08:54:06.673+0000
Duration: 19 min 42 sec

Test stats 🧪

Test	Results
Failed	17
Passed	48
Skipped	20
Total	85

Test errors

Expand to view the tests failures

Name: Initializing / End-To-End Tests / fleet_agent_endpoint_integration / Adding the Endpoint Integration to an Agent makes the host to show in Security App – Agent Endpoint Integration
- Age: 6
- Duration: 15.114211
- Error Details: Step the agent is listed in Fleet as "online"
Name: Initializing / End-To-End Tests / fleet_agent_endpoint_integration / Deploying an Endpoint makes policies to appear in the Security App – Agent Endpoint Integration
- Age: 6
- Duration: 5.9309354
- Error Details: Step the policy response will be shown in the Security App
Name: Initializing / End-To-End Tests / fleet_agent_endpoint_integration / Changing an Agent policy is reflected in the Security App – Agent Endpoint Integration
- Age: 6
- Duration: 6.0949736
- Error Details: Step the policy is updated to have "malware" in "detect" mode
Name: Initializing / End-To-End Tests / fleet_agent_endpoint_integration / Un-enrolling Elastic Agent stops Elastic Endpoint – Agent Endpoint Integration
- Age: 6
- Duration: 6.0066547
- Error Details: Step the agent is un-enrolled
Name: Initializing / End-To-End Tests / fleet_agent_endpoint_integration / Removing Endpoint from Agent policy stops the connected Endpoint – Agent Endpoint Integration
- Age: 6
- Duration: 5.7201576
- Error Details: Step the "Elastic Endpoint Security" integration is "removed" in the policy
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Deploying the centos agent – Fleet Mode Agent
- Age: 6
- Duration: 15.73534
- Error Details: Step the "elastic-agent" process is in the "started" state on the host
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Deploying the debian agent – Fleet Mode Agent
- Age: 6
- Duration: 11.982758
- Error Details: Step the "elastic-agent" process is in the "started" state on the host
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Stopping the centos agent stops backend processes – Fleet Mode Agent
- Age: 6
- Duration: 6.0235715
- Error Details: Step the "elastic-agent" process is "stopped" on the host
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Stopping the debian agent stops backend processes – Fleet Mode Agent
- Age: 6
- Duration: 7.101955
- Error Details: Step the "elastic-agent" process is "stopped" on the host
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Restarting the centos host with persistent agent restarts backend processes – Fleet Mode Agent
- Age: 6
- Duration: 6.1716905
- Error Details: Step the host is restarted
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Restarting the debian host with persistent agent restarts backend processes – Fleet Mode Agent
- Age: 6
- Duration: 7.0552797
- Error Details: Step the host is restarted
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Un-enrolling the centos agent – Fleet Mode Agent
- Age: 6
- Duration: 5.9855895
- Error Details: Step the agent is un-enrolled
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Un-enrolling the debian agent – Fleet Mode Agent
- Age: 6
- Duration: 7.080644
- Error Details: Step the agent is un-enrolled
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Re-enrolling the centos agent – Fleet Mode Agent
- Age: 6
- Duration: 6.1247406
- Error Details: Step the agent is un-enrolled
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Re-enrolling the debian agent – Fleet Mode Agent
- Age: 6
- Duration: 7.8913465
- Error Details: Step the agent is un-enrolled
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Revoking the enrollment token for the centos agent – Fleet Mode Agent
- Age: 6
- Duration: 6.610173
- Error Details: Step the enrollment token is revoked
Name: Initializing / End-To-End Tests / fleet_fleet_mode / Revoking the enrollment token for the debian agent – Fleet Mode Agent
- Age: 6
- Duration: 7.09952
- Error Details: Step the enrollment token is revoked

Steps errors

Expand to view the steps failures

Name: Run functional tests for fleet:agent_endpoint_integration
- Description:
- Duration: 4 min 12 sec
- Start Time: 2020-10-08T08:59:36.723+0000
- log
Name: Error signal
- Description:
- Duration: 0 min 0 sec
- Start Time: 2020-10-08T09:03:48.819+0000
- log
Name: General Build Step
- Description: [2020-10-08T09:03:49.323Z] Archiving artifacts
  hudson.AbortException: script returned exit code 1
- Duration: 0 min 0 sec
- Start Time: 2020-10-08T09:03:49.317+0000
- log
Name: Run functional tests for fleet:fleet_mode
- Description:
- Duration: 6 min 40 sec
- Start Time: 2020-10-08T08:59:36.473+0000
- log
Name: Error signal
- Description:
- Duration: 0 min 0 sec
- Start Time: 2020-10-08T09:05:16.336+0000
- log
Name: General Build Step
- Description: [2020-10-08T09:05:16.860Z] Archiving artifacts
  hudson.AbortException: script returned exit code 1
- Duration: 0 min 0 sec
- Start Time: 2020-10-08T09:05:16.855+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-10-08T09:11:13.055Z] time="2020-10-08T09:11:12Z" level=debug msg="Docker compose executed." cmd="[rm -fvs metricbeat]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-8.0.0-mysql-percona-5.7.24-itljjurf logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:5.7.24 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:11:13.055Z] time="2020-10-08T09:11:12Z" level=debug msg="Service removed from compose" profile=metricbeat service=metricbeat
[2020-10-08T09:11:13.628Z] Stopping metricbeat_mysql_1 ... 
[2020-10-08T09:11:16.935Z] 
Stopping metricbeat_mysql_1 ... done
Removing metricbeat_mysql_1 ... 
[2020-10-08T09:11:16.936Z] 
Removing metricbeat_mysql_1 ... done
Going to remove metricbeat_mysql_1
[2020-10-08T09:11:16.936Z] time="2020-10-08T09:11:16Z" level=debug msg="Docker compose executed." cmd="[rm -fvs mysql]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-8.0.0-mysql-percona-5.7.24-itljjurf logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:5.7.24 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:11:16.936Z] time="2020-10-08T09:11:16Z" level=debug msg="Service removed from compose" profile=metricbeat service=mysql
[2020-10-08T09:11:16.936Z] time="2020-10-08T09:11:16Z" level=debug msg="Index deleted using Elasticsearch Go client" indexName=metricbeat-8.0.0-mysql-percona-5.7.24-itljjurf status="400 Bad Request"
[2020-10-08T09:11:16.936Z] time="2020-10-08T09:11:16Z" level=debug msg="Index Alias deleted using Elasticsearch Go client" indexAlias=metricbeat-8.0.0-mysql-percona-5.7.24-itljjurf status="400 Bad Request"
[2020-10-08T09:11:17.197Z] Pulling mysql (docker.elastic.co/integrations-ci/beats-mysql:percona-8.0.13-4-1)...
[2020-10-08T09:11:17.459Z] percona-8.0.13-4-1: Pulling from integrations-ci/beats-mysql
[2020-10-08T09:11:29.714Z] metricbeat_elasticsearch_1 is up-to-date
[2020-10-08T09:11:29.714Z] Creating metricbeat_mysql_1 ... 
[2020-10-08T09:11:32.271Z] 
Creating metricbeat_mysql_1 ... done
time="2020-10-08T09:11:31Z" level=debug msg="Docker compose executed." cmd="[up -d]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false MYSQL_PATH:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql MYSQL_VARIANT:percona MYSQL_VERSION:8.0.13-4 indexName:metricbeat-8.0.0-mysql-percona-5.7.24-itljjurf logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:5.7.24 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:11:54.278Z] Found orphan containers (metricbeat_mysql_1) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
[2020-10-08T09:11:54.279Z] metricbeat_elasticsearch_1 is up-to-date
[2020-10-08T09:11:54.279Z] Creating metricbeat_metricbeat_1 ... 
[2020-10-08T09:11:54.279Z] 
Creating metricbeat_metricbeat_1 ... done
time="2020-10-08T09:11:53Z" level=debug msg="Docker compose executed." cmd="[up -d]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/metricbeat/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false MYSQL_PATH:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql MYSQL_VARIANT:percona MYSQL_VERSION:8.0.13-4 indexName:metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:8.0.13-4 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:11:54.279Z] time="2020-10-08T09:11:53Z" level=info msg="Metricbeat is running configured for the service" metricbeatVersion=8.0.0-SNAPSHOT service=mysql serviceVersion=8.0.13-4 variant=Percona
[2020-10-08T09:11:54.279Z] Attaching to metricbeat_metricbeat_1
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.474Z	INFO	instance/beat.go:628	Home path: [/usr/share/metricbeat] Config path: [/usr/share/metricbeat] Data path: [/usr/share/metricbeat/data] Logs path: [/usr/share/metricbeat/logs]
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.474Z	DEBUG	[beat]	instance/beat.go:680	Beat metadata path: /usr/share/metricbeat/data/meta.json
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.480Z	INFO	instance/beat.go:636	Beat ID: 44f9e93d-1c39-4184-b1f7-1ff1778ea70e
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.481Z	DEBUG	[seccomp]	seccomp/seccomp.go:117	Loading syscall filter	{"seccomp_filter": {"no_new_privs":true,"flag":"tsync","policy":{"default_action":"errno","syscalls":[{"names":["accept","accept4","access","arch_prctl","bind","brk","chmod","chown","clock_gettime","clone","close","connect","dup","dup2","epoll_create","epoll_create1","epoll_ctl","epoll_pwait","epoll_wait","exit","exit_group","fchdir","fchmod","fchmodat","fchown","fchownat","fcntl","fdatasync","flock","fstat","fstatfs","fsync","ftruncate","futex","getcwd","getdents","getdents64","geteuid","getgid","getpeername","getpid","getppid","getrandom","getrlimit","getrusage","getsockname","getsockopt","gettid","gettimeofday","getuid","inotify_add_watch","inotify_init1","inotify_rm_watch","ioctl","kill","listen","lseek","lstat","madvise","mincore","mkdirat","mmap","mprotect","munmap","nanosleep","newfstatat","open","openat","pipe","pipe2","poll","ppoll","pread64","pselect6","pwrite64","read","readlink","readlinkat","recvfrom","recvmmsg","recvmsg","rename","renameat","rt_sigaction","rt_sigprocmask","rt_sigreturn","sched_getaffinity","sched_yield","sendfile","sendmmsg","sendmsg","sendto","set_robust_list","setitimer","setsockopt","shutdown","sigaltstack","socket","splice","stat","statfs","sysinfo","tgkill","time","tkill","uname","unlink","unlinkat","wait4","waitid","write","writev"],"action":"allow"}]}}}
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.481Z	INFO	[seccomp]	seccomp/seccomp.go:124	Syscall filter successfully installed
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.481Z	INFO	[beat]	instance/beat.go:960	Beat info	{"system_info": {"beat": {"path": {"config": "/usr/share/metricbeat", "data": "/usr/share/metricbeat/data", "home": "/usr/share/metricbeat", "logs": "/usr/share/metricbeat/logs"}, "type": "metricbeat", "uuid": "44f9e93d-1c39-4184-b1f7-1ff1778ea70e"}}}
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.481Z	INFO	[beat]	instance/beat.go:969	Build info	{"system_info": {"build": {"commit": "189171723ce69e3a235ef16a80c870db74fba682", "libbeat": "8.0.0", "time": "2020-10-08T01:56:02.000Z", "version": "8.0.0"}}}
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.481Z	INFO	[beat]	instance/beat.go:972	Go runtime info	{"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":4,"version":"go1.14.7"}}}
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.483Z	INFO	[beat]	instance/beat.go:976	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2020-10-08T08:58:47Z","containerized":true,"name":"ddc011373f49","ip":["127.0.0.1/8","172.18.0.4/16"],"kernel_version":"5.4.0-1025-gcp","mac":["02:42:ac:12:00:04"],"os":{"family":"redhat","platform":"centos","name":"CentOS Linux","version":"7 (Core)","major":7,"minor":8,"patch":2003,"codename":"Core"},"timezone":"UTC","timezone_offset_sec":0}}}
[2020-10-08T09:11:54.279Z] metricbeat_1     | 2020-10-08T09:11:53.483Z	INFO	[beat]	instance/beat.go:1005	Process info	{"system_info": {"process": {"capabilities": {"inheritable":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"permitted":null,"effective":null,"bounding":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"ambient":null}, "cwd": "/usr/share/metricbeat", "exe": "/usr/share/metricbeat/metricbeat", "name": "metricbeat", "pid": 1, "ppid": 0, "seccomp": {"mode":"filter","no_new_privs":true}, "start_time": "2020-10-08T09:11:52.790Z"}}}
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.483Z	INFO	instance/beat.go:298	Setup Beat: metricbeat; Version: 8.0.0
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.483Z	DEBUG	[beat]	instance/beat.go:324	Initializing output plugins
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.483Z	INFO	[index-management]	idxmgmt/std.go:184	Set output.elasticsearch.index to 'metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo' as ILM is enabled.
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.484Z	INFO	eslegclient/connection.go:99	elasticsearch url: http://elasticsearch:9200
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.484Z	DEBUG	[publisher]	pipeline/consumer.go:148	start pipeline event consumer
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.484Z	INFO	[publisher]	pipeline/module.go:113	Beat name: ddc011373f49
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.508Z	DEBUG	[modules]	beater/metricbeat.go:151	Available modules and metricsets: Register [ModuleFactory:[aws, azure, beat, cloudfoundry, docker, elasticsearch, kibana, linux, logstash, mongodb, mssql, mysql, oracle, postgresql, system, uwsgi], MetricSetFactory:[aerospike/namespace, apache/status, appsearch/stats, aws/billing, aws/cloudwatch, aws/ec2, aws/rds, aws/s3_daily_storage, aws/s3_request, aws/sqs, azure/app_insights, azure/billing, azure/monitor, azure/storage, beat/state, beat/stats, ceph/cluster_disk, ceph/cluster_health, ceph/cluster_status, ceph/mgr_cluster_disk, ceph/mgr_cluster_health, ceph/mgr_osd_perf, ceph/mgr_osd_pool_stats, ceph/mgr_osd_tree, ceph/mgr_pool_disk, ceph/monitor_health, ceph/osd_df, ceph/osd_tree, ceph/pool_disk, cloudfoundry/container, cloudfoundry/counter, cloudfoundry/value, consul/agent, coredns/stats, couchbase/bucket, couchbase/cluster, couchbase/node, couchdb/server, docker/container, docker/cpu, docker/diskio, docker/event, docker/healthcheck, docker/image, docker/info, docker/memory, docker/network, dropwizard/collector, elasticsearch/ccr, elasticsearch/cluster_stats, elasticsearch/enrich, elasticsearch/index, elasticsearch/index_recovery, elasticsearch/index_summary, elasticsearch/ml_job, elasticsearch/node, elasticsearch/node_stats, elasticsearch/pending_tasks, elasticsearch/shard, envoyproxy/server, etcd/leader, etcd/metrics, etcd/self, etcd/store, golang/expvar, golang/heap, googlecloud/billing, googlecloud/metrics, graphite/server, haproxy/info, haproxy/stat, http/json, http/server, istio/citadel, istio/galley, istio/mesh, istio/mixer, istio/pilot, jolokia/jmx, kafka/consumergroup, kafka/partition, kibana/stats, kibana/status, kubernetes/apiserver, kubernetes/container, kubernetes/controllermanager, kubernetes/event, kubernetes/node, kubernetes/pod, kubernetes/proxy, kubernetes/scheduler, kubernetes/state_container, kubernetes/state_cronjob, kubernetes/state_daemonset, kubernetes/state_deployment, kubernetes/state_node, kubernetes/state_persistentvolume, kubernetes/state_persistentvolumeclaim, kubernetes/state_pod, kubernetes/state_replicaset, kubernetes/state_resourcequota, kubernetes/state_service, kubernetes/state_statefulset, kubernetes/state_storageclass, kubernetes/system, kubernetes/volume, kvm/dommemstat, kvm/status, linux/conntrack, linux/iostat, linux/ksm, linux/memory, linux/pageinfo, logstash/node, logstash/node_stats, memcached/stats, mongodb/collstats, mongodb/dbstats, mongodb/metrics, mongodb/replstatus, mongodb/status, mssql/performance, mssql/transaction_log, munin/node, mysql/galera_status, mysql/query, mysql/status, nats/connections, nats/routes, nats/stats, nats/subscriptions, nginx/stubstatus, openmetrics/collector, oracle/performance, oracle/tablespace, php_fpm/pool, php_fpm/process, postgresql/activity, postgresql/bgwriter, postgresql/database, postgresql/statement, prometheus/collector, prometheus/query, prometheus/remote_write, rabbitmq/connection, rabbitmq/exchange, rabbitmq/node, rabbitmq/queue, redis/info, redis/key, redis/keyspace, sql/query, stan/channels, stan/stats, stan/subscriptions, statsd/server, system/core, system/cpu, system/diskio, system/entropy, system/filesystem, system/fsstat, system/load, system/memory, system/network, system/network_summary, system/process, system/process_summary, system/raid, system/service, system/socket, system/socket_summary, system/uptime, system/users, traefik/health, uwsgi/status, vsphere/datastore, vsphere/host, vsphere/virtualmachine, zookeeper/connection, zookeeper/mntr, zookeeper/server], LightModules:[LightModules:[ibmmq/qmgr, mysql/performance, tomcat/threading, tomcat/memory, tomcat/requests, tomcat/cache, redisenterprise/node, redisenterprise/proxy, aws/vpn, aws/usage, aws/lambda, aws/sns, aws/dynamodb, aws/transitgateway, aws/natgateway, aws/elb, aws/ebs, cockroachdb/status, azure/container_service, azure/database_account, azure/app_state, azure/compute_vm, azure/compute_vm_scaleset, azure/container_registry, azure/container_instance, iis/webserver, iis/website, activemq/broker, activemq/queue, activemq/topic, kafka/broker, kafka/producer, kafka/consumer, googlecloud/loadbalancing, googlecloud/storage, googlecloud/compute, googlecloud/pubsub]]]
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.510Z	INFO	[monitoring]	log/log.go:118	Starting metrics logging every 30s
[2020-10-08T09:11:54.280Z] metricbeat_1     | 2020-10-08T09:11:53.510Z	INFO	instance/beat.go:449	metricbeat start running.
[2020-10-08T09:11:54.281Z] metricbeat_1     | 2020-10-08T09:11:53.510Z	DEBUG	[module]	module/wrapper.go:127	Starting Wrapper[name=mysql, len(metricSetWrappers)=1]
[2020-10-08T09:11:54.281Z] metricbeat_1     | 2020-10-08T09:11:53.510Z	DEBUG	[module]	module/wrapper.go:181	mysql/status will start after 646.562074ms
[2020-10-08T09:11:54.281Z] time="2020-10-08T09:11:54Z" level=debug msg="Docker compose executed." cmd="[logs metricbeat]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/metricbeat/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:8.0.13-4 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:12:16.268Z] time="2020-10-08T09:12:14Z" level=debug msg="Response information" hits=2 status="200 OK" took=3
[2020-10-08T09:12:16.268Z] time="2020-10-08T09:12:14Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=9.50133ms index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=1
[2020-10-08T09:12:16.268Z] time="2020-10-08T09:12:14Z" level=debug msg="Response information" hits=2 status="200 OK" took=2
[2020-10-08T09:12:16.268Z] time="2020-10-08T09:12:14Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=637.469962ms index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=2
[2020-10-08T09:12:16.268Z] time="2020-10-08T09:12:15Z" level=debug msg="Response information" hits=2 status="200 OK" took=2
[2020-10-08T09:12:16.268Z] time="2020-10-08T09:12:15Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=1.945861624s index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=3
[2020-10-08T09:12:18.817Z] time="2020-10-08T09:12:18Z" level=debug msg="Response information" hits=3 status="200 OK" took=2
[2020-10-08T09:12:18.817Z] time="2020-10-08T09:12:18Z" level=warning msg="Waiting for more hits in the index" currentHits=3 desiredHits=5 elapsedTime=4.413501313s index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=4
[2020-10-08T09:12:21.369Z] time="2020-10-08T09:12:21Z" level=debug msg="Response information" hits=3 status="200 OK" took=2
[2020-10-08T09:12:21.369Z] time="2020-10-08T09:12:21Z" level=warning msg="Waiting for more hits in the index" currentHits=3 desiredHits=5 elapsedTime=7.153519627s index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=5
[2020-10-08T09:12:26.662Z] time="2020-10-08T09:12:25Z" level=debug msg="Response information" hits=3 status="200 OK" took=2
[2020-10-08T09:12:26.662Z] time="2020-10-08T09:12:25Z" level=warning msg="Waiting for more hits in the index" currentHits=3 desiredHits=5 elapsedTime=11.802059243s index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=6
[2020-10-08T09:12:33.252Z] time="2020-10-08T09:12:32Z" level=debug msg="Response information" hits=4 status="200 OK" took=2
[2020-10-08T09:12:33.252Z] time="2020-10-08T09:12:32Z" level=warning msg="Waiting for more hits in the index" currentHits=4 desiredHits=5 elapsedTime=18.795462237s index=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo retry=7
[2020-10-08T09:12:39.842Z] time="2020-10-08T09:12:38Z" level=debug msg="Response information" hits=5 status="200 OK" took=2
[2020-10-08T09:12:39.842Z] time="2020-10-08T09:12:38Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=24.717304893s retries=8
[2020-10-08T09:12:39.842Z] time="2020-10-08T09:12:38Z" level=debug msg="Response information" hits=5 status="200 OK" took=2
[2020-10-08T09:12:39.842Z] time="2020-10-08T09:12:38Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=6.167925ms retries=1
[2020-10-08T09:12:39.842Z] Stopping metricbeat_metricbeat_1 ... 
[2020-10-08T09:12:39.842Z] 
Stopping metricbeat_metricbeat_1 ... done
Removing metricbeat_metricbeat_1 ... 
[2020-10-08T09:12:39.842Z] 
Removing metricbeat_metricbeat_1 ... done
Going to remove metricbeat_metricbeat_1
[2020-10-08T09:12:39.842Z] time="2020-10-08T09:12:39Z" level=debug msg="Docker compose executed." cmd="[rm -fvs metricbeat]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:8.0.13-4 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:12:39.842Z] time="2020-10-08T09:12:39Z" level=debug msg="Service removed from compose" profile=metricbeat service=metricbeat
[2020-10-08T09:12:40.416Z] Stopping metricbeat_mysql_1 ... 
[2020-10-08T09:12:43.718Z] 
Stopping metricbeat_mysql_1 ... done
Removing metricbeat_mysql_1 ... 
[2020-10-08T09:12:43.719Z] 
Removing metricbeat_mysql_1 ... done
Going to remove metricbeat_mysql_1
[2020-10-08T09:12:43.719Z] time="2020-10-08T09:12:43Z" level=debug msg="Docker compose executed." cmd="[rm -fvs mysql]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:8.0.13-4 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:12:43.719Z] time="2020-10-08T09:12:43Z" level=debug msg="Service removed from compose" profile=metricbeat service=mysql
[2020-10-08T09:12:43.719Z] time="2020-10-08T09:12:43Z" level=debug msg="Index deleted using Elasticsearch Go client" indexName=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo status="400 Bad Request"
[2020-10-08T09:12:43.719Z] time="2020-10-08T09:12:43Z" level=debug msg="Index Alias deleted using Elasticsearch Go client" indexAlias=metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo status="400 Bad Request"
[2020-10-08T09:12:44.294Z] Stopping metricbeat_elasticsearch_1 ... 
[2020-10-08T09:12:45.249Z] 
Stopping metricbeat_elasticsearch_1 ... done
Removing metricbeat_elasticsearch_1 ... 
[2020-10-08T09:12:45.510Z] 
Removing metricbeat_elasticsearch_1 ... done
Removing network metricbeat_default
[2020-10-08T09:12:45.511Z] time="2020-10-08T09:12:45Z" level=debug msg="Docker compose executed." cmd="[down]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/.op/compose/profiles/metricbeat/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-8.0.0-mysql-percona-8.0.13-4-aeprrueo logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:8.0.0-SNAPSHOT mysqlTag:8.0.13-4 serviceName:mysql stackVersion:8.0.0-SNAPSHOT]" profile=metricbeat
[2020-10-08T09:12:45.511Z] <?xml version="1.0" encoding="UTF-8"?>
[2020-10-08T09:12:45.511Z] <testsuites name="main" tests="7" skipped="0" failures="0" errors="0" time="663.720850936">
[2020-10-08T09:12:45.511Z]   <testsuite name="Mysql" tests="7" skipped="0" failures="0" errors="0" time="615.690874836">
[2020-10-08T09:12:45.511Z]     <testcase name="MariaDB-10.2.23 sends metrics to Elasticsearch without errors" status="passed" time="92.754149684"></testcase>
[2020-10-08T09:12:45.511Z]     <testcase name="MariaDB-10.3.14 sends metrics to Elasticsearch without errors" status="passed" time="79.89067727"></testcase>
[2020-10-08T09:12:45.511Z]     <testcase name="MariaDB-10.4.4 sends metrics to Elasticsearch without errors" status="passed" time="86.156079653"></testcase>
[2020-10-08T09:12:45.511Z]     <testcase name="MySQL-5.7.12 sends metrics to Elasticsearch without errors" status="passed" time="82.377147278"></testcase>
[2020-10-08T09:12:45.511Z]     <testcase name="MySQL-8.0.13 sends metrics to Elasticsearch without errors" status="passed" time="87.863264816"></testcase>
[2020-10-08T09:12:45.511Z]     <testcase name="Percona-5.7.24 sends metrics to Elasticsearch without errors" status="passed" time="81.986904441"></testcase>
[2020-10-08T09:12:45.511Z]     <testcase name="Percona-8.0.13-4 sends metrics to Elasticsearch without errors" status="passed" time="82.313175347"></testcase>
[2020-10-08T09:12:45.511Z]   </testsuite>
[2020-10-08T09:12:45.511Z] </testsuites>+ sed -e 's/^[ \t]*//; s#>.*failed$#>#g' outputs/TEST-metricbeat-mysql
[2020-10-08T09:12:45.511Z] + grep -E '^<.*>$'
[2020-10-08T09:12:45.511Z] + exit 0
[2020-10-08T09:12:45.570Z] Recording test results
[2020-10-08T09:12:46.065Z] Archiving artifacts
[2020-10-08T09:12:47.536Z] Stage "Release" skipped due to earlier failure(s)
[2020-10-08T09:12:48.387Z] Running on worker-395930 in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-348
[2020-10-08T09:12:48.423Z] [INFO] getVaultSecret: Getting secrets
[2020-10-08T09:12:48.468Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-08T09:12:50.426Z] + chmod 755 generate-build-data.sh
[2020-10-08T09:12:50.426Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-348/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-348/runs/9 FAILURE 1122346
[2020-10-08T09:12:50.426Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-348/runs/9/steps/?limit=10000 -o steps-info.json
[2020-10-08T09:12:58.153Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-348/runs/9/tests/?status=FAILED -o tests-errors.json

EricDavisX

looks right to me - so glad they are all encapsulated here, nicely set up for easy maintenance!

e2e/_suites/ingest-manager/fleet.go

Co-authored-by: Nicolas Chaulet <[email protected]>

EricDavisX · 2020-10-06T18:55:12Z

the Kibana side PR is merged, fyi

mdelapenya · 2020-10-06T18:57:44Z

We can merge, as the tests were already failing, although I'm tempted to wait for the release process to generate the Docker images and binaries.

I'll merge tomorrow morning

EricDavisX · 2020-10-07T14:18:34Z

the 8.0 / master unified build failed... not sure if a new Kibana container was created or not - we may want to wait to merge, not sure.

mdelapenya · 2020-10-09T05:46:41Z

Merging, as I verified that latest Kibana snapshot contains the changes. Thanks!

chore: rename ingest_manager endpoints to fleet

23b930f

mdelapenya self-assigned this Oct 5, 2020

mdelapenya requested a review from a team October 5, 2020 16:01

fix: remove duplicated fleet path in URLs

5772fc8

mdelapenya marked this pull request as ready for review October 5, 2020 16:04

mdelapenya added the needs_backport label Oct 5, 2020

mdelapenya requested review from EricDavisX and nchaulet October 5, 2020 16:06

EricDavisX approved these changes Oct 5, 2020

View reviewed changes

nchaulet reviewed Oct 5, 2020

View reviewed changes

e2e/_suites/ingest-manager/fleet.go Outdated Show resolved Hide resolved

Update setup endpoint

ddf3938

Co-authored-by: Nicolas Chaulet <[email protected]>

cachedout approved these changes Oct 6, 2020

View reviewed changes

chore: rename ingest-manager test suite to Fleet

4759cd2

nchaulet approved these changes Oct 7, 2020

View reviewed changes

Merge branch 'master' into 342-api-changes

ef148c3

mdelapenya merged commit b95f777 into elastic:master Oct 9, 2020

mdelapenya deleted the 342-api-changes branch October 9, 2020 07:48

This was referenced Oct 13, 2020

fix: rename JJB files in maintenance branch too #362

Merged

[Fleet] duplicate file for legacy backwards compatibility support apis due to ingest_magement -> fleet api change #349

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: rename ingest_manager endpoints to fleet #348

chore: rename ingest_manager endpoints to fleet #348

mdelapenya commented Oct 5, 2020 •

edited

Loading

elasticmachine commented Oct 5, 2020 •

edited

Loading

Build stats

Test stats 🧪

EricDavisX left a comment

EricDavisX commented Oct 6, 2020

mdelapenya commented Oct 6, 2020 •

edited

Loading

EricDavisX commented Oct 7, 2020

mdelapenya commented Oct 9, 2020

chore: rename ingest_manager endpoints to fleet #348

chore: rename ingest_manager endpoints to fleet #348

Conversation

mdelapenya commented Oct 5, 2020 • edited Loading

What does this PR do?

Why is it important?

Checklist

Related issues

Follow-ups

elasticmachine commented Oct 5, 2020 • edited Loading

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

EricDavisX left a comment

Choose a reason for hiding this comment

EricDavisX commented Oct 6, 2020

mdelapenya commented Oct 6, 2020 • edited Loading

EricDavisX commented Oct 7, 2020

mdelapenya commented Oct 9, 2020

mdelapenya commented Oct 5, 2020 •

edited

Loading

elasticmachine commented Oct 5, 2020 •

edited

Loading

mdelapenya commented Oct 6, 2020 •

edited

Loading