Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

docs: generate a website with the specs #261

Merged
merged 10 commits into from
Sep 4, 2020
Merged

docs: generate a website with the specs #261

merged 10 commits into from
Sep 4, 2020

Conversation

mdelapenya
Copy link
Contributor

@mdelapenya mdelapenya commented Sep 3, 2020 •
edited by zube bot
Loading

What does this PR do?

This PR generates a website with the HTML representation of the gherkin feature files, so that it's easier to consume them.

The generation is done using picklesdoc (http://docs.picklesdoc.com), a Windows application that parses Gherkin files and generates an HTML output. We have wrapped the Windows binary into a Docker image (using mono), and pushing this image to our registry:

Because this image uses a Windows binary, we wrapped the execution into a Make target, which massages the output to remove bad slashes in the generated paths (i.e. the root index.html file).

Why is it important?

We want to provide an easy way to consume the specification, shareable and understandable by anybody in the team, and HTML is easy to read.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have run the Unit tests for the CLI, and they are passing locally
  • I have run the End-2-End tests for the suite I'm working on, and they are passing locally
  • I have noticed new Go dependencies (run make notice in the proper directory)

Author's Checklist

  • Generated the docs locally

How to test this PR locally

$ cd e2e
$ make build-docs

A website will be generate under the docs directory

Related issues

Screenshots

Sample website:

Screenshot 2020-09-03 at 17 38 49

Logs

Generating documentation based on the following parameters 
---------------------------------------------------------- 
Feature Directory              : /suites 
Output Directory               : /suites/docs 
Project Name                   : E2E Testing 
Project Version                : 1.0.0 
Language                       : en 
Incorporate Test Results?      : No 
Include Experimental Features? : No 
Exclude Tag                    :  
Technical Tag                    :  
Writing HTML to /suites/docs 
Pickles completed successfully

Follow-ups

The templates are embedded into the binary, need to research about customising the HTML templates.

We also need to put the Dockerfile for the picklesdoc image in a repo.

@mdelapenya mdelapenya self-assigned this Sep 3, 2020
@mdelapenya mdelapenya requested review from a team and EricDavisX September 3, 2020 15:36
@mdelapenya mdelapenya added automation documentation Improvements or additions to documentation labels Sep 3, 2020
@elasticmachine
Copy link
Contributor

elasticmachine commented Sep 3, 2020 •
edited
Loading

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #261 updated]

  • Start Time: 2020-09-04T07:43:37.900+0000

  • Duration: 20 min 47 sec

Test stats 🧪

Test Results
Failed 15
Passed 48
Skipped 13
Total 76

Test errors

Expand to view the tests failures

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Deploying the centos agent – Fleet Mode Agent

    • Age: 1
    • Duration: 12.698066
    • Error Details: Step the agent is listed in Fleet as online

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Deploying the debian agent – Fleet Mode Agent

    • Age: 1
    • Duration: 11.756456
    • Error Details: Step the agent is listed in Fleet as online

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Starting the centos agent starts backend processes – Fleet Mode Agent

    • Age: 1
    • Duration: 7.720017
    • Error Details: Step the "filebeat" process is in the "started" state on the host

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Starting the debian agent starts backend processes – Fleet Mode Agent

    • Age: 1
    • Duration: 7.826832
    • Error Details: Step the "filebeat" process is in the "started" state on the host

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Stopping the centos agent stops backend processes – Fleet Mode Agent

    • Age: 1
    • Duration: 7.725255
    • Error Details: Step the "elastic-agent" process is "stopped" on the host

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Stopping the debian agent stops backend processes – Fleet Mode Agent

    • Age: 1
    • Duration: 7.766217
    • Error Details: Step the "elastic-agent" process is "stopped" on the host

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Restarting the centos host with persistent agent restarts backend processes – Fleet Mode Agent

    • Age: 1
    • Duration: 9.0408125
    • Error Details: Step the host is restarted

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Restarting the debian host with persistent agent restarts backend processes – Fleet Mode Agent

    • Age: 1
    • Duration: 8.922197
    • Error Details: Step the host is restarted

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Un-enrolling the centos agent – Fleet Mode Agent

    • Age: 1
    • Duration: 8.991559
    • Error Details: Step the agent is un-enrolled

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Un-enrolling the debian agent – Fleet Mode Agent

    • Age: 1
    • Duration: 8.956349
    • Error Details: Step the agent is un-enrolled

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Re-enrolling the centos agent – Fleet Mode Agent

    • Age: 1
    • Duration: 7.9669857
    • Error Details: Step the agent is un-enrolled

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Re-enrolling the debian agent – Fleet Mode Agent

    • Age: 1
    • Duration: 10.943387
    • Error Details: Step the agent is un-enrolled

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Revoking the enrollment token for the centos agent – Fleet Mode Agent

    • Age: 1
    • Duration: 7.9046946
    • Error Details: Step the enrollment token is revoked

  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Revoking the enrollment token for the debian agent – Fleet Mode Agent

    • Age: 1
    • Duration: 9.882246
    • Error Details: Step the enrollment token is revoked

  • Name: Initializing / End-To-End Tests / ingest-manager_stand_alone_mode / Deploying a stand-alone agent – Stand-alone Agent

    • Age: 1
    • Duration: 180.34006
    • Error Details: Step there is new data in the index from agent: Not enough hits in the index yet. Current: 1, Desired: 50

Steps errors

Expand to view the steps failures

  • Name: Run functional tests for ingest-manager:stand_alone_mode

    • Description:

    • Duration: 8 min 51 sec

    • Start Time: 2020-09-04T07:50:07.138+0000

    • log

  • Name: Error signal

    • Description:

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-04T07:57:57.723+0000

    • log

  • Name: General Build Step

    • Description: [2020-09-04T07:57:58.383Z] Archiving artifacts
      hudson.AbortException: script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-04T07:57:58.378+0000

    • log

  • Name: Run functional tests for ingest-manager:fleet_mode

    • Description:

    • Duration: 8 min 48 sec

    • Start Time: 2020-09-04T07:50:07.042+0000

    • log

  • Name: Error signal

    • Description:

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-04T07:57:54.922+0000

    • log

  • Name: General Build Step

    • Description: [2020-09-04T07:57:55.395Z] Archiving artifacts
      hudson.AbortException: script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-04T07:57:55.390+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-09-04T08:02:22.140Z] metricbeat_1     | 2020-09-04T08:02:21.584Z	DEBUG	[modules]	beater/metricbeat.go:151	Available modules and metricsets: Register [ModuleFactory:[aws, azure, beat, cloudfoundry, docker, elasticsearch, kibana, linux, logstash, mongodb, mssql, mysql, oracle, postgresql, system, uwsgi], MetricSetFactory:[aerospike/namespace, apache/status, appsearch/stats, aws/cloudwatch, aws/ec2, aws/rds, aws/s3_daily_storage, aws/s3_request, aws/sqs, azure/compute_vm, azure/compute_vm_scaleset, azure/monitor, azure/storage, beat/state, beat/stats, ceph/cluster_disk, ceph/cluster_health, ceph/cluster_status, ceph/mgr_cluster_disk, ceph/mgr_cluster_health, ceph/mgr_osd_perf, ceph/mgr_osd_pool_stats, ceph/mgr_osd_tree, ceph/mgr_pool_disk, ceph/monitor_health, ceph/osd_df, ceph/osd_tree, ceph/pool_disk, cloudfoundry/container, cloudfoundry/counter, cloudfoundry/value, consul/agent, coredns/stats, couchbase/bucket, couchbase/cluster, couchbase/node, couchdb/server, docker/container, docker/cpu, docker/diskio, docker/event, docker/healthcheck, docker/image, docker/info, docker/memory, docker/network, dropwizard/collector, elasticsearch/ccr, elasticsearch/cluster_stats, elasticsearch/enrich, elasticsearch/index, elasticsearch/index_recovery, elasticsearch/index_summary, elasticsearch/ml_job, elasticsearch/node, elasticsearch/node_stats, elasticsearch/pending_tasks, elasticsearch/shard, envoyproxy/server, etcd/leader, etcd/metrics, etcd/self, etcd/store, golang/expvar, golang/heap, googlecloud/stackdriver, graphite/server, haproxy/info, haproxy/stat, http/json, http/server, istio/citadel, istio/galley, istio/mesh, istio/mixer, istio/pilot, jolokia/jmx, kafka/consumergroup, kafka/partition, kibana/stats, kibana/status, kubernetes/apiserver, kubernetes/container, kubernetes/controllermanager, kubernetes/event, kubernetes/node, kubernetes/pod, kubernetes/proxy, kubernetes/scheduler, kubernetes/state_container, kubernetes/state_cronjob, kubernetes/state_deployment, kubernetes/state_node, kubernetes/state_persistentvolume, kubernetes/state_persistentvolumeclaim, kubernetes/state_pod, kubernetes/state_replicaset, kubernetes/state_resourcequota, kubernetes/state_service, kubernetes/state_statefulset, kubernetes/state_storageclass, kubernetes/system, kubernetes/volume, kvm/dommemstat, kvm/status, linux/conntrack, linux/ksm, linux/pageinfo, logstash/node, logstash/node_stats, memcached/stats, mongodb/collstats, mongodb/dbstats, mongodb/metrics, mongodb/replstatus, mongodb/status, mssql/performance, mssql/transaction_log, munin/node, mysql/galera_status, mysql/status, nats/connections, nats/routes, nats/stats, nats/subscriptions, nginx/stubstatus, openmetrics/collector, oracle/performance, oracle/tablespace, php_fpm/pool, php_fpm/process, postgresql/activity, postgresql/bgwriter, postgresql/database, postgresql/statement, prometheus/collector, prometheus/query, prometheus/remote_write, rabbitmq/connection, rabbitmq/exchange, rabbitmq/node, rabbitmq/queue, redis/info, redis/key, redis/keyspace, sql/query, stan/channels, stan/stats, stan/subscriptions, statsd/server, system/core, system/cpu, system/diskio, system/entropy, system/filesystem, system/fsstat, system/load, system/memory, system/network, system/network_summary, system/process, system/process_summary, system/raid, system/service, system/socket, system/socket_summary, system/uptime, system/users, traefik/health, uwsgi/status, vsphere/datastore, vsphere/host, vsphere/virtualmachine, zookeeper/connection, zookeeper/mntr, zookeeper/server], LightModules:[LightModules:[redisenterprise/node, redisenterprise/proxy, ibmmq/qmgr, aws/usage, aws/sns, aws/lambda, aws/dynamodb, aws/vpn, aws/elb, aws/ebs, aws/billing, aws/transitgateway, aws/natgateway, azure/container_registry, azure/container_instance, azure/container_service, azure/database_account, activemq/broker, activemq/queue, activemq/topic, iis/webserver, iis/website, kafka/broker, kafka/producer, kafka/consumer, cockroachdb/status, googlecloud/compute, googlecloud/pubsub, googlecloud/loadbalancing, googlecloud/storage, tomcat/requests, tomcat/cache, tomcat/threading, tomcat/memory]]]
[2020-09-04T08:02:22.140Z] metricbeat_1     | 2020-09-04T08:02:21.585Z	INFO	[monitoring]	log/log.go:118	Starting metrics logging every 30s
[2020-09-04T08:02:22.140Z] metricbeat_1     | 2020-09-04T08:02:21.585Z	INFO	instance/beat.go:463	metricbeat start running.
[2020-09-04T08:02:22.140Z] metricbeat_1     | 2020-09-04T08:02:21.586Z	DEBUG	[module]	module/wrapper.go:127	Starting Wrapper[name=mysql, len(metricSetWrappers)=1]
[2020-09-04T08:02:22.140Z] metricbeat_1     | 2020-09-04T08:02:21.586Z	DEBUG	[module]	module/wrapper.go:181	mysql/status will start after 8.800294384s
[2020-09-04T08:02:22.406Z] time="2020-09-04T08:02:22Z" level=debug msg="Docker compose executed." cmd="[logs metricbeat]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/metricbeat/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:7.8.0 mysqlTag:8.0.13-4 serviceName:mysql stackVersion:7.8.0]" profile=metricbeat
[2020-09-04T08:02:22.406Z] time="2020-09-04T08:02:22Z" level=debug msg="Updating state" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:02:22.406Z] time="2020-09-04T08:02:22Z" level=debug msg="State updated" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:02:22.406Z] time="2020-09-04T08:02:22Z" level=debug msg="Waiting 20 seconds" seconds=20
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:42Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:42Z" level=debug msg="Response information" hits=1 status="200 OK" took=2
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:42Z" level=warning msg="Waiting for more hits in the index" currentHits=1 desiredHits=5 elapsedTime=8.276594ms index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=1
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:42Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:42Z" level=debug msg="Response information" hits=2 status="200 OK" took=3
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:42Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=638.14164ms index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=2
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:44Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:44Z" level=debug msg="Response information" hits=2 status="200 OK" took=2
[2020-09-04T08:02:44.436Z] time="2020-09-04T08:02:44Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=1.945277261s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=3
[2020-09-04T08:02:46.997Z] time="2020-09-04T08:02:46Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:02:46.997Z] time="2020-09-04T08:02:46Z" level=debug msg="Response information" hits=2 status="200 OK" took=3
[2020-09-04T08:02:46.997Z] time="2020-09-04T08:02:46Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=4.416095538s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=4
[2020-09-04T08:02:49.575Z] time="2020-09-04T08:02:49Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:02:49.575Z] time="2020-09-04T08:02:49Z" level=debug msg="Response information" hits=2 status="200 OK" took=2
[2020-09-04T08:02:49.575Z] time="2020-09-04T08:02:49Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=7.154182807s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=5
[2020-09-04T08:02:54.886Z] time="2020-09-04T08:02:53Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:02:54.886Z] time="2020-09-04T08:02:53Z" level=debug msg="Response information" hits=3 status="200 OK" took=3
[2020-09-04T08:02:54.886Z] time="2020-09-04T08:02:53Z" level=warning msg="Waiting for more hits in the index" currentHits=3 desiredHits=5 elapsedTime=11.804310619s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=6
[2020-09-04T08:03:01.488Z] time="2020-09-04T08:03:00Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:03:01.488Z] time="2020-09-04T08:03:00Z" level=debug msg="Response information" hits=3 status="200 OK" took=3
[2020-09-04T08:03:01.488Z] time="2020-09-04T08:03:00Z" level=warning msg="Waiting for more hits in the index" currentHits=3 desiredHits=5 elapsedTime=18.798155017s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=7
[2020-09-04T08:03:08.089Z] time="2020-09-04T08:03:06Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:03:08.089Z] time="2020-09-04T08:03:06Z" level=debug msg="Response information" hits=4 status="200 OK" took=2
[2020-09-04T08:03:08.089Z] time="2020-09-04T08:03:06Z" level=warning msg="Waiting for more hits in the index" currentHits=4 desiredHits=5 elapsedTime=24.719921176s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv retry=8
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Response information" hits=5 status="200 OK" took=5
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=32.124923662s retries=9
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Elasticsearch query" index=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv query="map[query:map[bool:map[must:[map[match:map[event.module:mysql]]]]]]"
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Response information" hits=5 status="200 OK" took=4
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=9.27899ms retries=1
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="After scenario..."
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Removing services to compose" profile=metricbeat services="[metricbeat mysql]"
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml type=profiles
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/metricbeat/docker-compose.yml type=services
[2020-09-04T08:03:14.698Z] time="2020-09-04T08:03:14Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/mysql/docker-compose.yml type=services
[2020-09-04T08:03:14.960Z] Stopping metricbeat_metricbeat_1 ... 
[2020-09-04T08:03:15.536Z] 
Stopping metricbeat_metricbeat_1 ... done
Removing metricbeat_metricbeat_1 ... 
[2020-09-04T08:03:15.536Z] 
Removing metricbeat_metricbeat_1 ... done
Going to remove metricbeat_metricbeat_1
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="Docker compose executed." cmd="[rm -fvs metricbeat]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:7.8.0 mysqlTag:8.0.13-4 serviceName:mysql stackVersion:7.8.0]" profile=metricbeat
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="Updating state" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="State updated" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="Service removed from compose" profile=metricbeat service=metricbeat
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml type=profiles
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/metricbeat/docker-compose.yml type=services
[2020-09-04T08:03:15.536Z] time="2020-09-04T08:03:15Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/mysql/docker-compose.yml type=services
[2020-09-04T08:03:16.488Z] Stopping metricbeat_mysql_1 ... 
[2020-09-04T08:03:19.800Z] 
Stopping metricbeat_mysql_1 ... done
Removing metricbeat_mysql_1 ... 
[2020-09-04T08:03:19.800Z] 
Removing metricbeat_mysql_1 ... done
Going to remove metricbeat_mysql_1
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Docker compose executed." cmd="[rm -fvs mysql]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/metricbeat/docker-compose.yml /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/services/mysql/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:7.8.0 mysqlTag:8.0.13-4 serviceName:mysql stackVersion:7.8.0]" profile=metricbeat
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Updating state" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="State updated" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Service removed from compose" profile=metricbeat service=mysql
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Index deleted using Elasticsearch Go client" indexName=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv status="400 Bad Request"
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Index Alias deleted using Elasticsearch Go client" indexAlias=metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv status="400 Bad Request"
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml type=profiles
[2020-09-04T08:03:19.800Z] time="2020-09-04T08:03:19Z" level=debug msg="Compose file found at workdir" composeFilePath=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml type=profiles
[2020-09-04T08:03:20.381Z] Stopping metricbeat_elasticsearch_1 ... 
[2020-09-04T08:03:21.330Z] 
Stopping metricbeat_elasticsearch_1 ... done
Removing metricbeat_elasticsearch_1 ... 
[2020-09-04T08:03:21.330Z] 
Removing metricbeat_elasticsearch_1 ... done
Removing network metricbeat_default
[2020-09-04T08:03:21.592Z] time="2020-09-04T08:03:21Z" level=debug msg="Docker compose executed." cmd="[down]" composeFilePaths="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml]" env="map[BEAT_STRICT_PERMS:false indexName:metricbeat-7.8.0-mysql-percona-8.0.13-4-tj7zdlbv logLevel:debug metricbeatConfigFile:/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/src/github.com/elastic/e2e-testing/e2e/_suites/metricbeat/configurations/mysql.yml metricbeatTag:7.8.0 mysqlTag:8.0.13-4 serviceName:mysql stackVersion:7.8.0]" profile=metricbeat
[2020-09-04T08:03:21.592Z] time="2020-09-04T08:03:21Z" level=debug msg="Updating state" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:21.592Z] time="2020-09-04T08:03:21Z" level=debug msg="State updated" dir=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:21.592Z] time="2020-09-04T08:03:21Z" level=debug msg="Docker compose down." composeFilePath="[/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/compose/profiles/metricbeat/docker-compose.yml]" profile=metricbeat
[2020-09-04T08:03:21.592Z] time="2020-09-04T08:03:21Z" level=debug msg="State destroyed" stateFile=/var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261/.op/metricbeat-profile.run
[2020-09-04T08:03:21.592Z] <?xml version="1.0" encoding="UTF-8"?>
[2020-09-04T08:03:21.592Z] <testsuites name="main" tests="7" skipped="0" failures="0" errors="0" time="669.93851186">
[2020-09-04T08:03:21.592Z]   <testsuite name="Apache" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-09-04T08:03:21.592Z]   <testsuite name="Metricbeat" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-09-04T08:03:21.592Z]   <testsuite name="Mysql" tests="7" skipped="0" failures="0" errors="0" time="620.265891901">
[2020-09-04T08:03:21.592Z]     <testcase name="Check MariaDB-10.2.23 is sending metrics to Elasticsearch without errors" status="passed" time="90.119213052"></testcase>
[2020-09-04T08:03:21.592Z]     <testcase name="Check MariaDB-10.3.14 is sending metrics to Elasticsearch without errors" status="passed" time="79.752024142"></testcase>
[2020-09-04T08:03:21.592Z]     <testcase name="Check MariaDB-10.4.4 is sending metrics to Elasticsearch without errors" status="passed" time="85.265245511"></testcase>
[2020-09-04T08:03:21.592Z]     <testcase name="Check MySQL-5.7.12 is sending metrics to Elasticsearch without errors" status="passed" time="87.361108051"></testcase>
[2020-09-04T08:03:21.592Z]     <testcase name="Check MySQL-8.0.13 is sending metrics to Elasticsearch without errors" status="passed" time="76.745010162"></testcase>
[2020-09-04T08:03:21.592Z]     <testcase name="Check Percona-5.7.24 is sending metrics to Elasticsearch without errors" status="passed" time="87.373140408"></testcase>
[2020-09-04T08:03:21.592Z]     <testcase name="Check Percona-8.0.13-4 is sending metrics to Elasticsearch without errors" status="passed" time="90.987876159"></testcase>
[2020-09-04T08:03:21.592Z]   </testsuite>
[2020-09-04T08:03:21.593Z]   <testsuite name="Redis" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-09-04T08:03:21.593Z]   <testsuite name="vSphere" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-09-04T08:03:21.593Z] </testsuites>+ sed -e 's/^[ \t]*//; s#>.*failed$#>#g' outputs/TEST-metricbeat-mysql
[2020-09-04T08:03:21.593Z] + grep -E '^<.*>$'
[2020-09-04T08:03:21.593Z] + exit 0
[2020-09-04T08:03:21.655Z] Recording test results
[2020-09-04T08:03:22.295Z] Archiving artifacts
[2020-09-04T08:03:23.661Z] Stage "Release" skipped due to earlier failure(s)
[2020-09-04T08:03:24.504Z] Running on Jenkins in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-261@2
[2020-09-04T08:03:24.545Z] [INFO] getVaultSecret: Getting secrets
[2020-09-04T08:03:24.608Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-09-04T08:03:25.259Z] + chmod 755 generate-build-data.sh
[2020-09-04T08:03:25.260Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-261/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-261/runs/11 FAILURE 1187098
[2020-09-04T08:03:25.260Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-261/runs/11/steps/?limit=10000 -o steps-info.json

v1v
v1v reviewed Sep 3, 2020
View reviewed changes
.ci/Jenkinsfile Outdated Show resolved Hide resolved
@mdelapenya mdelapenya marked this pull request as ready for review September 4, 2020 07:50
@mdelapenya
Copy link
Contributor Author

@EricDavisX you'll love this: https://beats-ci.elastic.co/job/e2e-tests/job/e2e-testing-mbp/job/PR-261/11/artifact/e2e/docs/_suites/ingest-manager/features/fleet_mode_agent.html

@mdelapenya
Copy link
Contributor Author

mdelapenya commented Sep 4, 2020 •
edited
Loading

The errors are not related, as the agent structure has changed: see elastic/beats#20986

@mdelapenya mdelapenya merged commit b355508 into elastic:master Sep 4, 2020
This was referenced Sep 4, 2020
Merged
Merged
mdelapenya added a commit to mdelapenya/e2e-testing that referenced this pull request Sep 4, 2020
@mdelapenya @v1v
docs: generate a website with the specs (elastic#261)
a998fdf 
* docs: generate a website with the specs

* docs: update docs

* fix: close jenkinsfile blocks properly

* chore: move stage to run it before the E2E tests

* fix: remove interactive command line

* fix: typo in URL

* chore: use a flatten structure for archived files

Co-authored-by: Victor Martinez <[email protected]>

* chore: login to Docker to pull docs image

* fix: use proper user in container

* fix: proper location for post block

Co-authored-by: Victor Martinez <[email protected]>
@mdelapenya mdelapenya mentioned this pull request Sep 4, 2020
Merged
mdelapenya added a commit that referenced this pull request Sep 4, 2020
@mdelapenya @v1v
docs: generate a website with the specs (#261) (#262)
7e3e8ae 
* docs: generate a website with the specs

* docs: update docs

* fix: close jenkinsfile blocks properly

* chore: move stage to run it before the E2E tests

* fix: remove interactive command line

* fix: typo in URL

* chore: use a flatten structure for archived files

Co-authored-by: Victor Martinez <[email protected]>

* chore: login to Docker to pull docs image

* fix: use proper user in container

* fix: proper location for post block

Co-authored-by: Victor Martinez <[email protected]>

Co-authored-by: Victor Martinez <[email protected]>
@mdelapenya mdelapenya deleted the 260-generate-docs branch September 4, 2020 16:55
@EricDavisX
Copy link
Contributor

excellent indeed!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@cachedout cachedout cachedout approved these changes

@v1v v1v v1v approved these changes

@EricDavisX EricDavisX Awaiting requested review from EricDavisX

Assignees

@mdelapenya mdelapenya

Labels
automation documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Automatically generate docs for the gherkin scenarios
5 participants
@mdelapenya @elasticmachine @EricDavisX @cachedout @v1v