Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cherry-pick to 7.x: [CI] enable new flaky detector (#24464) #24589

Merged
merged 1 commit into from
Mar 18, 2021
Merged

Cherry-pick to 7.x: [CI] enable new flaky detector (#24464) #24589

merged 1 commit into from
Mar 18, 2021

Conversation

v1v
Copy link
Member

@v1v v1v commented Mar 17, 2021

Backports the following commits to 7.x:

@v1v v1v self-assigned this Mar 17, 2021
@v1v v1v added automation backport ci skip-ci Skip the build in the CI but linting Team:Automation Label for the Observability productivity team labels Mar 17, 2021
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Mar 17, 2021
@elasticmachine
Copy link
Collaborator

elasticmachine commented Mar 17, 2021 •
edited by jenkins-beats-ci bot
Loading

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: v1v commented: /test

  • Start Time: 2021-03-17T15:09:11.598+0000

  • Duration: 56 min 22 sec

  • Commit: 6fc36e5

Test stats 🧪

Test Results
Failed 1
Passed 45559
Skipped 5139
Total 50699

Trends 🧪

Image of Build Times

Image of Tests

Test errors 1

Expand to view the tests failures

Build&Test / metricbeat-pythonIntegTest / test_output – metricbeat.module.consul.test_consul.ConsulAgentTest_1
    Expand to view the error details

     AssertionError: Element counts were not equal: First has 1, Second has 0:  'runtime'

    Expand to view the stacktrace

     self = <test_consul.ConsulAgentTest_1 testMethod=test_output>

    @unittest.skipUnless(metricbeat.INTEGRATION_TESTS, "integration test")
    @pytest.mark.tag('integration')
    def test_output(self):
        """
        Consul agent module outputs an event.
        """
        self.render_config_template(modules=[{
            "name": "consul",
            "metricsets": ["agent"],
            "hosts": self.get_hosts(),
            "period": "10s"
        }])
        proc = self.start_beat()
        self.wait_until(lambda: self.output_lines() > 0, max_timeout=30)
        proc.check_kill_and_wait()
        self.assert_no_logged_warnings()
    
        output = self.read_output_json()
        self.assertEqual(len(output), 1)
        evt = output[0]
    
        self.assertCountEqual(self.de_dot(CONSUL_FIELDS), evt.keys())
        consul_agent = evt["consul"]["agent"]
    
        consul_agent.pop("raft", None)
        consul_agent.pop("autopilot", None)
    
        print(consul_agent)
>       self.assertCountEqual(self.de_dot(AGENT_FIELDS), consul_agent.keys())
E       AssertionError: Element counts were not equal:
E       First has 1, Second has 0:  'runtime'

module/consul/test_consul.py:56: AssertionError

Steps errors 6

Expand to view the steps failures

metricbeat-pythonIntegTest - mage pythonIntegTest
  • Took 32 min 32 sec . View more details on here
  • Description: mage pythonIntegTest
Prepare test output
  • Took 0 min 5 sec . View more details on here
  • Description: python .ci/scripts/pre_archive_test.py
Prepare test output
  • Took 0 min 4 sec . View more details on here
  • Description: python .ci/scripts/pre_archive_test.py
Prepare test output
  • Took 0 min 3 sec . View more details on here
  • Description: python .ci/scripts/pre_archive_test.py
Prepare test output
  • Took 0 min 4 sec . View more details on here
  • Description: python .ci/scripts/pre_archive_test.py
Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output 

[2021-03-17T16:03:37.538Z]  Version:           20.10.3
[2021-03-17T16:03:37.538Z]  API version:       1.41
[2021-03-17T16:03:37.538Z]  Go version:        go1.13.15
[2021-03-17T16:03:37.538Z]  Git commit:        48d30b5
[2021-03-17T16:03:37.538Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-17T16:03:37.538Z]  OS/Arch:           linux/amd64
[2021-03-17T16:03:37.538Z]  Context:           default
[2021-03-17T16:03:37.538Z]  Experimental:      true
[2021-03-17T16:03:37.538Z] 
[2021-03-17T16:03:37.538Z] Server: Docker Engine - Community
[2021-03-17T16:03:37.538Z]  Engine:
[2021-03-17T16:03:37.538Z]   Version:          20.10.3
[2021-03-17T16:03:37.538Z]   API version:      1.41 (minimum version 1.12)
[2021-03-17T16:03:37.538Z]   Go version:       go1.13.15
[2021-03-17T16:03:37.538Z]   Git commit:       46229ca
[2021-03-17T16:03:37.538Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-17T16:03:37.538Z]   OS/Arch:          linux/amd64
[2021-03-17T16:03:37.538Z]   Experimental:     false
[2021-03-17T16:03:37.538Z]  containerd:
[2021-03-17T16:03:37.538Z]   Version:          1.4.4
[2021-03-17T16:03:37.538Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-17T16:03:37.538Z]  runc:
[2021-03-17T16:03:37.538Z]   Version:          1.0.0-rc93
[2021-03-17T16:03:37.539Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-17T16:03:37.539Z]  docker-init:
[2021-03-17T16:03:37.539Z]   Version:          0.19.0
[2021-03-17T16:03:37.539Z]   GitCommit:        de40ad0
[2021-03-17T16:03:37.539Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-17T16:03:37.539Z] Unable to find image 'alpine:3.4' locally
[2021-03-17T16:03:49.766Z] 3.4: Pulling from library/alpine
[2021-03-17T16:03:49.766Z] c1e54eec4b57: Pulling fs layer
[2021-03-17T16:03:50.028Z] c1e54eec4b57: Verifying Checksum
[2021-03-17T16:03:50.028Z] c1e54eec4b57: Download complete
[2021-03-17T16:03:50.028Z] c1e54eec4b57: Pull complete
[2021-03-17T16:03:50.028Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-03-17T16:03:50.028Z] Status: Downloaded newer image for alpine:3.4
[2021-03-17T16:03:52.580Z] Change permissions with write access of all files inside the specific folder
[2021-03-17T16:03:53.827Z] + python .ci/scripts/pre_archive_test.py
[2021-03-17T16:04:08.738Z] Copy ./x-pack/metricbeat/build into build/x-pack/metricbeat/build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/metricbeat/build/golang-crossbuild into build/x-pack/metricbeat/build/golang-crossbuild
[2021-03-17T16:04:08.738Z] Copy ./x-pack/metricbeat/build/package/metricbeat/metricbeat-linux-amd64.docker/docker-build into build/x-pack/metricbeat/build/package/metricbeat/metricbeat-linux-amd64.docker/docker-build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/metricbeat/build/package/metricbeat-ubi8/metricbeat-linux-amd64.docker/docker-build into build/x-pack/metricbeat/build/package/metricbeat-ubi8/metricbeat-linux-amd64.docker/docker-build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/elastic-agent/build into build/x-pack/elastic-agent/build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/elastic-agent/build/golang-crossbuild into build/x-pack/elastic-agent/build/golang-crossbuild
[2021-03-17T16:04:08.738Z] Copy ./x-pack/elastic-agent/build/package/elastic-agent/elastic-agent-linux-amd64.docker/docker-build into build/x-pack/elastic-agent/build/package/elastic-agent/elastic-agent-linux-amd64.docker/docker-build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/elastic-agent/build/package/elastic-agent-ubi8/elastic-agent-linux-amd64.docker/docker-build into build/x-pack/elastic-agent/build/package/elastic-agent-ubi8/elastic-agent-linux-amd64.docker/docker-build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/heartbeat/build into build/x-pack/heartbeat/build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/heartbeat/build/golang-crossbuild into build/x-pack/heartbeat/build/golang-crossbuild
[2021-03-17T16:04:08.738Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/filebeat/build/golang-crossbuild into build/x-pack/filebeat/build/golang-crossbuild
[2021-03-17T16:04:08.738Z] Copy ./x-pack/filebeat/build/package/filebeat-ubi8/filebeat-linux-amd64.docker/docker-build into build/x-pack/filebeat/build/package/filebeat-ubi8/filebeat-linux-amd64.docker/docker-build
[2021-03-17T16:04:08.738Z] Copy ./x-pack/filebeat/build/package/filebeat/filebeat-linux-amd64.docker/docker-build into build/x-pack/filebeat/build/package/filebeat/filebeat-linux-amd64.docker/docker-build
[2021-03-17T16:04:08.756Z] Running in /var/lib/jenkins/workspace/PR-24589-2-a86a8006-f757-47ec-baf6-e403f99cc60a/src/github.com/elastic/beats/build
[2021-03-17T16:04:09.078Z] + rm -rf ve
[2021-03-17T16:04:09.078Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-03-17T16:04:09.097Z] Recording test results
[2021-03-17T16:04:11.685Z] None of the test reports contained any result
[2021-03-17T16:04:11.693Z] [Checks API] No suitable checks publisher found.
[2021-03-17T16:04:12.053Z] + go clean -modcache
[2021-03-17T16:04:16.574Z] Cleaning up /var/lib/jenkins/workspace/PR-24589-2-a86a8006-f757-47ec-baf6-e403f99cc60a
[2021-03-17T16:04:16.574Z] Client: Docker Engine - Community
[2021-03-17T16:04:16.574Z]  Version:           20.10.3
[2021-03-17T16:04:16.574Z]  API version:       1.41
[2021-03-17T16:04:16.574Z]  Go version:        go1.13.15
[2021-03-17T16:04:16.574Z]  Git commit:        48d30b5
[2021-03-17T16:04:16.574Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-17T16:04:16.574Z]  OS/Arch:           linux/amd64
[2021-03-17T16:04:16.574Z]  Context:           default
[2021-03-17T16:04:16.574Z]  Experimental:      true
[2021-03-17T16:04:16.574Z] 
[2021-03-17T16:04:16.574Z] Server: Docker Engine - Community
[2021-03-17T16:04:16.574Z]  Engine:
[2021-03-17T16:04:16.574Z]   Version:          20.10.3
[2021-03-17T16:04:16.574Z]   API version:      1.41 (minimum version 1.12)
[2021-03-17T16:04:16.574Z]   Go version:       go1.13.15
[2021-03-17T16:04:16.574Z]   Git commit:       46229ca
[2021-03-17T16:04:16.574Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-17T16:04:16.574Z]   OS/Arch:          linux/amd64
[2021-03-17T16:04:16.574Z]   Experimental:     false
[2021-03-17T16:04:16.574Z]  containerd:
[2021-03-17T16:04:16.574Z]   Version:          1.4.4
[2021-03-17T16:04:16.574Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-17T16:04:16.574Z]  runc:
[2021-03-17T16:04:16.574Z]   Version:          1.0.0-rc93
[2021-03-17T16:04:16.574Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-17T16:04:16.574Z]  docker-init:
[2021-03-17T16:04:16.574Z]   Version:          0.19.0
[2021-03-17T16:04:16.574Z]   GitCommit:        de40ad0
[2021-03-17T16:04:16.574Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-17T16:05:24.319Z] Change permissions with write access of all files inside the specific folder
[2021-03-17T16:05:24.355Z] Running in /var/lib/jenkins/workspace/PR-24589-2-a86a8006-f757-47ec-baf6-e403f99cc60a
[2021-03-17T16:05:31.389Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-03-17T16:05:31.458Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-24589/src/github.com/elastic/beats
[2021-03-17T16:05:32.616Z] Running on beats-ci-immutable-ubuntu-1604-1615996541517604077 in /var/lib/jenkins/workspace/Beats_beats_PR-24589
[2021-03-17T16:05:32.665Z] [INFO] getVaultSecret: Getting secrets
[2021-03-17T16:05:32.772Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-03-17T16:05:34.300Z] + chmod 755 generate-build-data.sh
[2021-03-17T16:05:34.300Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24589/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24589/runs/2 FAILURE 3381831
[2021-03-17T16:05:34.300Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24589/runs/2/steps/?limit=10000 -o steps-info.json
[2021-03-17T16:05:44.303Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24589/runs/2/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❄️ The following tests failed but also have a history of flakiness and may not be related to this change:

Expand to view the summary

Test stats 🧪

Test Results
Failed 1
Passed 45559
Skipped 5139
Total 50699

@v1v v1v removed the skip-ci Skip the build in the CI but linting label Mar 17, 2021
@v1v
Copy link
Member Author

v1v commented Mar 17, 2021

/test

@elasticmachine elasticmachine mentioned this pull request Mar 17, 2021
Closed
@v1v v1v requested a review from cachedout March 17, 2021 19:10
cachedout
cachedout approved these changes Mar 18, 2021
View reviewed changes
Copy link
Contributor

@cachedout cachedout left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@v1v v1v merged commit 5141edb into elastic:7.x Mar 18, 2021
@v1v v1v deleted the backport/7.x/pr-24464 branch March 18, 2021 14:49
This was referenced Mar 22, 2021
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@kuisathaverat kuisathaverat kuisathaverat approved these changes

@mdelapenya mdelapenya mdelapenya approved these changes

@cachedout cachedout cachedout approved these changes

Assignees

@v1v v1v

Labels
automation backport ci Team:Automation Label for the Observability productivity team
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@v1v @elasticmachine @cachedout @mdelapenya @kuisathaverat