Flaky Test [Build&Test / metricbeat-pythonIntegTest / test_output – metricbeat.module.consul.test_consul.ConsulAgentTest_1]

[elasticmachine]

Flaky Test

• Test Name: Build&Test / metricbeat-pythonIntegTest / test_output – metricbeat.module.consul.test_consul.ConsulAgentTest_1
• Artifact Link: https://beats-ci.elastic.co/blue/organizations/jenkins/Beats%2Fbeats%2FPR-24589/detail/PR-24589/2/
• PR: Cherry-pick to 7.x: [CI] enable new flaky detector (#24464) #24589
• Commit: 6fc36e5

Error details

AssertionError: Element counts were not equal: First has 1, Second has 0:  "runtime"

Stack Trace

self = <test_consul.ConsulAgentTest_1 testMethod=test_output>

    @unittest.skipUnless(metricbeat.INTEGRATION_TESTS, "integration test")
    @pytest.mark.tag("integration")
    def test_output(self):
        """
        Consul agent module outputs an event.
        """
        self.render_config_template(modules=[{
            "name": "consul",
            "metricsets": ["agent"],
            "hosts": self.get_hosts(),
            "period": "10s"
        }])
        proc = self.start_beat()
        self.wait_until(lambda: self.output_lines() > 0, max_timeout=30)
        proc.check_kill_and_wait()
        self.assert_no_logged_warnings()
    
        output = self.read_output_json()
        self.assertEqual(len(output), 1)
        evt = output[0]
    
        self.assertCountEqual(self.de_dot(CONSUL_FIELDS), evt.keys())
        consul_agent = evt["consul"]["agent"]
    
        consul_agent.pop("raft", None)
        consul_agent.pop("autopilot", None)
    
        print(consul_agent)
>       self.assertCountEqual(self.de_dot(AGENT_FIELDS), consul_agent.keys())
E       AssertionError: Element counts were not equal:
E       First has 1, Second has 0:  "runtime"

module/consul/test_consul.py:56: AssertionError

[elasticmachine]

Pinging @elastic/integrations (Team:Integrations)

[elasticmachine]

Flaky Test

• Test Name: Build&Test / metricbeat-pythonIntegTest / test_output – metricbeat.module.consul.test_consul.ConsulAgentTest_1
• Artifact Link: https://beats-ci.elastic.co/blue/organizations/jenkins/Beats%2Fbeats%2Fmaster/detail/master/373/
• PR: None
• Commit: 02000c3

Error details

AssertionError: Element counts were not equal: First has 1, Second has 0:  "runtime"

Stack Trace

self = <test_consul.ConsulAgentTest_1 testMethod=test_output>

    @unittest.skipUnless(metricbeat.INTEGRATION_TESTS, "integration test")
    @pytest.mark.tag("integration")
    def test_output(self):
        """
        Consul agent module outputs an event.
        """
        self.render_config_template(modules=[{
            "name": "consul",
            "metricsets": ["agent"],
            "hosts": self.get_hosts(),
            "period": "10s"
        }])
        proc = self.start_beat()
        self.wait_until(lambda: self.output_lines() > 0, max_timeout=30)
        proc.check_kill_and_wait()
        self.assert_no_logged_warnings()
    
        output = self.read_output_json()
        self.assertEqual(len(output), 1)
        evt = output[0]
    
        self.assertCountEqual(self.de_dot(CONSUL_FIELDS), evt.keys())
        consul_agent = evt["consul"]["agent"]
    
        consul_agent.pop("raft", None)
        consul_agent.pop("autopilot", None)
    
        print(consul_agent)
>       self.assertCountEqual(self.de_dot(AGENT_FIELDS), consul_agent.keys())
E       AssertionError: Element counts were not equal:
E       First has 1, Second has 0:  "runtime"

module/consul/test_consul.py:56: AssertionError

[jsoriano]

Fixed in #24663.