This repository has been archived by the owner on Jan 23, 2024. It is now read-only.

test: use filebeat step to grab Docker logs #1029

Merged

kuisathaverat merged 10 commits into elastic:master from kuisathaverat:filebeat

Feb 4, 2021

Contributor

kuisathaverat commented Jan 14, 2021

What does this PR do?

It uses the new filebeat step to grab the Dcoker logs

Why is it important?

It simplifies de troubleshooting all logs are in a single file for test block.

kuisathaverat added automation test Team:Automation labels

kuisathaverat self-assigned this

Contributor Author

kuisathaverat commented Jan 14, 2021

/testAll


          test: use filebeat step to grab Docker logs

c523424

kuisathaverat force-pushed the filebeat branch from ee0b57e to c523424 Compare

January 14, 2021 18:41

Collaborator

apmmachine commented Jan 14, 2021 •

edited

Loading

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Started by timer
- Start Time: 2021-02-04T05:22:00.202+0000
Duration: 184 min 34 sec
Commit: 091981e

Test stats 🧪

Test	Results
Failed	9
Passed	524
Skipped	3
Total	536

Test errors

Expand to view the tests failures

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test PHP / test_concurrent_req_php_apache – tests.agent.test_php`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])], expected 1000, got 0

Expand to view the stacktrace

 php_apache = <tests.fixtures.agents.Agent object at 0x7f6b2820fd90>

    @pytest.mark.version
    @pytest.mark.php_apache
    def test_concurrent_req_php_apache(php_apache):
        foo = Concurrent.Endpoint(php_apache.foo.url,
                                  php_apache.app_name,
                                  ["foo"],
                                  "GET /foo/")
>       Concurrent(php_apache.apm_server.elasticsearch, [foo], iters=2).run()

tests/agent/test_php.py:21: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])]
expected = 1000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])], expected 1000, got 0

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.11.0-SNAPSHOT' / Run ITs / Test PHP / test_concurrent_req_php_apache – tests.agent.test_php`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])], expected 1000, got 0

Expand to view the stacktrace

 php_apache = <tests.fixtures.agents.Agent object at 0x7f94a47d5050>

    @pytest.mark.version
    @pytest.mark.php_apache
    def test_concurrent_req_php_apache(php_apache):
        foo = Concurrent.Endpoint(php_apache.foo.url,
                                  php_apache.app_name,
                                  ["foo"],
                                  "GET /foo/")
>       Concurrent(php_apache.apm_server.elasticsearch, [foo], iters=2).run()

tests/agent/test_php.py:21: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])]
expected = 1000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])], expected 1000, got 0

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_concurrent_req_php_apache – tests.agent.test_php`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])], expected 1000, got 777

Expand to view the stacktrace

 php_apache = <tests.fixtures.agents.Agent object at 0x7f94ffa50450>

    @pytest.mark.version
    @pytest.mark.php_apache
    def test_concurrent_req_php_apache(php_apache):
        foo = Concurrent.Endpoint(php_apache.foo.url,
                                  php_apache.app_name,
                                  ["foo"],
                                  "GET /foo/")
>       Concurrent(php_apache.apm_server.elasticsearch, [foo], iters=2).run()

tests/agent/test_php.py:21: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])]
expected = 1000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['phpapacheapp'])], expected 1000, got 777

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_concurrent_req_flask – tests.agent.test_python`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['flaskapp'])], expected 1000, got 0

Expand to view the stacktrace

 flask = <tests.fixtures.agents.Agent object at 0x7f9514de1550>

    @pytest.mark.version
    @pytest.mark.flask
    def test_concurrent_req_flask(flask):
        foo = Concurrent.Endpoint(flask.foo.url,
                                  flask.app_name,
                                  ["app.foo"],
                                  "GET /foo")
>       Concurrent(flask.apm_server.elasticsearch, [foo], iters=2).run()

tests/agent/test_python.py:26: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['flaskapp'])]
expected = 1000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['flaskapp'])], expected 1000, got 0

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_concurrent_req_flask_foobar – tests.agent.test_python`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['flaskapp', 'flaskapp'])], expected 1375, got 1003

Expand to view the stacktrace

 flask = <tests.fixtures.agents.Agent object at 0x7f9514de1550>

    @pytest.mark.version
    @pytest.mark.flask
    def test_concurrent_req_flask_foobar(flask):
        foo = Concurrent.Endpoint(flask.foo.url,
                                  flask.app_name,
                                  ["app.foo"],
                                  "GET /foo",
                                  events_no=375)
        bar = Concurrent.Endpoint(flask.bar.url,
                                  flask.app_name,
                                  ["app.bar", "app.extra"],
                                  "GET /bar")
>       Concurrent(flask.apm_server.elasticsearch, [foo, bar], iters=1).run()

tests/agent/test_python.py:53: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['flaskapp', 'flaskapp'])]
expected = 1375

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['flaskapp', 'flaskapp'])], expected 1375, got 1003

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_concurrent_req_django – tests.agent.test_python`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['djangoapp'])], expected 1000, got 1

Expand to view the stacktrace

 django = <tests.fixtures.agents.Agent object at 0x7f9514de11d0>

    @pytest.mark.version
    @pytest.mark.django
    def test_concurrent_req_django(django):
        foo = Concurrent.Endpoint(django.foo.url,
                                  django.app_name,
                                  ["foo.views.foo"],
                                  "GET foo.views.show")
>       Concurrent(django.apm_server.elasticsearch, [foo], iters=2).run()

tests/agent/test_python.py:75: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['djangoapp'])]
expected = 1000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['djangoapp'])], expected 1000, got 1

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_concurrent_req_django_foobar – tests.agent.test_python`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['djangoapp', 'djangoapp'])], expected 1820, got 1002

Expand to view the stacktrace

 django = <tests.fixtures.agents.Agent object at 0x7f9514de11d0>

    @pytest.mark.version
    @pytest.mark.django
    def test_concurrent_req_django_foobar(django):
        foo = Concurrent.Endpoint(django.foo.url,
                                  django.app_name,
                                  ["foo.views.foo"],
                                  "GET foo.views.show")
        bar = Concurrent.Endpoint(django.bar.url,
                                  django.app_name,
                                  ["bar.views.bar", "bar.views.extra"],
                                  "GET bar.views.show",
                                  events_no=820)
>       Concurrent(django.apm_server.elasticsearch, [foo, bar], iters=1).run()

tests/agent/test_python.py:90: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['djangoapp', 'djangoapp'])]
expected = 1820

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['djangoapp', 'djangoapp'])], expected 1820, got 1002

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_conc_req_rails – tests.agent.test_ruby`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['railsapp'])], expected 1000, got 0

Expand to view the stacktrace

 es = <tests.fixtures.es.es.<locals>.Elasticsearch object at 0x7f955849dc50>
apm_server = <tests.fixtures.apm_server.apm_server.<locals>.APMServer object at 0x7f955849d7d0>
rails = <tests.fixtures.agents.Agent object at 0x7f95581a8490>

    @pytest.mark.version
    @pytest.mark.rails
    def test_conc_req_rails(es, apm_server, rails):
        foo = Concurrent.Endpoint(rails.foo.url,
                                  rails.app_name,
                                  ["ApplicationController#foo"],
                                  "ApplicationController#foo",
                                  events_no=1000)
>       Concurrent(es, [foo], iters=1).run()

tests/agent/test_ruby.py:29: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['railsapp'])]
expected = 1000

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['railsapp'])], expected 1000, got 0

tests/agent/concurrent_requests.py:132: AssertionError

`Tests On ECK / Matrix - ELASTIC_STACK_VERSION = '7.10.2' / Run ITs / Test All / test_conc_req_rails_foobar – tests.agent.test_ruby`

Expand to view the error details

 AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['railsapp', 'railsapp'])], expected 1820, got 0

Expand to view the stacktrace

 es = <tests.fixtures.es.es.<locals>.Elasticsearch object at 0x7f955849dc50>
apm_server = <tests.fixtures.apm_server.apm_server.<locals>.APMServer object at 0x7f955849d7d0>
rails = <tests.fixtures.agents.Agent object at 0x7f95581a8490>

    @pytest.mark.version
    @pytest.mark.rails
    def test_conc_req_rails_foobar(es, apm_server, rails):
        foo = Concurrent.Endpoint(rails.foo.url,
                                  rails.app_name,
                                  ["ApplicationController#foo"],
                                  "ApplicationController#foo")
        bar = Concurrent.Endpoint(rails.bar.url,
                                  rails.app_name,
                                  ["ApplicationController#bar", "app.extra"],
                                  "ApplicationController#bar",
                                  events_no=820)
>       Concurrent(es, [foo, bar], iters=1).run()

tests/agent/test_ruby.py:44: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/agent/concurrent_requests.py:254: in run
    self.check_counts(it)
tests/agent/concurrent_requests.py:138: in check_counts
    assert_count([("processor.event", "transaction"), ("service.name", service_names)], transactions_count)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

terms = [('processor.event', 'transaction'), ('service.name', ['railsapp', 'railsapp'])]
expected = 1820

    def assert_count(terms, expected):
        """wait a bit for doc count to reach expectation"""
        @timeout_decorator.timeout(max_wait)
        def check_count(mut_actual):
            while True:
                rsp = self.es.count(index=self.index, body=self.elasticsearch.term_q(terms))
                mut_actual[0] = rsp["count"]
                if mut_actual[0] >= expected:
                    return
                time.sleep(backoff)
    
        mut_actual = [-1]  # keep actual count in this mutable
        try:
            check_count(mut_actual)
        except timeout_decorator.TimeoutError:
            pass
        actual = mut_actual[0]
>       assert actual == expected, err.format(terms, expected, actual)
E       AssertionError: queried for [('processor.event', 'transaction'), ('service.name', ['railsapp', 'railsapp'])], expected 1820, got 0

tests/agent/concurrent_requests.py:132: AssertionError

Steps errors

Expand to view the steps failures

`Deploy Cluster`

Took 28 min 11 sec . View more details on here
Description: make create-cluster

`Shell Script`

Took 9 min 26 sec . View more details on here
Description: .ci/scripts/php.sh

`General Build Step`

Took 0 min 1 sec . View more details on here
Description: [2021-02-04T06:24:19.295Z] Archiving artifacts script returned exit code 2

`Shell Script`

Took 8 min 49 sec . View more details on here
Description: .ci/scripts/php.sh

`General Build Step`

Took 0 min 1 sec . View more details on here
Description: [2021-02-04T06:18:48.142Z] Archiving artifacts script returned exit code 2

`Shell Script`

Took 29 min 10 sec . View more details on here
Description: .ci/scripts/all.sh

`General Build Step`

Took 0 min 1 sec . View more details on here
Description: [2021-02-04T07:06:41.772Z] Archiving artifacts script returned exit code 2

Log output

Expand to view the last 100 lines of log output

[2021-02-04T08:25:35.944Z] + argument=https://apm-ci.elastic.co/
[2021-02-04T08:25:35.944Z] + query='map(with_entries(select(.key != "_links")) + ( .url = $a + ._links.self.href + "log"))'
[2021-02-04T08:25:35.944Z] + file=steps-info.json
[2021-02-04T08:25:35.944Z] ++ mktemp
[2021-02-04T08:25:35.944Z] + tmp=/tmp/tmp.tKdP03b3t3
[2021-02-04T08:25:35.944Z] + jq --arg a https://apm-ci.elastic.co/ 'map(with_entries(select(.key != "_links")) + ( .url = $a + ._links.self.href + "log"))' steps-info.json
[2021-02-04T08:25:35.944Z] + mv /tmp/tmp.tKdP03b3t3 steps-info.json
[2021-02-04T08:25:35.944Z] + jqEdit 'map(del(._links))' steps-info.json
[2021-02-04T08:25:35.944Z] + query='map(del(._links))'
[2021-02-04T08:25:35.944Z] + file=steps-info.json
[2021-02-04T08:25:35.944Z] ++ mktemp
[2021-02-04T08:25:35.944Z] + tmp=/tmp/tmp.mzHD5x90O7
[2021-02-04T08:25:35.944Z] + jq 'map(del(._links))' steps-info.json
[2021-02-04T08:25:36.194Z] + mv /tmp/tmp.mzHD5x90O7 steps-info.json
[2021-02-04T08:25:36.195Z] + jqEdit 'map(del(._class))' steps-info.json
[2021-02-04T08:25:36.195Z] + query='map(del(._class))'
[2021-02-04T08:25:36.195Z] + file=steps-info.json
[2021-02-04T08:25:36.195Z] ++ mktemp
[2021-02-04T08:25:36.195Z] + tmp=/tmp/tmp.WeyloyMQnq
[2021-02-04T08:25:36.195Z] + jq 'map(del(._class))' steps-info.json
[2021-02-04T08:25:36.195Z] + mv /tmp/tmp.WeyloyMQnq steps-info.json
[2021-02-04T08:25:36.195Z] + jqEdit 'map(del(.actions))' steps-info.json
[2021-02-04T08:25:36.195Z] + query='map(del(.actions))'
[2021-02-04T08:25:36.195Z] + file=steps-info.json
[2021-02-04T08:25:36.195Z] ++ mktemp
[2021-02-04T08:25:36.195Z] + tmp=/tmp/tmp.mvAvMjhI7T
[2021-02-04T08:25:36.195Z] + jq 'map(del(.actions))' steps-info.json
[2021-02-04T08:25:36.195Z] + mv /tmp/tmp.mvAvMjhI7T steps-info.json
[2021-02-04T08:25:36.195Z] + normaliseSteps steps-errors.json
[2021-02-04T08:25:36.195Z] + file=steps-errors.json
[2021-02-04T08:25:36.195Z] + jqAppend https://apm-ci.elastic.co/ 'map(with_entries(select(.key != "_links")) + ( .url = $a + ._links.self.href + "log"))' steps-errors.json
[2021-02-04T08:25:36.195Z] + argument=https://apm-ci.elastic.co/
[2021-02-04T08:25:36.195Z] + query='map(with_entries(select(.key != "_links")) + ( .url = $a + ._links.self.href + "log"))'
[2021-02-04T08:25:36.195Z] + file=steps-errors.json
[2021-02-04T08:25:36.195Z] ++ mktemp
[2021-02-04T08:25:36.195Z] + tmp=/tmp/tmp.2ES8UVtTZx
[2021-02-04T08:25:36.195Z] + jq --arg a https://apm-ci.elastic.co/ 'map(with_entries(select(.key != "_links")) + ( .url = $a + ._links.self.href + "log"))' steps-errors.json
[2021-02-04T08:25:36.195Z] + mv /tmp/tmp.2ES8UVtTZx steps-errors.json
[2021-02-04T08:25:36.195Z] + jqEdit 'map(del(._links))' steps-errors.json
[2021-02-04T08:25:36.195Z] + query='map(del(._links))'
[2021-02-04T08:25:36.195Z] + file=steps-errors.json
[2021-02-04T08:25:36.195Z] ++ mktemp
[2021-02-04T08:25:36.195Z] + tmp=/tmp/tmp.jGguWsdOZd
[2021-02-04T08:25:36.195Z] + jq 'map(del(._links))' steps-errors.json
[2021-02-04T08:25:36.445Z] + mv /tmp/tmp.jGguWsdOZd steps-errors.json
[2021-02-04T08:25:36.445Z] + jqEdit 'map(del(._class))' steps-errors.json
[2021-02-04T08:25:36.445Z] + query='map(del(._class))'
[2021-02-04T08:25:36.445Z] + file=steps-errors.json
[2021-02-04T08:25:36.445Z] ++ mktemp
[2021-02-04T08:25:36.445Z] + tmp=/tmp/tmp.HoMj69eMWX
[2021-02-04T08:25:36.445Z] + jq 'map(del(._class))' steps-errors.json
[2021-02-04T08:25:36.445Z] + mv /tmp/tmp.HoMj69eMWX steps-errors.json
[2021-02-04T08:25:36.445Z] + jqEdit 'map(del(.actions))' steps-errors.json
[2021-02-04T08:25:36.446Z] + query='map(del(.actions))'
[2021-02-04T08:25:36.446Z] + file=steps-errors.json
[2021-02-04T08:25:36.446Z] ++ mktemp
[2021-02-04T08:25:36.446Z] + tmp=/tmp/tmp.l757ixhHTj
[2021-02-04T08:25:36.446Z] + jq 'map(del(.actions))' steps-errors.json
[2021-02-04T08:25:36.446Z] + mv /tmp/tmp.l757ixhHTj steps-errors.json
[2021-02-04T08:25:36.446Z] + fetchAndDefaultTestsErrors tests-errors.json 'https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED' '[ ]'
[2021-02-04T08:25:36.446Z] + file=tests-errors.json
[2021-02-04T08:25:36.446Z] + url='https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED'
[2021-02-04T08:25:36.446Z] + default='[ ]'
[2021-02-04T08:25:36.446Z] + fetchAndDefault tests-errors.json 'https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED' '[ ]'
[2021-02-04T08:25:36.446Z] + file=tests-errors.json
[2021-02-04T08:25:36.446Z] + url='https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED'
[2021-02-04T08:25:36.446Z] + default='[ ]'
[2021-02-04T08:25:36.446Z] + fetch tests-errors.json 'https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED'
[2021-02-04T08:25:36.446Z] + file=tests-errors.json
[2021-02-04T08:25:36.446Z] + url='https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED'
[2021-02-04T08:25:36.446Z] + echo 'INFO: curl https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED -o tests-errors.json'
[2021-02-04T08:25:36.446Z] INFO: curl https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED -o tests-errors.json
[2021-02-04T08:25:36.446Z] + [[ -n https://apm-ci.elastic.co/ ]]
[2021-02-04T08:25:36.446Z] + [[ -e /usr/local/bin/bash_standard_lib.sh ]]
[2021-02-04T08:25:36.446Z] + retry 3 curlCommand tests-errors.json 'https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED'
[2021-02-04T08:25:36.446Z] + local retries=3
[2021-02-04T08:25:36.446Z] + shift
[2021-02-04T08:25:36.446Z] + local count=0
[2021-02-04T08:25:36.446Z] + curlCommand tests-errors.json 'https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED'
[2021-02-04T08:25:36.446Z] + curl --silent --max-time 600 --connect-timeout 30 -o tests-errors.json 'https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-it-eck/PR-1029/runs/6/tests/?status=FAILED' --fail
[2021-02-04T08:25:36.446Z] + return 0
[2021-02-04T08:25:36.446Z] + '[' '!' -e tests-errors.json ']'
[2021-02-04T08:25:36.446Z] + '[' '!' -s tests-errors.json ']'
[2021-02-04T08:25:36.446Z] + jq -e 'select(.code==404)' tests-errors.json
[2021-02-04T08:25:36.446Z] + normaliseTests tests-errors.json
[2021-02-04T08:25:36.446Z] + file=tests-errors.json
[2021-02-04T08:25:36.446Z] + jqEdit 'map(del(._links))' tests-errors.json
[2021-02-04T08:25:36.446Z] + query='map(del(._links))'
[2021-02-04T08:25:36.446Z] + file=tests-errors.json
[2021-02-04T08:25:36.446Z] ++ mktemp
[2021-02-04T08:25:36.446Z] + tmp=/tmp/tmp.uc7OqXF95f
[2021-02-04T08:25:36.446Z] + jq 'map(del(._links))' tests-errors.json
[2021-02-04T08:25:36.446Z] + mv /tmp/tmp.uc7OqXF95f tests-errors.json
[2021-02-04T08:25:36.446Z] + jqEdit 'map(del(._class))' tests-errors.json
[2021-02-04T08:25:36.446Z] + query='map(del(._class))'
[2021-02-04T08:25:36.446Z] + file=tests-errors.json
[2021-02-04T08:25:36.446Z] ++ mktemp
[2021-02-04T08:25:36.446Z] + tmp=/tmp/tmp.YhaVKhePI4
[2021-02-04T08:25:36.446Z] + jq 'map(del(._class))' tests-errors.json
[2021-02-04T08:25:36.446Z] + mv /tmp/tmp.YhaVKhePI4 tests-errors.json

Contributor Author

kuisathaverat commented Jan 15, 2021

/testAll

kuisathaverat added 6 commits

January 20, 2021 14:30


          fix: move filebeat step to runScript

74292c9


          refactor

04194da


          test: chekc is correct executed

105f6a5


          fix: typo

b3e711d


          test: list containers

39958e0


          fix: do not kill containers in CI

f5540c7

kuisathaverat marked this pull request as ready for review

January 25, 2021 11:53


          Merge branch 'master' into filebeat

246e3cd

Contributor Author

kuisathaverat commented Jan 27, 2021

/test

Contributor Author

kuisathaverat commented Jan 27, 2021

it is green https://apm-ci.elastic.co/blue/organizations/jenkins/apm-integration-test-downstream/detail/PR-1029/81/pipeline/87

Contributor Author

kuisathaverat commented Jan 27, 2021

the CI fails because uses the master branch to test not the PR and there is a change on a script that is no used, this build is launched manually to run the PR https://apm-ci.elastic.co/blue/organizations/jenkins/apm-integration-test-downstream/detail/PR-1029/81/pipeline/87

kuisathaverat requested a review from a team

January 27, 2021 20:00

cachedout suggested changes

View reviewed changes

.ci/integrationTestDownstream.groovy Outdated Show resolved Hide resolved

v1v reviewed

View reviewed changes

.ci/integrationTestEC.groovy Outdated Show resolved Hide resolved

.ci/integrationTestECK.groovy Outdated Show resolved Hide resolved

.ci/integrationTestDownstream.groovy Show resolved Hide resolved

.ci/integrationTestDownstream.groovy Outdated Show resolved Hide resolved

.ci/integrationTestDownstream.groovy Show resolved Hide resolved


          fix: several fixes

9a84b2b

Contributor Author

kuisathaverat commented Feb 1, 2021

Testing all pipelines
https://apm-ci.elastic.co/job/apm-integration-test-downstream/job/PR-1029/86/
https://apm-ci.elastic.co/job/apm-integration-test-downstream/job/PR-1029/87/
https://apm-ci.elastic.co/job/apm-it-ec/view/change-requests/job/PR-1029/1/
https://apm-ci.elastic.co/job/apm-it-eck/view/change-requests/job/PR-1029/1/

cachedout approved these changes

View reviewed changes


          fix: typo

091981e

cachedout approved these changes

View reviewed changes

kuisathaverat added the [zube]: In Review label

mdelapenya approved these changes

View reviewed changes

kuisathaverat merged commit 951e5ab into elastic:master

zube bot added [zube]: Done and removed [zube]: In Review labels

kuisathaverat added a commit to kuisathaverat/apm-integration-testing that referenced this pull request


          test: use filebeat step to grab Docker logs (elastic#1029)

c017b69

* test: use filebeat step to grab Docker logs

* fix: move filebeat step to runScript

* refactor

* test: chekc is correct executed

* fix: typo

* test: list containers

* fix: do not kill containers in CI

* fix: several fixes

* fix: typo
# Conflicts:
#	.ci/integrationTestDownstream.groovy
#	.ci/integrationTestEC.groovy
#	.ci/integrationTestECK.groovy
#	.ci/integrationTestSelector.groovy
#	.ci/scripts/common.sh

kuisathaverat mentioned this pull request

[7.x] test: use filebeat step to grab Docker logs (#1029) #1057

Merged

kuisathaverat added a commit to kuisathaverat/apm-integration-testing that referenced this pull request


          test: use filebeat step to grab Docker logs (elastic#1029)

000176c

* test: use filebeat step to grab Docker logs

* fix: move filebeat step to runScript

* refactor

* test: chekc is correct executed

* fix: typo

* test: list containers

* fix: do not kill containers in CI

* fix: several fixes

* fix: typo
# Conflicts:
#	.ci/integrationTestDownstream.groovy
#	.ci/integrationTestEC.groovy
#	.ci/integrationTestECK.groovy
#	.ci/integrationTestSelector.groovy
#	.ci/scripts/common.sh

kuisathaverat mentioned this pull request

[6.x] test: use filebeat step to grab Docker logs (#1029) #1058

Merged

kuisathaverat removed the [zube]: Done label

v1v added a commit to v1v/apm-integration-testing that referenced this pull request


          Merge remote-tracking branch 'upstream/master' into feature/split-sta…

2d54afa

…rt-from-build

* upstream/master: (24 commits)
  Add mergify (elastic#1089)
  fix: update flake8 and deps to work with Python 3.8+ (elastic#1085)
  chore: bump elastic stack (elastic#1087)
  fix: force to activate venv (elastic#1086)
  fix: --opbeans-node-agent-local-repo=/a/local/dir (elastic#1084)
  ci: jjbb remove periodic-folder-trigger (elastic#1079)
  Fix APM Server managed by Elastic Agent setup (elastic#1078)
  docker/opbeans/go: use -mod=mod (elastic#1077)
  [fleet] fix elastic-agent setup (elastic#1076)
  update supported stack versions (elastic#1075)
  [CI] Increase timeout (elastic#1070)
  Add --package-registry-url flag (elastic#1069)
  Create opbeans_user/role with write/read access for the opbeans-python (elastic#1063)
  reset postgres sequences after database migration (elastic#1062)
  chore: bump Elastic Stack (elastic#1060)
  docker/go/nethttp: go build -mod=mod (elastic#1061)
  check agent liveness via version subcommand (elastic#1059)
  test: use filebeat step to grab Docker logs (elastic#1029)
  Update dotnet sdk 5.0 docker image (elastic#1048)
  docs: using Dyno (elastic#1056)
  ...

kuisathaverat added a commit that referenced this pull request


          test: use filebeat step to grab Docker logs (#1029) (#1058)

8f0f183

* test: use filebeat step to grab Docker logs

* fix: move filebeat step to runScript

* refactor

* test: chekc is correct executed

* fix: typo

* test: list containers

* fix: do not kill containers in CI

* fix: several fixes

* fix: typo
# Conflicts:
#	.ci/integrationTestDownstream.groovy
#	.ci/integrationTestEC.groovy
#	.ci/integrationTestECK.groovy
#	.ci/integrationTestSelector.groovy
#	.ci/scripts/common.sh

kuisathaverat added a commit that referenced this pull request


          [7.x] test: use filebeat step to grab Docker logs (#1029) (#1057)

d3b1adf

* test: use filebeat step to grab Docker logs (#1029)

* test: use filebeat step to grab Docker logs

* fix: move filebeat step to runScript

* refactor

* test: chekc is correct executed

* fix: typo

* test: list containers

* fix: do not kill containers in CI

* fix: several fixes

* fix: typo
# Conflicts:
#	.ci/integrationTestDownstream.groovy
#	.ci/integrationTestEC.groovy
#	.ci/integrationTestECK.groovy
#	.ci/integrationTestSelector.groovy
#	.ci/scripts/common.sh

* Update .ci/integrationTestDownstream.groovy

v1v mentioned this pull request

ci: add debug traces for the docker containers #1477

Merged

v1v mentioned this pull request

ci: store Docker logs and events as Jenkins artifacts if a "Test" stage fails elastic/apm-agent-nodejs#2950

Merged

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

automation Team:Automation test