Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.x] Introduce Go system tests (#3790) #4151

Merged
merged 2 commits into from
Sep 7, 2020
Merged

Conversation

axw
Copy link
Member

@axw axw commented Sep 4, 2020

Backports the following commits to 7.x:

* systemtest: introduce new system testing framework

New system testing framework, written in Go.

The goal here is to simplify the development and
maintenance of apm-server system tests, consolidating
on Go as the language of choice. The framework
provides abstractions for:

 - building and starting apm-server with a specified configuration
 - querying apm-server metrics via /debug/vars
 - parsing and iterating over apm-server logs
 - querying Elasticsearch, with optional return conditions

* tests/system: remove old API Key command tests

* tests/system: remove old logging tests

Closes elastic#3353

* tests/system: remove old Jaeger tests

* tests/system: remove old onboarding test

* tests/system: reinstate invalidate function

* Add TODO about testing OSS build

* Add "extra" args _after_ converting config to JSON

* Add constants for Kibana

And fix env var for KIBANA_PORT

* systemtests: API Key test improvements

- cleanup apm_server_user API Keys
- test validity of API Keys with authenticate requests
@axw axw added the backport label Sep 4, 2020
@apmmachine
Copy link
Contributor

apmmachine commented Sep 4, 2020

💚 Build Succeeded

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #4151 updated]

  • Start Time: 2020-09-07T05:17:37.394+0000

  • Duration: 28 min 14 sec

Test stats 🧪

Test Results
Failed 0
Passed 3031
Skipped 143
Total 3174

Steps errors

Expand to view the steps failures

  • Name: Compress

    • Description: tar --exclude=coverage-files.tgz -czf coverage-files.tgz coverage

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-07T05:32:17.258+0000

    • log

  • Name: Compress

    • Description: tar --exclude=system-tests-linux-files.tgz -czf system-tests-linux-files.tgz system-tests

    • Duration: 0 min 0 sec

    • Start Time: 2020-09-07T05:45:49.676+0000

    • log

  • Name: Test Sync

    • Description: ./script/jenkins/sync.sh

    • Duration: 3 min 42 sec

    • Start Time: 2020-09-07T05:27:12.072+0000

    • log

@axw
Copy link
Member Author

axw commented Sep 7, 2020

Requires #4153

@axw axw merged commit bb311e2 into elastic:7.x Sep 7, 2020
@axw axw deleted the backport/7.x/pr-3790 branch September 7, 2020 06:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants