Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cherry-pick #19604 to 7.x: [Filebeat] [tests] Keep host.name in forwarded events #19679

Merged
merged 1 commit into from
Jul 14, 2020

Conversation

adriansr
Copy link
Contributor

@adriansr adriansr commented Jul 6, 2020

Cherry-pick of PR #19604 to 7.x branch. Original message:

What does this PR do?

Updates Filebeat's test_modules.py integration test to not strip the host.name field in events tagged as forwarded.

Why is it important?

So the -expected.json golden files keep the host.name field and errors in modules that populate this field can be detected.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • [ ] I have made corresponding changes to the documentation
  • [ ] I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • [ ] I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Relates #13920

Update Filebeat's test_modules.py integration test to not strip the
`host.name` field in events marked as forwarded.

Relates elastic#13920

(cherry picked from commit 156c87b)
@elasticmachine
Copy link
Collaborator

Pinging @elastic/siem (Team:SIEM)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jul 6, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Jul 6, 2020

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

Pipeline View Test View Changes Artifacts

Expand to view the summary

Build stats

  • Build Cause: [Branch indexing]

  • Start Time: 2020-07-13T09:43:45.385+0000

  • Duration: 123 min 57 sec

Test stats 🧪

Test Results
Failed 0
Passed 2400
Skipped 414
Total 2814

Steps errors

Expand to view the steps failures

  • Name: Notifies GitHub of the status of a Pull Request

Log output

Expand to view the last 100 lines of log output

[2020-07-13T11:45:53.391Z] 	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2705)
[2020-07-13T11:45:53.391Z] 	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2686)
[2020-07-13T11:45:53.391Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3073)
[2020-07-13T11:45:53.391Z] Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from beats-ci-immutable-ubuntu-1604-1594634813829011405.c.elastic-ci-prod.internal/10.224.2.197:49630
[2020-07-13T11:45:53.391Z] 		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1788)
[2020-07-13T11:45:53.391Z] 		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356)
[2020-07-13T11:45:53.391Z] 		at hudson.remoting.Channel.call(Channel.java:998)
[2020-07-13T11:45:53.391Z] 		at hudson.FilePath.act(FilePath.java:1069)
[2020-07-13T11:45:53.391Z] 		at hudson.FilePath.act(FilePath.java:1058)
[2020-07-13T11:45:53.392Z] 		at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-07-13T11:45:53.392Z] 		at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-07-13T11:45:53.392Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-07-13T11:45:53.392Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-07-13T11:45:53.392Z] 		at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-07-13T11:45:53.392Z] 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-07-13T11:45:53.392Z] 		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-07-13T11:45:53.392Z] 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-07-13T11:45:53.392Z] 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-07-13T11:45:53.392Z] Caused: hudson.FilePath$TunneledInterruptedException
[2020-07-13T11:45:53.392Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3075)
[2020-07-13T11:45:53.392Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
[2020-07-13T11:45:53.392Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
[2020-07-13T11:45:53.392Z] 	at hudson.remoting.Request$2.run(Request.java:369)
[2020-07-13T11:45:53.392Z] 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-07-13T11:45:53.392Z] 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
[2020-07-13T11:45:53.392Z] Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
[2020-07-13T11:45:53.392Z] 	at hudson.FilePath.act(FilePath.java:1071)
[2020-07-13T11:45:53.392Z] 	at hudson.FilePath.act(FilePath.java:1058)
[2020-07-13T11:45:53.392Z] 	at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-07-13T11:45:53.392Z] 	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-07-13T11:45:53.392Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-07-13T11:45:53.392Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-07-13T11:45:53.392Z] 	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-07-13T11:45:53.392Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-07-13T11:45:53.392Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-07-13T11:45:53.392Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-07-13T11:45:55.917Z] + curl -sSLo codecov https://codecov.io/bash
[2020-07-13T11:45:56.181Z] + FILE=auditbeat/build/coverage/full.cov
[2020-07-13T11:45:56.181Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=filebeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=heartbeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=libbeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=metricbeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=packetbeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.182Z] + FILE=journalbeat/build/coverage/full.cov
[2020-07-13T11:45:56.182Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.312Z] + curl -sSLo codecov https://codecov.io/bash
[2020-07-13T11:45:56.576Z] + FILE=auditbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=filebeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=heartbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=libbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=metricbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=packetbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-07-13T11:45:56.577Z] + FILE=journalbeat/build/coverage/full.cov
[2020-07-13T11:45:56.577Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-07-13T11:46:01.219Z] Failed in branch Filebeat oss
[2020-07-13T11:46:02.465Z] Failed in branch Filebeat x-pack
[2020-07-13T11:46:16.251Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-19679/src/github.com/elastic/beats
[2020-07-13T11:46:16.818Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-07-13T11:46:16.922Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-19679/src/github.com/elastic/beats/Lint
[2020-07-13T11:46:17.898Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-19679/src/github.com/elastic/beats/Filebeat-Windows
[2020-07-13T11:46:19.208Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-19679/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-07-13T11:46:20.410Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-19679/src/github.com/elastic/beats/Filebeat-oss
[2020-07-13T11:46:21.684Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-19679/src/github.com/elastic/beats/Filebeat-x-pack
[2020-07-13T11:46:22.831Z] + cat
[2020-07-13T11:46:22.833Z] + /usr/local/bin/runbld ./runbld-script
[2020-07-13T11:46:22.833Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-07-13T11:46:29.920Z] runbld>>> runbld started
[2020-07-13T11:46:29.920Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-07-13T11:46:30.180Z] Body did not finish within grace period; terminating with extreme prejudice
[2020-07-13T11:46:30.612Z] ERROR: runbld post build action failed.
[2020-07-13T11:46:30.613Z] Timeout has been exceeded
[2020-07-13T11:46:32.580Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-19679
[2020-07-13T11:46:34.076Z] [INFO] getVaultSecret: Getting secrets
[2020-07-13T11:46:35.012Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-07-13T11:46:42.266Z] + chmod 755 generate-build-data.sh
[2020-07-13T11:46:42.267Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-19679/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-19679/runs/1 ABORTED 7376535
[2020-07-13T11:46:42.267Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-19679/runs/1/steps/?limit=10000 -o steps-info.json
[2020-07-13T11:46:48.998Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-19679/runs/1/tests/?status=FAILED -o tests-errors.json

@adriansr adriansr merged commit eeda621 into elastic:7.x Jul 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants