Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changing field type to keyword #17978

Merged
merged 3 commits into from
Apr 29, 2020
Merged

Changing field type to keyword #17978

merged 3 commits into from
Apr 29, 2020

Conversation

SHolzhauer
Copy link
Contributor

@SHolzhauer SHolzhauer commented Apr 24, 2020

  • Enhancement

What does this PR do?

Modify the field type from filebeat/nginx module fields from text to keyword as requested in #17834

Why is it important?

See Issue #17834

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Related issues

Note

First PR ever, go easy on me ;)

@elasticmachine
Copy link
Collaborator

Since this is a community submitted pull request, a Jenkins build has not been kicked off automatically. Can an Elastic organization member please verify the contents of this patch and then kick off a build manually?

1 similar comment
@elasticmachine
Copy link
Collaborator

Since this is a community submitted pull request, a Jenkins build has not been kicked off automatically. Can an Elastic organization member please verify the contents of this patch and then kick off a build manually?

@kaiyan-sheng kaiyan-sheng added needs_backport PR is waiting to be backported to other branches. Team:Platforms Label for the Integrations - Platforms team labels Apr 24, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@kaiyan-sheng
Copy link
Contributor

Thanks for contributing! Change looks good to me. Could you add a changelog entry under Filebeat bug fixes please? Thanks!!

@SHolzhauer
Copy link
Contributor Author

@kaiyan-sheng Sure, but is this really a bugfix? As it "improves" but doesn't actually fix an issue right?

@kaiyan-sheng
Copy link
Contributor

Good point! @exekias WDYT about the changelog?

@kaiyan-sheng
Copy link
Contributor

jenkins, test this please

@SHolzhauer
Copy link
Contributor Author

Good point! @exekias WDYT about the changelog?

For now I added it under bug-fixes, let me know if it requires changing.

@exekias
Copy link
Contributor

exekias commented Apr 27, 2020

Having it under bugfix sounds good to me! Thank you for contributing!

@elasticmachine
Copy link
Collaborator

elasticmachine commented Apr 28, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview stats

Expand to view the summary

Build stats

  • Build Cause: [Started by user kaiyan-sheng, Replayed Random Crashes #6]

  • Start Time: 2020-04-29T02:02:52.317+0000

  • Duration: 52 min 25 sec (3144658)

  • Commit: af4858b

Test stats 🧪

Test Results
Failed 5
Passed 2762
Skipped 405
Total 3172

Test errors

Expand to view the tests failures

  • Name: Build and Test / Filebeat Mac OS X / test_symlink_rotated – test_harvester.Test

    • Status: FAILED
    • Age: 1
    • Duration: 1.909
    • Error Details: expected to see 2 entries, got '[{'source': '/private/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17978/src/github.com/elastic/beats/filebeat/build/system-tests/run/test_harvester.Test.test_symlink_rotated/log/symlink.log', 'offset': 13, 'timestamp': '2020-04-28T19:41:47.305465-07:00', 'ttl': -1, 'type': 'log', 'meta': None, 'FileStateOS': {'inode': 772516087, 'device': 16777217}}]'
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file_with_restart – test_registrar.Test

    • Status: FAILED
    • Age: 1
    • Duration: 6.144
    • Error Details: 'NoneType' object is not subscriptable
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_6_3_0 – test_registrar_upgrade.Test

    • Status: FAILED
    • Age: 1
    • Duration: 1.867
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_6_3_1 – test_registrar_upgrade.Test

    • Status: FAILED
    • Age: 1
    • Duration: 1.893
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_single_file_to_folder_hierarchy – test_registrar_upgrade.Test

    • Status: FAILED
    • Age: 1
    • Duration: 1.906
    • Error Details:

Steps errors

Expand to view the steps failures

  • Name: Mage build unitTest
    • Description: mage build unitTest

    • Result: FAILURE

    • Duration: 17 min 42 sec<

    • Start Time: 2020-04-29T02:30:37.153+0000

Log output

Expand to view the last 100 lines of log output

[2020-04-29T02:55:02.314Z] Recording test results
[2020-04-29T02:55:05.050Z] Archiving artifacts
[2020-04-29T02:55:05.532Z] java.lang.InterruptedException: no matches found within 10000
[2020-04-29T02:55:05.532Z] 	at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2826)
[2020-04-29T02:55:05.532Z] 	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2705)
[2020-04-29T02:55:05.532Z] 	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2686)
[2020-04-29T02:55:05.532Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3073)
[2020-04-29T02:55:05.532Z] Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from beats-ci-immutable-ubuntu-1604-1588127050909443490.c.elastic-ci-prod.internal/10.224.0.171:51984
[2020-04-29T02:55:05.532Z] 		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1788)
[2020-04-29T02:55:05.532Z] 		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356)
[2020-04-29T02:55:05.532Z] 		at hudson.remoting.Channel.call(Channel.java:998)
[2020-04-29T02:55:05.532Z] 		at hudson.FilePath.act(FilePath.java:1069)
[2020-04-29T02:55:05.532Z] 		at hudson.FilePath.act(FilePath.java:1058)
[2020-04-29T02:55:05.532Z] 		at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-04-29T02:55:05.532Z] 		at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-04-29T02:55:05.532Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-04-29T02:55:05.532Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-04-29T02:55:05.532Z] 		at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-04-29T02:55:05.532Z] 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-04-29T02:55:05.532Z] 		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-04-29T02:55:05.532Z] 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-04-29T02:55:05.532Z] 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-04-29T02:55:05.532Z] Caused: hudson.FilePath$TunneledInterruptedException
[2020-04-29T02:55:05.532Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3075)
[2020-04-29T02:55:05.532Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
[2020-04-29T02:55:05.533Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
[2020-04-29T02:55:05.533Z] 	at hudson.remoting.Request$2.run(Request.java:369)
[2020-04-29T02:55:05.533Z] 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-04-29T02:55:05.533Z] 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
[2020-04-29T02:55:05.533Z] Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
[2020-04-29T02:55:05.533Z] 	at hudson.FilePath.act(FilePath.java:1071)
[2020-04-29T02:55:05.533Z] 	at hudson.FilePath.act(FilePath.java:1058)
[2020-04-29T02:55:05.533Z] 	at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-04-29T02:55:05.533Z] 	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-04-29T02:55:05.533Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-04-29T02:55:05.533Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-04-29T02:55:05.533Z] 	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-04-29T02:55:05.533Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-04-29T02:55:05.533Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-04-29T02:55:05.533Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-04-29T02:55:05.888Z] + curl -sSLo codecov https://codecov.io/bash
[2020-04-29T02:55:06.149Z] + FILE=auditbeat/build/coverage/full.cov
[2020-04-29T02:55:06.149Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-04-29T02:55:06.149Z] + FILE=filebeat/build/coverage/full.cov
[2020-04-29T02:55:06.149Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-04-29T02:55:06.149Z] + bash codecov -f filebeat/build/coverage/full.cov
[2020-04-29T02:55:06.149Z] 
[2020-04-29T02:55:06.149Z]   _____          _
[2020-04-29T02:55:06.149Z]  / ____|        | |
[2020-04-29T02:55:06.149Z] | |     ___   __| | ___  ___ _____   __
[2020-04-29T02:55:06.149Z] | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
[2020-04-29T02:55:06.149Z] | |___| (_) | (_| |  __/ (_| (_) \ V /
[2020-04-29T02:55:06.149Z]  \_____\___/ \__,_|\___|\___\___/ \_/
[2020-04-29T02:55:06.149Z]                               Bash-tbd
[2020-04-29T02:55:06.149Z] 
[2020-04-29T02:55:06.149Z] 
[2020-04-29T02:55:06.149Z] ==> Jenkins CI detected.
[2020-04-29T02:55:06.149Z]     project root: .
[2020-04-29T02:55:06.149Z]     Fixing merge commit SHA
[2020-04-29T02:55:06.149Z]     Yaml found at: codecov.yml
[2020-04-29T02:55:06.149Z]     -> Found 1 reports
[2020-04-29T02:55:06.149Z] ==> Detecting git/mercurial file structure
[2020-04-29T02:55:06.410Z] ==> Reading reports
[2020-04-29T02:55:06.410Z]     + filebeat/build/coverage/full.cov bytes=259428
[2020-04-29T02:55:06.410Z] ==> Appending adjustments
[2020-04-29T02:55:06.411Z]     http://docs.codecov.io/docs/fixing-reports
[2020-04-29T02:55:14.558Z]     + Found adjustments
[2020-04-29T02:55:14.558Z] ==> Gzipping contents
[2020-04-29T02:55:14.558Z] ==> Uploading reports
[2020-04-29T02:55:14.558Z]     url: https://codecov.io
[2020-04-29T02:55:14.558Z]     query: branch=PR-17978&commit=7d16a0f6db1c5847adcca44b4299601960fb86ed&build=7&build_url=https%3A%2F%2Fbeats-ci.elastic.co%2Fjob%2FBeats%2Fjob%2Fbeats-beats-mbp%2Fjob%2FPR-17978%2F7%2F&name=&tag=&slug=elastic%2Fbeats&service=jenkins&flags=&pr=17978&job=
[2020-04-29T02:55:14.558Z]     -> Pinging Codecov
[2020-04-29T02:55:14.558Z] https://codecov.io/upload/v4?package=bash-tbd&token=secret&branch=PR-17978&commit=7d16a0f6db1c5847adcca44b4299601960fb86ed&build=7&build_url=https%3A%2F%2Fbeats-ci.elastic.co%2Fjob%2FBeats%2Fjob%2Fbeats-beats-mbp%2Fjob%2FPR-17978%2F7%2F&name=&tag=&slug=elastic%2Fbeats&service=jenkins&flags=&pr=17978&job=
[2020-04-29T02:55:14.558Z] HTTP 400
[2020-04-29T02:55:14.558Z] Please provide the repository token to upload reports via `-t :repository-token`
[2020-04-29T02:55:14.558Z] + FILE=heartbeat/build/coverage/full.cov
[2020-04-29T02:55:14.558Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-04-29T02:55:14.558Z] + FILE=libbeat/build/coverage/full.cov
[2020-04-29T02:55:14.558Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-04-29T02:55:14.558Z] + FILE=metricbeat/build/coverage/full.cov
[2020-04-29T02:55:14.558Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-04-29T02:55:14.558Z] + FILE=packetbeat/build/coverage/full.cov
[2020-04-29T02:55:14.558Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-04-29T02:55:14.558Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-04-29T02:55:14.558Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-04-29T02:55:14.558Z] + FILE=journalbeat/build/coverage/full.cov
[2020-04-29T02:55:14.558Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-04-29T02:55:16.324Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17978
[2020-04-29T02:55:16.429Z] [INFO] getVaultSecret: Getting secrets
[2020-04-29T02:55:16.478Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-04-29T02:55:17.237Z] + chmod 755 generate-build-data.sh
[2020-04-29T02:55:17.238Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17978/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17978/runs/7 FAILURE 3144658
[2020-04-29T02:55:17.788Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17978/runs/7/steps/?limit=10000 -o steps-info.json
[2020-04-29T02:55:17.788Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-17978/runs/7/tests/?status=FAILED -o tests-errors.json

@kaiyan-sheng
Copy link
Contributor

jenkins, test this please

@kaiyan-sheng kaiyan-sheng merged commit 5cd6b52 into elastic:master Apr 29, 2020
@kaiyan-sheng kaiyan-sheng added v7.8.0 and removed needs_backport PR is waiting to be backported to other branches. labels Apr 29, 2020
@sejbot
Copy link

sejbot commented Apr 30, 2020

Thanks for fixing this! 👍
Since ingress_controller fileset is new in version 7.7 it might not need a changelog entry this is released in 7.7.

kaiyan-sheng added a commit that referenced this pull request Apr 30, 2020
* Changing field type to keyword (#17978)

* Changing field type to keyword
* Adding changelog

(cherry picked from commit 5cd6b52)

* update changelog

Co-authored-by: Stijn Holzhauer <[email protected]>
kaiyan-sheng added a commit that referenced this pull request Apr 30, 2020
* Changing field type to keyword (#17978)

* Changing field type to keyword
* Adding changelog

(cherry picked from commit 5cd6b52)

* update changelog

Co-authored-by: Stijn Holzhauer <[email protected]>
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
…stic#18093)

* Changing field type to keyword (elastic#17978)

* Changing field type to keyword
* Adding changelog

(cherry picked from commit 179c1ce)

* update changelog

Co-authored-by: Stijn Holzhauer <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Platforms Label for the Integrations - Platforms team v7.7.0 v7.8.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Change ingress_controller fields mapping from text to keyword
6 participants