Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Grok pattern of MongoDB module #7568

Merged

Conversation

kvch
Copy link
Contributor

@kvch kvch commented Jul 11, 2018

Previously, the following log line produced an error, because the number of spaces after the component name were limited to two in the pattern.

2018-02-05T13:44:56.724+0100 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/diagnostic.data'

In case of this line the parsing failed, because after "FTDC" there are more than two space due to padding. From now on arbitrary number of spaces are allowed, so padding won't cause any problem.

Ohter minor changes regarding testing:

  • add the missing example logs to mongodb/log
  • follow up changes in the expected data

@@ -100,6 +100,7 @@ https://github.com/elastic/beats/compare/v6.2.3...master[Check the HEAD diff]
- Optimize PostgreSQL ingest pipeline to use anchored regexp and merge multiple regexp into a single expression. {pull}7269[7269]
- Fix offset field pointing at end of a line. {issue}6514[6514]
- Fix an issue when parsing ISO8601 dates with timezone definition {issue}7367[7367]
- Fix MongoDB Filebeat module. {pull}7568[7568]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you be more specific on what was fixed? It seems it worked for most of the log lines and only didn't match a few.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kvch Can you update this part here?

Copy link
Contributor

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CHANGE LGTM. Minor comment for the changelog

@ruflin
Copy link
Contributor

ruflin commented Jul 12, 2018

Can you rebase on master? That should fix the header issue.

@kvch kvch force-pushed the fix/filebeat/add-missing-mongodb-module-logs branch from 8c94c4c to 2bd88c6 Compare July 13, 2018 08:41
Copy link
Member

@andrewkroh andrewkroh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@andrewkroh andrewkroh merged commit 86a25e4 into elastic:master Jul 13, 2018
@kvch kvch changed the title Fix MongoDB Filebeat module Fix Grok pattern of MongoDB module Jul 13, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants