Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove noisy debug log in nest filter #4005

Closed
hossain-rayhan opened this issue Aug 25, 2021 · 0 comments · Fixed by #4055
Closed

Remove noisy debug log in nest filter #4005

hossain-rayhan opened this issue Aug 25, 2021 · 0 comments · Fixed by #4055

Comments

@hossain-rayhan
Copy link
Contributor

Debug Issue

Describe the Issue
While setting FLB_LOG_LEVEL to debug, it prints thousands of noisy debug logs from the nest filter. It gets really tough to find the actual debug message which customer is looking for.

** Possible Fix**
Remove this 3 lines: https://github.com/fluent/fluent-bit/blob/master/plugins/filter_nest/nest.c#L499-L501

To Reproduce
Run any fluent-bit image setting the FLB_LOG_LEVEL to debug and use the tail input plugin.

Expected behavior
Less but informative log.

Your Environment

  • Version used: fluent/fluent-bit:1.8.3-debug
  • Operating System and version: Amazon Linux 2
  • Filters and plugins: tail, kinesis_firehose

Additional context
Take a look on my debug log to undersand how noisy they are.

[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [input:tail:tail.0] inode=13594988 events: IN_MODIFY 
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
[2021/08/25 22:25:14] [debug] [filter:nest:nest.0] outer map size is 1, will be 1, nested map size will be 1
nokute78 added a commit to nokute78/fluent-bit that referenced this issue Sep 4, 2021
edsiper pushed a commit that referenced this issue Sep 7, 2021
edsiper pushed a commit that referenced this issue Sep 7, 2021
pwhelan pushed a commit to pwhelan/fluent-bit that referenced this issue Sep 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant