Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tail] Tail input does not work with built-in multiline + Path_Key #6240

Closed
BinaryFissionGames opened this issue Oct 19, 2022 · 0 comments · Fixed by #6243 or GoogleCloudPlatform/ops-agent#1128

Comments

@BinaryFissionGames
Copy link
Contributor

BinaryFissionGames commented Oct 19, 2022

Bug Report

Describe the bug
When specifying both a multiline config (multiline.parser) and Path_Key in the config, fluent-bit drops all log messages with this message:

[2022/10/19 15:05:47] [debug] [input chunk] skip ingesting data with 0 bytes

To Reproduce
fluent_bit_main.conf:

[INPUT]
    Name              tail
    Key               message
    Path              ./test.log
    Path_Key          path
    Read_from_Head    True
    Tag               json_log
    multiline.parser  multiline_parser

[OUTPUT]
    Match *
    Name stdout

fluent_bit_parser.conf:

[MULTILINE_PARSER]
    flush_timeout 5000
    name          multiline_parser
    type          regex
    rule          "start_state"    "^{.*"    "cont"
    rule          "cont"    "^[^{]"    "cont"

test.log:

{"message": "test_message"}
{"message": "test_message2"}
{
 "message": "multi-line-message"
}

Run with:

/opt/fluent-bit/bin/fluent-bit --config fluent_bit_main.conf --parser fluent_bit_parser.conf --verbose

Expected behavior
Three log mesages are output to stdout; Currently, none are put out, and

[2022/10/19 15:05:47] [debug] [input chunk] skip ingesting data with 0 bytes

is put into stdout.

If I remove either the multiline or Path_Key config options, log messages are spit out in the manner expected (e.g. no multiline, or no Path_Key).

Your Environment

  • Version used: 1.9.9 (installed through package manager)
  • Operating System and version: Debian 11 (bullseye)

Related issues:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant