Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Git Master branch] Bug in forward input #4670

Closed
PettitWesley opened this issue Jan 23, 2022 · 2 comments · Fixed by #4672
Closed

[Git Master branch] Bug in forward input #4670

PettitWesley opened this issue Jan 23, 2022 · 2 comments · Fixed by #4672
Assignees
@nokute78

Comments

@PettitWesley
Copy link
Contributor

Bug Report

I have tested on current git master that the forward input does not work as expected and has weird behavior with the fluentd docker log driver. Logs from the same container get their tag messed up and are ingested under multiple tags.

Config:

[INPUT]
     Name forward
     Listen 0.0.0.0
     Port 24224
     Tag *

[FILTER]
     Name    modify
     Match   *
     Remove_wildcard container_name
     Remove_wildcard source
     Remove_wildcard container_id

[OUTPUT]
     name                  stdout
     match                 *
     json_date_key         false

Run a container with fluentd log driver:

docker run -d --log-driver fluentd app

Debug output:

Fluent Bit v1.9.0
* Copyright (C) 2019-2021 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2022/01/23 05:05:25] [ info] Configuration:
[2022/01/23 05:05:25] [ info]  flush time     | 15.000000 seconds
[2022/01/23 05:05:25] [ info]  grace          | 1 seconds
[2022/01/23 05:05:25] [ info]  daemon         | 0
[2022/01/23 05:05:25] [ info] ___________
[2022/01/23 05:05:25] [ info]  inputs:
[2022/01/23 05:05:25] [ info]      forward
[2022/01/23 05:05:25] [ info] ___________
[2022/01/23 05:05:25] [ info]  filters:
[2022/01/23 05:05:25] [ info]      modify.0
[2022/01/23 05:05:25] [ info] ___________
[2022/01/23 05:05:25] [ info]  outputs:
[2022/01/23 05:05:25] [ info]      stdout.0
[2022/01/23 05:05:25] [ info] ___________
[2022/01/23 05:05:25] [ info]  collectors:
[2022/01/23 05:05:25] [ info] [engine] started (pid=1407)
[2022/01/23 05:05:25] [debug] [engine] coroutine stack size: 24576 bytes (24.0K)
[2022/01/23 05:05:25] [debug] [storage] [cio stream] new stream registered: forward.0
[2022/01/23 05:05:25] [ info] [storage] version=1.1.5, initializing...
[2022/01/23 05:05:25] [ info] [storage] in-memory
[2022/01/23 05:05:25] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
[2022/01/23 05:05:25] [ info] [cmetrics] version=0.2.2
[2022/01/23 05:05:25] [debug] [in_fw] Listen='0.0.0.0' TCP_Port=24224
[2022/01/23 05:05:25] [ info] [input:forward:forward.0] listening on 0.0.0.0:24224
[2022/01/23 05:05:25] [debug] [filter:modify:modify.0] Initialized modify filter with 0 conditions and 3 rules
[2022/01/23 05:05:25] [debug] [stdout:stdout.0] created event channels: read=20 write=21
[2022/01/23 05:05:25] [debug] [router] match rule forward.0:stdout.0
[2022/01/23 05:05:25] [ info] [sp] stream processor started
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=26
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=119
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=79
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=83
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=83
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=80
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=73
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=27
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=27
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=12
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=34
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=37
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=104
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=41
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=73
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=28
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=106
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=32
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=28
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=12
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=39
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=85
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=103
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=86
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=102
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=72
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=103
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=49
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=102
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=23
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=73
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=26
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=103
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=28
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=106
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=12
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=42
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=73
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=103
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=77
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=102
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=35
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=102
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=28
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=106
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=37
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=58
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=12
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=40
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=77
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=103
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=69
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=102
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=41
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=105
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=28
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=106
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=39
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=57
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=39
[2022/01/23 05:05:29] [debug] [input chunk] update output instances with new chunk size diff=14
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094009870 id=0 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094009950 id=1 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094009a00 id=2 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094009ab0 id=3 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094009b80 id=4 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094014650 id=5 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094014790 id=6 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f00940148d0 id=7 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f00940149a0 id=8 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094014a70 id=9 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094014b40 id=10 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f0094014cb0 id=11 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a0f0 id=12 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a1a0 id=13 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a270 id=14 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a410 id=15 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a4e0 id=16 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a5b0 id=17 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a680 id=18 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400a850 id=19 OK
[0] c1eedfd77a01: [1642914329.000000000, {"log"=>"single line..."}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400c9c0 id=20 OK
[1] c1eedfd77a01: [1642914329.000000000, {"log"=>"Dec 14 06:41:08 Exception in thread "main" java.lang.RuntimeException: Something has gone wrong, aborting!"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400ca60 id=21 OK
[2] c1eedfd77a01: [1642914329.000000000, {"log"=>"panic(0x45cb40, 0x47ad70)"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400cb30 id=22 OK
[3] c1eedfd77a01: [1642914329.000000000, {"log"=>"  foo.go:9 +0x6f fp=0xc420053f80 sp=0xc420053f50 pc=0x4512ef"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400cd30 id=23 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400ce00 id=24 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400ced0 id=25 OK
[0] c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"    at com.myproject.module.MyProject.badMethod(MyProject.java:22)"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400cfa0 id=26 OK
[1] c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/panic.go:542 +0x46c fp=0xc42003f7b8 sp=0xc42003f710 pc=0x422f7c"}]
[2] c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.main()"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400d1d0 id=27 OK
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400d2a0 id=28 OK
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"    at com.myproject.module.MyProject.oneMoreMethod(MyProject.java:18)"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400d370 id=29 OK
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"main.main.func1(0xc420024120)"}]
[2022/01/23 05:05:40] [debug] [task] created task=0x7f009400d5d0 id=30 OK
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:185 +0x20d fp=0xc420053fe0 sp=0xc420053f80 pc=0x424bad"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"    at com.myproject.module.MyProject.anotherMethod(MyProject.java:14)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  foo.go:6 +0x39 fp=0xc42003f7d8 sp=0xc42003f7b8 pc=0x451339"}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goexit()"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"    at com.myproject.module.MyProject.someMethod(MyProject.java:10)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goexit()"}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc420053fe8 sp=0xc420053fe0 pc=0x44b4d1"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"    at com.myproject.module.MyProject.main(MyProject.java:6)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc42003f7e0 sp=0xc42003f7d8 pc=0x44b4d1"}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>""}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"another line..."}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"created by main.main"}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"goroutine 2 [force gc (idle)]:"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"panic: my panic"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  foo.go:5 +0x58"}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.gopark(0x4739b8, 0x4ad720, 0x47001e, 0xf, 0x14, 0x1)"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>""}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>""}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:280 +0x12c fp=0xc42003e768 sp=0xc42003e738 pc=0x42503c"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"goroutine 4 [running]:"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"goroutine 1 [chan receive]:"}]
[2] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goparkunlock(0x4ad720, 0x47001e, 0xf, 0xc420000114, 0x1)"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.gopark(0x4739b8, 0xc420024178, 0x46fcd7, 0xc, 0xc420028e17, 0x3)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:286 +0x5e fp=0xc42003e7a8 sp=0xc42003e768 pc=0x42512e"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:280 +0x12c fp=0xc420053e30 sp=0xc420053e00 pc=0x42503c"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.forcegchelper()"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goparkunlock(0xc420024178, 0x46fcd7, 0xc, 0x1000f010040c217, 0x3)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:238 +0xcc fp=0xc42003e7e0 sp=0xc42003e7a8 pc=0x424e5c"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:286 +0x5e fp=0xc420053e70 sp=0xc420053e30 pc=0x42512e"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goexit()"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.chanrecv(0xc420024120, 0x0, 0xc420053f01, 0x4512d8)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc42003e7e8 sp=0xc42003e7e0 pc=0x44b4d1"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/chan.go:506 +0x304 fp=0xc420053f20 sp=0xc420053e70 pc=0x4046b4"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"created by runtime.init.4"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.chanrecv1(0xc420024120, 0x0)"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:227 +0x35"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/chan.go:388 +0x2b fp=0xc420053f50 sp=0xc420053f20 pc=0x40439b"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>""}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"main.main()"}]
[1] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"goroutine 3 [GC sweep wait]:"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.gopark(0x4739b8, 0x4ad7e0, 0x46fdd2, 0xd, 0x419914, 0x1)"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:280 +0x12c fp=0xc42003ef60 sp=0xc42003ef30 pc=0x42503c"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goparkunlock(0x4ad7e0, 0x46fdd2, 0xd, 0x14, 0x1)"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/proc.go:286 +0x5e fp=0xc42003efa0 sp=0xc42003ef60 pc=0x42512e"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.bgsweep(0xc42001e150)"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/mgcsweep.go:52 +0xa3 fp=0xc42003efd8 sp=0xc42003efa0 pc=0x419973"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"runtime.goexit()"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc42003efe0 sp=0xc42003efd8 pc=0x44b4d1"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"created by runtime.gcenable"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"  /usr/local/go/src/runtime/mgc.go:216 +0x58"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"one more line, no multiline"}]
[0] c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01c1eedfd77a01: [1642914329.000000000, {"log"=>"60"}]
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=0
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=1
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=2
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=3
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=4
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=5
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=6
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=7
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=8
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=9
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=10
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=11
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=12
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=13
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=14
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=15
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=16
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=17
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=18
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=19
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=20
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=21
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=22
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=23
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=24
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=25
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=26
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=27
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=28
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=29
[2022/01/23 05:05:40] [debug] [out flush] cb_destroy coro_id=30
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094009870 (task_id=0)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094009950 (task_id=1)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094009a00 (task_id=2)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094009ab0 (task_id=3)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094009b80 (task_id=4)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094014650 (task_id=5)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094014790 (task_id=6)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f00940148d0 (task_id=7)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f00940149a0 (task_id=8)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094014a70 (task_id=9)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094014b40 (task_id=10)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f0094014cb0 (task_id=11)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a0f0 (task_id=12)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a1a0 (task_id=13)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a270 (task_id=14)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a410 (task_id=15)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a4e0 (task_id=16)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a5b0 (task_id=17)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a680 (task_id=18)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400a850 (task_id=19)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400c9c0 (task_id=20)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400ca60 (task_id=21)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400cb30 (task_id=22)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400cd30 (task_id=23)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400ce00 (task_id=24)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400ced0 (task_id=25)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400cfa0 (task_id=26)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400d1d0 (task_id=27)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400d2a0 (task_id=28)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400d370 (task_id=29)
[2022/01/23 05:05:40] [debug] [task] destroy task=0x7f009400d5d0 (task_id=30)
^C[2022/01/23 05:06:18] [engine] caught signal (SIGINT)

As you can see, the tag is messed up.
This was referenced Jan 23, 2022
Merged
Merged
@nokute78
Copy link
Collaborator

I think out_tag should be clear after using at fw_prot_process.

nokute78 added a commit to nokute78/fluent-bit that referenced this issue Jan 23, 2022
@nokute78
in_forward: clear out_tag before using(fluent#4670)
6f6d242 
Signed-off-by: Takahiro Yamashita <[email protected]>
@nokute78 nokute78 mentioned this issue Jan 23, 2022
Merged
4 tasks
@nokute78
Copy link
Collaborator

I sent a patch #4672

edsiper pushed a commit that referenced this issue Jan 24, 2022
@nokute78 @edsiper
in_forward: clear out_tag before using(#4670)
db194f7 
Signed-off-by: Takahiro Yamashita <[email protected]>
edsiper pushed a commit that referenced this issue Jan 24, 2022
@nokute78 @edsiper
in_forward: clear out_tag before using(#4670)
b0cf448 
Signed-off-by: Takahiro Yamashita <[email protected]>
edsiper pushed a commit that referenced this issue Jan 24, 2022
@nokute78 @edsiper
in_forward: clear out_tag before using(#4670)
6795b5f 
Signed-off-by: Takahiro Yamashita <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nokute78 nokute78

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

in_forward: clear out_tag before using(#4670) nokute78/fluent-bit
3 participants
@lecaros @nokute78 @PettitWesley