Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lsfeventsbeat crashes #4

Open
ttran1361 opened this issue Jan 10, 2020 · 1 comment
Open

lsfeventsbeat crashes #4

ttran1361 opened this issue Jan 10, 2020 · 1 comment

Comments

@ttran1361
Copy link

Ran "./lsfeventsbeat -c lsfeventsbeat.yml" and it crashed every time with below error message

fatal error: concurrent map read and map write

goroutine 31 [running]:
runtime.throw(0x173c85a, 0x21)
/local/mnt/workspace/tntran/go/src/runtime/panic.go:774 +0x72 fp=0xc000267cf8 sp=0xc000267cc8 pc=0xa3b5d2
runtime.mapaccess2_faststr(0x1692dc0, 0xc00048d860, 0x1723e41, 0x9, 0x18, 0x0)
/local/mnt/workspace/tntran/go/src/runtime/map_faststr.go:116 +0x48f fp=0xc000267d68 sp=0xc000267cf8 pc=0xa1f2cf
github.com/elastic/beats/libbeat/outputs/kafka.(*client).getEventMessage(0xc0001bc600, 0xc0006aff00, 0xc000267e90, 0xc000132260, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/outputs/kafka/client.go:153 +0x599 fp=0xc000267e20 sp=0xc000267d68 pc=0x1028ec9
github.com/elastic/beats/libbeat/outputs/kafka.(*client).Publish(0xc0001bc600, 0x18b34a0, 0xc000058340, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/outputs/kafka/client.go:129 +0x166 fp=0xc000267f30 sp=0xc000267e20 pc=0x1028586
github.com/elastic/beats/libbeat/publisher/pipeline.(*netClientWorker).run(0xc00013ed00)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:119 +0x310 fp=0xc000267fd8 sp=0xc000267f30 pc=0xf8ba80
runtime.goexit()
/local/mnt/workspace/tntran/go/src/runtime/asm_amd64.s:1357 +0x1 fp=0xc000267fe0 sp=0xc000267fd8 pc=0xa6bb51
created by github.com/elastic/beats/libbeat/publisher/pipeline.makeClientWorker
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:48 +0xe0

goroutine 1 [chan receive]:
github.com/elastic/beats/filebeat/beater.(*signalWait).Wait(...)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/beater/signalwait.go:45
github.com/elastic/beats/filebeat/beater.(*Filebeat).Run(0xc00012b5c0, 0xc00000c5a0, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/beater/filebeat.go:406 +0xc71
github.com/elastic/beats/libbeat/cmd/instance.(*Beat).launch(0xc00000c5a0, 0x1777158, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:373 +0x41a
github.com/elastic/beats/libbeat/cmd/instance.Run.func1(0x172292d, 0x8, 0x172292d, 0x8, 0x0, 0x0, 0x1777158, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:188 +0x613
github.com/elastic/beats/libbeat/cmd/instance.Run(0x172292d, 0x8, 0x172292d, 0x8, 0x0, 0x0, 0x1777158, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:189 +0x71
github.com/elastic/beats/libbeat/cmd.genRunCmd.func1(0xc0003f0000, 0xc0003c16a0, 0x0, 0x2)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/cmd/run.go:36 +0x60
github.com/elastic/beats/vendor/github.com/spf13/cobra.(*Command).execute(0xc0003f0000, 0xc00003c0a0, 0x2, 0x2, 0xc0003f0000, 0xc00003c0a0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/spf13/cobra/command.go:704 +0x285
github.com/elastic/beats/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc0003f0000, 0x0, 0x7ee00, 0xc0000520b8)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/spf13/cobra/command.go:785 +0x2c9
github.com/elastic/beats/vendor/github.com/spf13/cobra.(*Command).Execute(...)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/spf13/cobra/command.go:738
main.main()
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/main.go:35 +0x2f

goroutine 7 [syscall]:
os/signal.signal_recv(0x0)
/local/mnt/workspace/tntran/go/src/runtime/sigqueue.go:147 +0x9c
os/signal.loop()
/local/mnt/workspace/tntran/go/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
/local/mnt/workspace/tntran/go/src/os/signal/signal_unix.go:29 +0x41

goroutine 27 [runnable]:
github.com/elastic/beats/libbeat/publisher/queue/memqueue.(*bufferingEventLoop).run(0xc0000dafa0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/eventloop.go:316 +0x1cf
github.com/elastic/beats/libbeat/publisher/queue/memqueue.NewBroker.func1(0xc0002a4230, 0x1894e60, 0xc0000dafa0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:160 +0x67
created by github.com/elastic/beats/libbeat/publisher/queue/memqueue.NewBroker
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:158 +0x396

goroutine 28 [select]:
github.com/elastic/beats/libbeat/publisher/queue/memqueue.(*ackLoop).run(0xc0000e0410)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/ackloop.go:60 +0x107
github.com/elastic/beats/libbeat/publisher/queue/memqueue.NewBroker.func2(0xc0002a4230, 0xc0000e0410)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:164 +0x61
created by github.com/elastic/beats/libbeat/publisher/queue/memqueue.NewBroker
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:162 +0x3c8

goroutine 29 [select]:
github.com/elastic/beats/libbeat/publisher/queue/memqueue.(*consumer).Get(0xc00012b400, 0x800, 0x3, 0x2, 0xc000058300, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/consume.go:67 +0xe9
github.com/elastic/beats/libbeat/publisher/pipeline.(*eventConsumer).loop(0xc0000e05a0, 0x1894ea0, 0xc00012b400)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:167 +0x40f
created by github.com/elastic/beats/libbeat/publisher/pipeline.newEventConsumer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:77 +0x154

goroutine 30 [select]:
github.com/elastic/beats/libbeat/publisher/pipeline.(*retryer).loop(0xc00013ecc0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:131 +0x1b4
created by github.com/elastic/beats/libbeat/publisher/pipeline.newRetryer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:86 +0x11e

goroutine 32 [select]:
github.com/elastic/beats/libbeat/monitoring/report/log.(*reporter).snapshotLoop(0xc000324330)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:125 +0x40f
github.com/elastic/beats/libbeat/monitoring/report/log.MakeReporter.func1(0xc000324330)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:103 +0x5d
created by github.com/elastic/beats/libbeat/monitoring/report/log.MakeReporter
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:101 +0x157

goroutine 178 [chan receive]:
github.com/elastic/beats/libbeat/service.HandleSignals.func1(0xc000129560, 0xc000091fd0, 0xc00011b5b0, 0xc00012b5e0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/service/service.go:50 +0x38
created by github.com/elastic/beats/libbeat/service.HandleSignals
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/service/service.go:49 +0xf9

goroutine 180 [select]:
github.com/elastic/beats/libbeat/publisher/pipeline.(*pipelineEventCB).worker(0xc00013ee00)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/pipeline_ack.go:245 +0x1d7
created by github.com/elastic/beats/libbeat/publisher/pipeline.newPipelineEventCB
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/pipeline_ack.go:196 +0x15b

goroutine 181 [select]:
github.com/elastic/beats/filebeat/registrar.(*Registrar).Run(0xc000129680)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/registrar/registrar.go:280 +0x189
created by github.com/elastic/beats/filebeat/registrar.(*Registrar).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/registrar/registrar.go:261 +0xe8

goroutine 182 [select]:
github.com/elastic/beats/libbeat/publisher/pipeline.(*gapCountACK).ackLoop(0xc000129bd0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/acker.go:138 +0xff
created by github.com/elastic/beats/libbeat/publisher/pipeline.(*gapCountACK).init
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/acker.go:126 +0x182

goroutine 183 [chan receive]:
github.com/elastic/beats/filebeat/channel.CloseOnSignal.func1(0xc000053260, 0x1894420, 0xc0003f5800)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:117 +0x34
created by github.com/elastic/beats/filebeat/channel.CloseOnSignal
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:116 +0x76

goroutine 184 [chan receive]:
github.com/elastic/beats/filebeat/channel.SubOutlet.func1(0xc0003f5830, 0x1894420, 0xc0003f5800)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:53 +0x9e
created by github.com/elastic/beats/filebeat/channel.SubOutlet
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:52 +0xf8

goroutine 185 [chan receive]:
github.com/elastic/beats/filebeat/channel.CloseOnSignal.func1(0xc000052cc0, 0x1894460, 0xc0003f5830)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:117 +0x34
created by github.com/elastic/beats/filebeat/channel.CloseOnSignal
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:116 +0x76

goroutine 186 [select]:
github.com/elastic/beats/filebeat/input.(*Runner).Run(0xc0001298c0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/input.go:147 +0x144
github.com/elastic/beats/filebeat/input.(*Runner).Start.func1(0xc00020a920, 0xc0001298c0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/input.go:132 +0x65
created by github.com/elastic/beats/filebeat/input.(*Runner).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/input.go:125 +0x198

goroutine 187 [select]:
github.com/elastic/beats/libbeat/publisher/pipeline.(*gapCountACK).ackLoop(0xc000129ed0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/acker.go:138 +0xff
created by github.com/elastic/beats/libbeat/publisher/pipeline.(*gapCountACK).init
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/publisher/pipeline/acker.go:126 +0x182

goroutine 188 [chan receive]:
github.com/elastic/beats/filebeat/channel.CloseOnSignal.func1(0xc000053260, 0x1894420, 0xc0001357d0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:117 +0x34
created by github.com/elastic/beats/filebeat/channel.CloseOnSignal
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:116 +0x76

goroutine 189 [chan receive]:
github.com/elastic/beats/filebeat/channel.SubOutlet.func1(0xc000135800, 0x1894420, 0xc0001357d0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:53 +0x9e
created by github.com/elastic/beats/filebeat/channel.SubOutlet
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:52 +0xf8

goroutine 190 [chan receive]:
github.com/elastic/beats/filebeat/channel.CloseOnSignal.func1(0xc000052cc0, 0x1894460, 0xc000135800)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:117 +0x34
created by github.com/elastic/beats/filebeat/channel.CloseOnSignal
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:116 +0x76

goroutine 191 [select]:
github.com/elastic/beats/filebeat/input.(*Runner).Run(0xc000129c80)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/input.go:147 +0x144
github.com/elastic/beats/filebeat/input.(*Runner).Start.func1(0xc00020b810, 0xc000129c80)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/input.go:132 +0x65
created by github.com/elastic/beats/filebeat/input.(*Runner).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/input.go:125 +0x198

goroutine 192 [chan receive]:
github.com/elastic/beats/libbeat/cfgfile.(*Reloader).Run(0xc0002a4620, 0x18944a0, 0xc0000e0c80)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/cfgfile/reload.go:198 +0x46a
github.com/elastic/beats/filebeat/crawler.(*Crawler).Start.func2(0xc0004a07e0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/crawler/crawler.go:102 +0x41
created by github.com/elastic/beats/filebeat/crawler.(*Crawler).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/crawler/crawler.go:101 +0x45c

goroutine 193 [chan receive]:
github.com/elastic/beats/filebeat/beater.waitChannel.func1()
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/beater/signalwait.go:79 +0x33
github.com/elastic/beats/filebeat/beater.(*signalWait).Add.func1(0xc0001318a0, 0xc00019e150)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/beater/signalwait.go:52 +0x27
created by github.com/elastic/beats/filebeat/beater.(*signalWait).Add
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/beater/signalwait.go:51 +0x4c

goroutine 163 [chan receive]:
github.com/elastic/beats/filebeat/input/log.(*Harvester).Run(0xc000190000, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:355 +0x133b
github.com/elastic/beats/filebeat/harvester.(*Registry).Start.func1(0xc00013eec0, 0x18a1760, 0xc000190000)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/harvester/registry.go:96 +0x9a
created by github.com/elastic/beats/filebeat/harvester.(*Registry).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/harvester/registry.go:90 +0x153

goroutine 164 [chan receive]:
github.com/elastic/beats/filebeat/channel.SubOutlet.func1(0xc0001c9e00, 0x1894420, 0xc0003f5800)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:53 +0x9e
created by github.com/elastic/beats/filebeat/channel.SubOutlet
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:52 +0xf8

goroutine 165 [chan receive]:
github.com/elastic/beats/filebeat/channel.CloseOnSignal.func1(0xc00021a120, 0x1894460, 0xc0001c9e00)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:117 +0x34
created by github.com/elastic/beats/filebeat/channel.CloseOnSignal
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:116 +0x76

goroutine 166 [select]:
github.com/robfig/cron.(*Cron).run(0xc00019a140)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/robfig/cron/cron.go:263 +0x541
created by github.com/robfig/cron.(*Cron).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/robfig/cron/cron.go:222 +0xa8

goroutine 167 [runnable]:
github.com/elastic/beats/filebeat/parselsb._Cfunc_readlsbEvents(0x7fa668150830, 0x7fa668163640)
_cgo_gotypes.go:90 +0x4a
github.com/elastic/beats/filebeat/parselsb.NewLsbParser.func1.1()
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/parselsb/readlsb.go:77 +0xa45
created by github.com/elastic/beats/filebeat/parselsb.NewLsbParser.func1
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/parselsb/readlsb.go:69 +0xf0

goroutine 168 [select]:
github.com/elastic/beats/filebeat/input/log.(*Harvester).Run.func2(0xc000190000, 0xc000281bc0, 0x37)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:246 +0xca
created by github.com/elastic/beats/filebeat/input/log.(*Harvester).Run
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:238 +0x22c

goroutine 195 [runnable]:
github.com/elastic/beats/filebeat/channel.(*subOutlet).OnEvent(0xc00048dda0, 0xc000308240, 0xbf7e5234011dbf00)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:89 +0x201
github.com/elastic/beats/filebeat/harvester.(*Forwarder).Send(0xc00026fb10, 0xc000308240, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/harvester/forwarder.go:50 +0x41
github.com/elastic/beats/filebeat/input/log.(*Harvester).sendEvent(0xc0001c6000, 0xc000308240, 0xc00026fb10, 0xa)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:430 +0x77
github.com/elastic/beats/filebeat/input/log.(*Harvester).Run(0xc0001c6000, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:396 +0xc23
github.com/elastic/beats/filebeat/harvester.(*Registry).Start.func1(0xc00013f1c0, 0x18a1760, 0xc0001c6000)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/harvester/registry.go:96 +0x9a
created by github.com/elastic/beats/filebeat/harvester.(*Registry).Start
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/harvester/registry.go:90 +0x153

goroutine 196 [chan receive]:
github.com/elastic/beats/filebeat/channel.SubOutlet.func1(0xc00048dda0, 0x1894420, 0xc0001357d0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:53 +0x9e
created by github.com/elastic/beats/filebeat/channel.SubOutlet
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:52 +0xf8

goroutine 197 [chan receive]:
github.com/elastic/beats/filebeat/channel.CloseOnSignal.func1(0xc000294060, 0x1894460, 0xc00048dda0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:117 +0x34
created by github.com/elastic/beats/filebeat/channel.CloseOnSignal
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/channel/util.go:116 +0x76

goroutine 198 [select]:
github.com/elastic/beats/filebeat/input/log.(*Harvester).Run.func2(0xc0001c6000, 0xc000281c80, 0x35)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:246 +0xca
created by github.com/elastic/beats/filebeat/input/log.(*Harvester).Run
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/filebeat/input/log/harvester.go:238 +0x22c

goroutine 243 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).responseReceiver(0xc000140580)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:682 +0xc7
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc00040c670)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).Open.func1
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:149 +0x96b

goroutine 172 [chan receive]:
github.com/elastic/beats/vendor/github.com/rcrowley/go-metrics.(*meterArbiter).tick(0x2380c00)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/rcrowley/go-metrics/meter.go:221 +0x31
created by github.com/elastic/beats/vendor/github.com/rcrowley/go-metrics.NewMeter
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/rcrowley/go-metrics/meter.go:40 +0x13f

goroutine 173 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).responseReceiver(0xc0003fa000)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:682 +0xc7
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000122ae0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).Open.func1
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:149 +0x96b

goroutine 199 [select]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*client).backgroundMetadataUpdater(0xc00044c5a0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/client.go:633 +0x15a
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476110)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.NewClient
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/client.go:163 +0x525

goroutine 200 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).dispatcher(0xc0001788c0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:245 +0xd3
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476160)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.NewAsyncProducerFromClient
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:99 +0x1cf

goroutine 201 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).retryHandler(0xc0001788c0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:802 +0x20d
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476170)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.NewAsyncProducerFromClient
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:100 +0x21d

goroutine 202 [chan receive]:
github.com/elastic/beats/libbeat/outputs/kafka.(*client).successWorker(0xc0001bc600, 0xc000212180)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/outputs/kafka/client.go:207 +0x106
created by github.com/elastic/beats/libbeat/outputs/kafka.(*client).Connect
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/outputs/kafka/client.go:99 +0x214

goroutine 203 [chan receive]:
github.com/elastic/beats/libbeat/outputs/kafka.(*client).errorWorker(0xc0001bc600, 0xc000212060)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/outputs/kafka/client.go:217 +0x11d
created by github.com/elastic/beats/libbeat/outputs/kafka.(*client).Connect
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/libbeat/outputs/kafka/client.go:100 +0x257

goroutine 204 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*topicProducer).dispatch(0xc0003e2880)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:320 +0x63
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc0004761d0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newTopicProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:315 +0x1aa

goroutine 205 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc00012ca20)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:428 +0xc3
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc0004761e0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:414 +0x1a8

goroutine 207 [select]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*brokerProducer).run(0xc00012cb40)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:604 +0x1c1
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476200)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:554 +0x195

goroutine 208 [runnable]:
hash/crc32.slicingUpdate(0xc014fea1ff, 0xc000418000, 0xc00066fd80, 0xe, 0xe, 0xc000968000)
/local/mnt/workspace/tntran/go/src/hash/crc32/crc32_generic.go:73 +0x143
hash/crc32.archUpdateIEEE(0x0, 0xc00065c000, 0x13d8e, 0x13d8e, 0xa6bb50)
/local/mnt/workspace/tntran/go/src/hash/crc32/crc32_amd64.go:221 +0xf4
hash/crc32.Update(0x0, 0xc000104000, 0xc00065c000, 0x13d8e, 0x13d8e, 0x0)
/local/mnt/workspace/tntran/go/src/hash/crc32/crc32.go:218 +0x78
compress/gzip.(*Writer).Write(0xc0004ca000, 0xc00065c000, 0x13d8e, 0x13d8e, 0x0, 0x0, 0x13d8e)
/local/mnt/workspace/tntran/go/src/compress/gzip/gzip.go:195 +0x91
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*RecordBatch).encodeRecords(0xc0001e0000, 0x18bc7e0, 0xc000472040, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/record_batch.go:232 +0x290
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*RecordBatch).encode(0xc0001e0000, 0x18bc7e0, 0xc000472040, 0x1, 0x1)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/record_batch.go:87 +0x360
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Records).encode(0xc0002fcab8, 0x18bc7e0, 0xc000472040, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/records.go:63 +0xbb
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*ProduceRequest).encode(0xc000472000, 0x18bc7e0, 0xc000472040, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/produce_request.go:106 +0x2a4
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*request).encode(0xc00051a0f0, 0x18bc7e0, 0xc000472040, 0x7fa698f24149, 0xc0002fcc10)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/request.go:32 +0x13c
github.com/elastic/beats/vendor/github.com/Shopify/sarama.encode(0x1881fe0, 0xc00051a0f0, 0x18b3440, 0xc0001dab10, 0x0, 0xb, 0x0, 0x0, 0xc0001a3301)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/encoder_decoder.go:24 +0x8d
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).send(0xc000140580, 0x18af060, 0xc000472000, 0xc000472001, 0x0, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:569 +0x27d
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).sendAndReceive(0xc000140580, 0x18af060, 0xc000472000, 0x1881f60, 0xc000472020, 0x8000102, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:600 +0x72
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*Broker).Produce(0xc000140580, 0xc000472000, 0xc0002d0001, 0x0, 0x0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/broker.go:266 +0xe8
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer.func1()
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:561 +0xb1
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc0004fe2c0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:557 +0x1f5

goroutine 209 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*topicProducer).dispatch(0xc0003e28c0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:320 +0x63
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476220)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newTopicProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:315 +0x1aa

goroutine 242 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc000128120)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:428 +0xc3
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc00040c3d0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:414 +0x1a8

goroutine 258 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*topicProducer).dispatch(0xc0003e2900)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:320 +0x63
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476240)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newTopicProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:315 +0x1aa

goroutine 259 [chan receive]:
github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc00012cea0)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:428 +0xc3
github.com/elastic/beats/vendor/github.com/Shopify/sarama.withRecover(0xc000476250)
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/utils.go:45 +0x4d
created by github.com/elastic/beats/vendor/github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
/local/mnt/workspace/tntran/lsfmq-master/buildtmp/src/github.com/elastic/beats/vendor/github.com/Shopify/sarama/async_producer.go:414 +0x1a8

@liuboxa
Copy link
Member

liuboxa commented May 14, 2020

@ttran1361 Sorry for the late reply.

This issue can's be reproduced in my test environment. The "fatal error: concurrent map read and map write" issue seems related to Kafka output which is beat's code and not touched by us.

Could you share me your lsfeventsbeat.yml?

BTW, have you tried with RabbitMQ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants