You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Our fluentd(v1.1) log system have billion logs per day. When the fluent out forward node fails more than a few hours, the fluentd save millions of buffer files, and 100% cpu usage. In fluentd 0.12.* is not that.
I think it is caused by some defects. In my fluentd config, chunk_limit_size is 4m, and flush_interval is 1s, I want fluentd foward plugin send data as quickly as possible. In fluentd v0.12 if forward node is error, it will save buffer files 4MB per file, but in fluentd v1.1, it will save buffer file every second, awful, it save million files. so, the problem will appear flush_mode is interval(and flush_interval is small) or immediate.
You can see, it save 4 buffer files and 4 meta files, however, in fluent 0.12 only 1 buffer file. so, if it happens in a highly loaded server, it will be very scary.
The text was updated successfully, but these errors were encountered:
I'm not sure if it is. but I have update fluentd to v1.1.2 and test it. I think it still has problems. when flush_interval 1s, it also save a buffer file every second, chunk_limit_size 4m has no effect.
Our fluentd(v1.1) log system have billion logs per day. When the fluent out forward node fails more than a few hours, the fluentd save millions of buffer files, and 100% cpu usage. In fluentd 0.12.* is not that.
I think it is caused by some defects. In my fluentd config, chunk_limit_size is 4m, and flush_interval is 1s, I want fluentd foward plugin send data as quickly as possible. In fluentd v0.12 if forward node is error, it will save buffer files 4MB per file, but in fluentd v1.1, it will save buffer file every second, awful, it save million files. so, the problem will appear flush_mode is interval(and flush_interval is small) or immediate.
It's test config:
then run
td-agent -c test.conf
and runls -al /data/fluentd-buffer/test/
:You can see, it save 4 buffer files and 4 meta files, however, in fluent 0.12 only 1 buffer file. so, if it happens in a highly loaded server, it will be very scary.
The text was updated successfully, but these errors were encountered: