Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crash pods #3588

Closed
satyavank1988 opened this issue Jun 2, 2021 · 2 comments
Closed

Crash pods #3588

satyavank1988 opened this issue Jun 2, 2021 · 2 comments
Labels

Comments

@satyavank1988
Copy link

Bug Report

Describe the bug
Pods restart or crash time to time.

fluent-bit.conf


    [PARSER]
        Name docker_no_time
        Format json
        Time_Keep On
        Time_Key time
        Time_Format %Y-%m-%dT%H:%M:%S.%L
    [PARSER]
        Name docker_multiline
        Format regex
        Regex ^{"log":"(?!\\u0009)(?<log>\S(?:(\\")|[^"]){9}(?:(\\")|[^"])*)"
  fluent-bit.conf: |
    [SERVICE]
        Flush 1
        Daemon Off
        Log_Level info
        Parsers_File parsers.conf
        Parsers_File custom_parsers.conf
        HTTP_Server On
        HTTP_Listen 0.0.0.0
        HTTP_Port 2020
        storage.path /var/log/flb-storage/
        storage.backlog.mem_limit 100M
        storage.max_chunks_up 128
    [INPUT]
        Name tail
        Path /var/log/containers/*.log
        Parser docker_no_time
        Tag kube.*
        Mem_Buf_Limit 100M
        Skip_Long_Lines On
        storage.type filesystem
        DB /var/log/flb-storage/fluentbit.db
        Docker_Mode On
        Docker_Mode_Parser docker_multiline
    [INPUT]
        Name systemd
        Tag host.*
        Systemd_Filter _SYSTEMD_UNIT=kubelet.service
        Read_From_Tail On
    [FILTER]
        Name kubernetes
        Match kube.*
        Merge_Log On
        Keep_Log Off
        K8S-Logging.Parser On
        K8S-Logging.Exclude On
    [FILTER]
        Name grep
        Match *
        Exclude log .*dpi_tcp_tracker.*
    [FILTER]
        Name modify
        Match *
        Add cluster_name eu1tst-eks001
        Add source fluentbit
    [FILTER]
        Name    lua
        Match   kube.*
        script  /etc/fluentbit/lua/dedot.lua
        call    dedot
    [OUTPUT]
        Name kafka
        Match *
        Brokers servername:8200,servername:8200,servername:8200
        Topics logs
        timestamp_format iso8601
        storage.total_limit_size 25G
        rdkafka.ssl.certificate.location /etc/fluentbit/client_cert.pem
        rdkafka.ssl.key.location /etc/fluentbit/client_cert.key
        rdkafka.ssl.ca.location /etc/fluentbit/ca_cert.pem
        rdkafka.security.protocol ssl

Error logs

[2021/05/31 10:08:03] [error] [output:kafka:kafka.0] error encoding to JSON
[2021/05/31 10:08:03] [error] [output:kafka:kafka.0] error encoding to JSON
[2021/05/31 10:08:08] [engine] caught signal (SIGSEGV)
#0  0x562ccdf32607      in  produce_message() at plugins/out_kafka/kafka.c:159
#1  0x562ccdf33203      in  cb_kafka_flush() at plugins/out_kafka/kafka.c:406
#2  0x562ccdea869c      in  output_pre_cb_flush() at include/fluent-bit/flb_output.h:470
#3  0x562cce349aa6      in  co_init() at lib/monkey/deps/flb_libco/amd64.c:117

Environment

  • Fluent-bit Version: v1.7.7
  • Environment name and version (e.g. Kubernetes? What version?): K8s, 1.18
@github-actions
Copy link
Contributor

github-actions bot commented Jul 3, 2021

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the Stale label Jul 3, 2021
@github-actions
Copy link
Contributor

github-actions bot commented Jul 8, 2021

This issue was closed because it has been stalled for 5 days with no activity.

@github-actions github-actions bot closed this as completed Jul 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant