Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tail debug issue crash on aws-for-fluent-bit:init-arm64-2.31.8 #637

Closed
ruchirbh opened this issue Apr 14, 2023 · 2 comments
Closed

Tail debug issue crash on aws-for-fluent-bit:init-arm64-2.31.8 #637

ruchirbh opened this issue Apr 14, 2023 · 2 comments

Comments

@ruchirbh
Copy link

Describe the question/issue

When I am using the latest fluentbit bit image .i.e aws-for-fluent-bit:init-arm64-2.31.8 it is crashing with following error logs.

/fluent-bit/bin/fluent-bit -i tail -p Refresh_Interval=5 -p parser=json -p path=/tmp/ray/session_latest/logs/monitor.log -p read_from_head=true -o stdout

[2257] tail.0: [1681464726.107460214, {"log"=>"2023-04-14 09:32:04,681	INFO autoscaler.py:462 -- The autoscaler took 0.002 seconds to complete the update iteration."}]
[2023/04/14 09:32:07] [debug] [out flush] cb_destroy coro_id=0
[2023/04/14 09:32:07] [debug] [task] destroy task=0xffff7fe40460 (task_id=0)
[2023/04/14 09:32:09] [engine] caught signal (SIGSEGV)
#0  0xffff81d64e44      in  ???() at ???:0
#1  0xffff81d307db      in  ???() at ???:0
#2  0xffff81d5496b      in  ???() at ???:0
#3  0x4c7aef            in  flb_sds_printf() at src/flb_sds.c:429
#4  0x539777            in  debug_event_mask() at plugins/in_tail/tail_fs_inotify.c:69
#5  0x539bef            in  tail_fs_event() at plugins/in_tail/tail_fs_inotify.c:199
#6  0x4cc007            in  flb_input_collector_fd() at src/flb_input.c:1239
#7  0x4e1b3f            in  flb_engine_handle_event() at src/flb_engine.c:447
#8  0x4e1b3f            in  flb_engine_start() at src/flb_engine.c:770
#9  0x4be9db            in  flb_lib_worker() at src/flb_lib.c:626
#10 0xffff823fb22b      in  ???() at ???:0
#11 0xffff81dbca1b      in  ???() at ???:0
#12 0xffffffffffffffff  in  ???() at ???:0
Aborted (core dumped)

whereas the old image on version aws-for-fluent-bit:init-arm64-2.28.5 works. just fine

@PettitWesley
Copy link
Contributor

@ruchirbh looks like its this issue: #639

Try any of the suggested mitigations, we're working on fixing it. Apologies.

@PettitWesley PettitWesley changed the title Fluentbit crashing with latest image aws-for-fluent-bit:init-arm64-2.31.8 Tail debug issue crash on aws-for-fluent-bit:init-arm64-2.31.8 Apr 18, 2023
@PettitWesley
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants