Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ability to handle index name template in ES output #454

Closed
dshmatov opened this issue Nov 28, 2017 · 3 comments
Closed

Add ability to handle index name template in ES output #454

dshmatov opened this issue Nov 28, 2017 · 3 comments
Assignees
@edsiper
Labels
enhancement fixed

Comments

@dshmatov
Copy link

So, as I understand correctly Fluentbit has an ability (if I use Logstash_Format True) to get timestamp from incoming data (e.g. @timestamp field). But it would be great to set index template time format (index-name-%Y%m%d) from local host not from incoming data. I don't want to use Logstash format, but I want to handle index name via time or env template from local host.
@onorua
Copy link
Contributor

onorua commented Nov 28, 2017

Will that help, if Index will support templating similar to Logstash_DateFormat?
Basically if we would treat Index field as strftime template instead of just string. That should solve your problem, and unify the approach with fluentd:

index_name fluentd-%Y%m%d

@dshmatov
Copy link
Author

@onorua yep, It would be great!

onorua added a commit to onorua/fluent-bit that referenced this issue Nov 28, 2017
@onorua
Introduce index strftime for fluent#454
d001573
onorua added a commit to onorua/fluent-bit that referenced this issue Jan 18, 2018
@onorua
Index is strftime formatted, fixes fluent#454
761ca20
onorua added a commit to onorua/fluent-bit that referenced this issue May 9, 2018
@onorua
Index is strftime formatted, fixes fluent#454
f5ee85c
onorua added a commit to onorua/fluent-bit that referenced this issue May 9, 2018
@onorua
Index is strftime formatted, fixes fluent#454
11d9330
onorua added a commit to onorua/fluent-bit that referenced this issue Aug 13, 2018
@onorua
Index is strftime formatted, fixes fluent#454
fba29d0
onorua added a commit to onorua/fluent-bit that referenced this issue Aug 13, 2018
@onorua
Index is strftime formatted, fixes fluent#454
7a2aae2
edsiper pushed a commit that referenced this issue Feb 18, 2019
@onorua @edsiper
out_es: add current_time_index option (PR #512, #454)
279123a 
The following patch introduce a new boolean configuration option
called 'current_time_index'. When enabled all records and index
will take the current time instead of record time.

Signed-off-by: Eduardo Silva <[email protected]>
edsiper pushed a commit that referenced this issue Feb 18, 2019
@onorua @edsiper
out_es: add current_time_index option (PR #512, #454)
455eae0 
The following patch introduce a new boolean configuration option
called 'current_time_index'. When enabled all records and index
will take the current time instead of record time.

Signed-off-by: Eduardo Silva <[email protected]>
@edsiper edsiper self-assigned this Feb 18, 2019
@edsiper
Copy link
Member

edsiper commented Feb 18, 2019

Fixed by 455eae0

@edsiper edsiper closed this as completed Feb 18, 2019
edsiper pushed a commit that referenced this issue Mar 20, 2019
@onorua @edsiper
out_es: add current_time_index option (PR #512, #454)
29b331b 
The following patch introduce a new boolean configuration option
called 'current_time_index'. When enabled all records and index
will take the current time instead of record time.

Signed-off-by: Eduardo Silva <[email protected]>
@gavenkoa gavenkoa mentioned this issue Mar 9, 2022
Closed
@gitworkflows gitworkflows mentioned this issue Jan 19, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@edsiper edsiper

Labels
enhancement fixed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@edsiper @onorua @dshmatov