-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Proposal: kafka output #942
Conversation
f046234
to
0b3d584
Compare
a905db4
to
1b938be
Compare
} | ||
debugf("hosts: %v", hosts) | ||
|
||
useType := kafkaDefaultTopicsFromType |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this configuration option is not documented.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
oh yes, forgot this one.
LGTM. I suggest some integration tests for a few of the common configuration (TLS/no-TLS, ACK/no-ACK), but those can come in a different PR. |
1ab0527
to
2f64b7e
Compare
History cleanup finished |
Is there a need for implementing other PR's or can we start using kafka output in beats framework. |
This is great news on providing a Kafka output for beats. When is v5.0.0-GA targeted to be released? In the meantime I have built from master to start testing it out. Any tips on how to configure the Kafka output? |
Docs: https://www.elastic.co/guide/en/beats/filebeat/master/kafka-output.html |
Thanks for sharing the docs. Kafka output with filebeat is working for me. |
Could anyone @elastic confirms if beat -> kafka is going to be available for version 5? |
Yes, Kafka will be available in the 5.0 release. You can already tests it with the 5.0.0-alpha releases. |
Kafka output basically wrapping github.com/Shopify/sarama library in libbeat + make it configurable.
Depends on: #927 and #940