Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for munin module in Metricbeat #6473

Closed
medcl opened this issue Feb 26, 2018 · 5 comments
Closed

Support for munin module in Metricbeat #6473

medcl opened this issue Feb 26, 2018 · 5 comments
Assignees
Labels

Comments

@medcl
Copy link
Contributor

medcl commented Feb 26, 2018

Munin: http://munin-monitoring.org/

Munin is a networked resource monitoring tool that can help analyze resource trends and "what just happened to kill our performance?" problems. It is designed to be very plug and play. A default installation provides a lot of graphs with almost no work.

Munin is a widely used monitoring solution, and support a lot of platforms, such as OpenWRT, Solaris/SmartOS(which beats is not able to reach, for now, limited by Golang's implementation),

Also with a lot of metric collect plugins:

Munin can be deployed as Munin-node in the edge machine, listen on tcp port 9494,
and a Munin server pulling these metrics via that agent's ip and port and generate reports, seems works like that, please correct me if I am wrong.

But Munin metrics analysis layer is kindly of out-dated, it uses a cron style to generate static html reports, neat but not enough, some modern analysis features are not there.

If we can leverage Munin-node to collect metrics, as they are pretty mature, and then use Metricbeat to collect these metrics and send to elasticsearch, now the world will rocks.

@elastic/beats Any thoughts?

@medcl medcl added the Metricbeat Metricbeat label Feb 26, 2018
@ruflin ruflin added the module label Feb 26, 2018
@ruflin
Copy link
Contributor

ruflin commented Feb 26, 2018

I like the idea. I would imagine it would work pretty similar to our http or prometheus module. In the best case metricbeat would be installed along the munin node agent but for not supported system it could be also remote.

@jsoriano jsoriano self-assigned this Mar 9, 2018
jsoriano added a commit to jsoriano/beats that referenced this issue Mar 16, 2018
Add munin module, with node metricset that obtain metrics
from a running munin node using the same protocol used by
munin masters.
ruflin pushed a commit that referenced this issue Mar 19, 2018
Add munin module, with node metricset that obtain metrics
from a running munin node using the same protocol used by
munin masters.
@jsoriano
Copy link
Member

@medcl we have merged #6517 with a new experimental module for munin, this should be enough by now to collect metrics from a munin node agent.

I was wondering if we can also setup something for visualization.

Munin nodes also provide "config" about how each metric they expose should be represented, this info is used by munin masters to periodically generate the static reports. We could maybe reuse this config to generate kibana dashboards but I think it doesn't fit so well with our current setup workflow: munin metrics config is though to be retrieved during runtime, and metricbeat setup is intended to be run as a previous step. I guess that the ideal approach (from munin point of view) would be to have the ability to setup kibana dashboards dynamically during runtime.

Other options would be to have kibana dashboards for well-known munin plugins, or to have an only dashboard that is generated depending on the information in the index or the events (maybe vega can help on that?)

@mattapperson @ruflin thoughts about this?

@tsg
Copy link
Contributor

tsg commented Mar 19, 2018

+1 for dashboards for the most popular munin plugins, or for what we don't support currently natively with Metricbeat.

@medcl
Copy link
Contributor Author

medcl commented Mar 20, 2018

@jsoriano Awesome! that's so quickly!

@ruflin
Copy link
Contributor

ruflin commented Apr 6, 2018

Closing this as we munin is in master.

@ruflin ruflin closed this as completed Apr 6, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants