Using ElasticSearch and Packetbeat to understand a Docker cluster


(Gergo Horanyi) #1

Hey all,

We are building a cool tool visualize what's happening in real-time on a Docker cluster based on the Intuition Engineering concept from Netflix. We are using Packetbeat to observe network traffic and ES aggregations to get the data to visualize. Any kind of feedback is appreciated.

Cheers,
Gergo


(Mark Walkom) #2

Nice, thanks for sharing this!


(Steffen Siering) #3

That's pretty cool.

Talking about beats, it would be great to access application logs by selecting the services. Logs could be collected with filebeat for example.

There's some work in progress for running metricbeat inside of docker (and metricbeat to custom mounted /proc dir), plus adding support for cgroups: https://github.com/elastic/beats/issues/2137 . Some docker-module might be added to metricbeat too.


(system) #4