Hello
I have a lot of servers running beats that are collected into a "middle layer"(1) before they are shipped to elasticsearch and I am currently managing the pipelines by hand, installing filebeat, set up against elasticsearch and I run the setup so it imports everything I need and I think that someone must have made a better way to do this .....
so, my question is, is there a better way to do this while retaining the middle layer ?
(1) redis server between various data collectors and elasticsearch