How to prevent logs missing

cwt · January 26, 2018, 6:52am

Hi folks,
Please share your experience and tips, how to protect from losing logs, when the Logstash or Elastic falls.

RabbitMQ? Redis?

I have one standalone ELK stack.

Thank you

pixiuPL · January 31, 2018, 12:16pm

Rather clasterize and apply adequate cluster policy.

dadoonet · January 31, 2018, 4:53pm

But then, what if RabbitMQ fails?

Logstash has now persistent queues which would probably avoid some of the problems.

What exactly the problem you have or you are thinking that you can have?

cwt · February 16, 2018, 11:37am

ELK need to update more often than rabbitmq ))) I just want to protect from losing my logs when updating EL.

dadoonet · February 16, 2018, 3:44pm

I see.

Kafka is also a good candidate IMHO. RabbitMQ and Redis are nice as well.

pixiuPL · February 27, 2018, 9:59am

Redis is shit. Dont recommend it (esp for newbies)
If Rabbit (or any other CaaS) fails, just restart it (either manually or by script) and you're back on track.

warkolm · February 27, 2018, 5:18pm

These forums are not the place for that sort of language, so please refrain from using it in future.

system · March 27, 2018, 5:18pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.