Batch processing

[dadoonet (David Pilato)]

Moved your question to logstash

Yes you can.

Look at something similar at

Logstash with elasticsearch input and output keep looping results

I would like to reindex and filter my log again. What I get the information from Internet is using the logstash to filter the data again. I tried and it can really split my data into different fields, however, the data keeps looping. That is, I have 100,000 log but after filter and output to elasticsearch, I found that more than 100,000 log output into elasticsearch and the log are deplicated. Does anyone have idea on that? Moreover, I receive below log when running logstash, although it said t…