# Buffering logs in logstash to wait for entire trace of logs

**URL:** <https://discuss.elastic.co/t/buffering-logs-in-logstash-to-wait-for-entire-trace-of-logs/176293>\
**Category:** Logstash\
**Created:** [April 10, 2019, 8:09pm UTC](https://discuss.elastic.co/t/buffering-logs-in-logstash-to-wait-for-entire-trace-of-logs/176293 "2019-04-10T20:09:51Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mudit\_Mehta](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mudit_mehta/32/43892_2.png) [@Mudit\_Mehta](https://discuss.elastic.co/u/Mudit_Mehta)\
**Post date:** [April 10, 2019, 8:09pm UTC](https://discuss.elastic.co/t/buffering-logs-in-logstash-to-wait-for-entire-trace-of-logs/176293/1 "2019-04-10T20:09:51Z")

</div>

I have configured logstash on multiple AWS instances. These logstash instances receive thousand of logs and I want a way to wait for the entire trace of logs in logstash and take action on the batch instead of a single log event. I thought of using persistent queues to buffer these logs in logstash but since I am having multiple instances the queue will not be a good option.  
Is there some way to buffer logs for some time in logstash and after that send the batches of logs that I want to send to Elastic search?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 8, 2019, 8:09pm UTC](https://discuss.elastic.co/t/buffering-logs-in-logstash-to-wait-for-entire-trace-of-logs/176293/2 "2019-05-08T20:09:54Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.