# Logstash output streaming when ES is down

**URL:** https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230
**Category:** Logstash
**Created:** [April 16, 2018, 4:28pm UTC](https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230 "2018-04-16T16:28:38Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![mww1](https://avatars.discourse-cdn.com/v4/letter/m/ccd318/32.png) [@mww1](https://discuss.elastic.co/u/mww1)
#### Post date: [April 16, 2018, 4:28pm UTC](https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230/1 "2018-04-16T16:28:38Z")

</div>

Hi, what happens when I want to stream my output data from logstash to ElasticSearch when ES is down ? how do I configure my logstash?

---

<div class="post-metadata">

### Author: ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [April 16, 2018, 4:52pm UTC](https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230/2 "2018-04-16T16:52:30Z")

</div>

If logstash cannot write to its output then it will stop reading inputs. For some inputs (udp comes to mind) that could lead to data loss.

Please do not post the same question in more than one forum.

---

<div class="post-metadata">

### Author: ![mww1](https://avatars.discourse-cdn.com/v4/letter/m/ccd318/32.png) [@mww1](https://discuss.elastic.co/u/mww1)
#### Post date: [April 16, 2018, 5:28pm UTC](https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230/3 "2018-04-16T17:28:54Z")

</div>

thanks for the reply. ok sure. I wasnt sure where this question would fit best. ill keep that in mind.  
ok so instead of logstash stop reading inputs from the data source, is there any way it could still read the input data and make a queue of data and once Elasticsearch is up it would push the data into ES?  
if there is a way, how can I do that?

thanks.

---

<div class="post-metadata">

### Author: ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [April 16, 2018, 5:47pm UTC](https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230/4 "2018-04-16T17:47:04Z")

</div>

There is a limited in-memory queue within logstash. If you want logstash to buffer more data then you could use [persistent queues](https://www.elastic.co/guide/en/logstash/current/persistent-queues.html). Personally I use kafka to queue data in front of logstash.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [May 14, 2018, 5:47pm UTC](https://discuss.elastic.co/t/logstash-output-streaming-when-es-is-down/128230/5 "2018-05-14T17:47:22Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
