# Multiple logstash

**URL:** https://discuss.elastic.co/t/multiple-logstash/253009
**Category:** Logstash
**Created:** [October 22, 2020, 1:40pm UTC](https://discuss.elastic.co/t/multiple-logstash/253009 "2020-10-22T13:40:42Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Aniket\_Pant](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)
#### Post date: [October 22, 2020, 1:40pm UTC](https://discuss.elastic.co/t/multiple-logstash/253009/1 "2020-10-22T13:40:43Z")

</div>

I want to add 2 logstash in my application for scalability.From availablity point... I have a question does 2 logstash works simultaneously or they works as a active-passive (one stop other takes) or they automatically manage the load and yes i have multiple pipelines id.

---

<div class="post-metadata">

### Author: ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)
#### Post date: [October 22, 2020, 2:36pm UTC](https://discuss.elastic.co/t/multiple-logstash/253009/2 "2020-10-22T14:36:15Z")

</div>

logstash does not support clustering. If you have two copies of logstash they will both process their inputs. For a tcp or http input you could put a load balancer in front of them and each request would get processed in one of the two. For a file input they would both read the file and all of the data would be duplicated.

---

<div class="post-metadata">

### Author: ![Aniket\_Pant](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)
#### Post date: [October 23, 2020, 3:47pm UTC](https://discuss.elastic.co/t/multiple-logstash/253009/3 "2020-10-23T15:47:09Z")

</div>

I want to know that if i have some logstash pipeline files do i need to keep these logstash pipeline files in both the nodes..if i do this then i have duplicate data in elasticsearch and the reason i want to use 2 logstash is for high availability but it seems that it's not good idea to have 2 logstash

---

<div class="post-metadata">

### Author: ![Kickinsix](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kickinsix/32/52040_2.png) [@Kickinsix](https://discuss.elastic.co/u/Kickinsix)
#### Post date: [October 24, 2020, 1:32am UTC](https://discuss.elastic.co/t/multiple-logstash/253009/4 "2020-10-24T01:32:30Z")

</div>

I have 5 logstash instances that pull from 3 Redis servers so it will never create duplicate documents. If you're concerned about the same file data going to each logstash then create a unique document ID. GL

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 21, 2020, 1:32am UTC](https://discuss.elastic.co/t/multiple-logstash/253009/5 "2020-11-21T01:32:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
