# Logstash Database pipeline resiliency

**URL:** <https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608>\
**Category:** Logstash\
**Created:** [January 9, 2021, 2:14pm UTC](https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608 "2021-01-09T14:14:15Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![adityaPsl](https://avatars.discourse-cdn.com/v4/letter/a/e47c2d/32.png) [@adityaPsl](https://discuss.elastic.co/u/adityaPsl)\
**Post date:** [January 9, 2021, 2:14pm UTC](https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608/1 "2021-01-09T14:14:15Z")

</div>

Hello Team,

I have a use case where Ineed to deploy database pipeline on 2 nodes, but i want to implement in a way that if one node(machine) goes down then only 2nd will pick up from that point and until the second goes down the first will wait.  
I dont have the option of docker and kubernetes.  
could you please help me understand if this is possible.

Thank you for your help and support.

Thank you,  
Aditya

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [January 9, 2021, 3:04pm UTC](https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608/2 "2021-01-09T15:04:51Z")

</div>

logstash does not support clustering in the sense that nodes are coordinated. They all run independently.

---

<div class="post-metadata">

**Author:** ![adityaPsl](https://avatars.discourse-cdn.com/v4/letter/a/e47c2d/32.png) [@adityaPsl](https://discuss.elastic.co/u/adityaPsl)\
**Post date:** [January 9, 2021, 3:13pm UTC](https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608/3 "2021-01-09T15:13:48Z")

</div>

Yeah right, any thoughts on handling the situaltion.  
I was thinking of keeping shared lastcrawledtime file (if possible) and keep scheduling at different time so that i wil not crawl duplicates and 2 pipeline will not query at same time.  
any thoughts on this approach.

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [January 9, 2021, 3:28pm UTC](https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608/4 "2021-01-09T15:28:24Z")

</div>

> [@adityaPsl](#):
>
> Yeah right, any thoughts on handling the situaltion.

logstash is not designed to do what you want it to do. That does not mean it is impossible, but it will not be simple.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 6, 2021, 3:28pm UTC](https://discuss.elastic.co/t/logstash-database-pipeline-resiliency/260608/5 "2021-02-06T15:28:27Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.