# How can resume logstash pipeline after terminated or crashed?

**URL:** <https://discuss.elastic.co/t/how-can-resume-logstash-pipeline-after-terminated-or-crashed/267029>\
**Category:** Logstash\
**Created:** [March 12, 2021, 4:35am UTC](https://discuss.elastic.co/t/how-can-resume-logstash-pipeline-after-terminated-or-crashed/267029 "2021-03-12T04:35:05Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sage](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sage/32/85429_2.png) [@Sage](https://discuss.elastic.co/u/Sage)\
**Post date:** [March 12, 2021, 4:35am UTC](https://discuss.elastic.co/t/how-can-resume-logstash-pipeline-after-terminated-or-crashed/267029/1 "2021-03-12T04:35:05Z")

</div>

I designed a pipeline with **elasticsearch** as a input plugin and **s3** as a output plugin. In my case, pipeline started successfully and push the data on s3 bucket but in case of **termination or crash** it does not start from where pipeline ended last time. What is happening? let suppose pipeline has been started and data size was **8GB** and pipeline has been pushed data around **6GB on S3 bucket** then suddenly pipeline terminated with any reason and restart pipeline again then data start from first position, 6GB is already there now again same data come then make duplicity on s3 bucket. Any way to resume pipeline? Pipeline already pushed data around 6GB and when we start again after crash it should push data remaining 2GB.

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [March 12, 2021, 3:42pm UTC](https://discuss.elastic.co/t/how-can-resume-logstash-pipeline-after-terminated-or-crashed/267029/2 "2021-03-12T15:42:27Z")

</div>

There is an [open issue](https://github.com/logstash-plugins/logstash-input-elasticsearch/issues/93) requesting the elasticsearch input provide a way to maintain state (as the jdbc input does) but it has not been implemented.

---

<div class="post-metadata">

**Author:** ![Sage](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sage/32/85429_2.png) [@Sage](https://discuss.elastic.co/u/Sage)\
**Post date:** [March 15, 2021, 7:22am UTC](https://discuss.elastic.co/t/how-can-resume-logstash-pipeline-after-terminated-or-crashed/267029/3 "2021-03-15T07:22:35Z")

</div>

@Badger Thanks for your response.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 12, 2021, 7:22am UTC](https://discuss.elastic.co/t/how-can-resume-logstash-pipeline-after-terminated-or-crashed/267029/4 "2021-04-12T07:22:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.