# Twitter Logstash pipeline stops after a certain period

**URL:** <https://discuss.elastic.co/t/twitter-logstash-pipeline-stops-after-a-certain-period/302425>\
**Category:** Logstash\
**Created:** [April 14, 2022, 12:15pm UTC](https://discuss.elastic.co/t/twitter-logstash-pipeline-stops-after-a-certain-period/302425 "2022-04-14T12:15:02Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![dihiaselma](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dihiaselma/32/102810_2.png) [@dihiaselma](https://discuss.elastic.co/u/dihiaselma)\
**Post date:** [April 14, 2022, 12:15pm UTC](https://discuss.elastic.co/t/twitter-logstash-pipeline-stops-after-a-certain-period/302425/1 "2022-04-14T12:15:02Z")

</div>

Hello;

I have created a pipeline logstash to retrieve data from twitter, then insert these data into Elasticsearch.  
It works fine for a certain period then, it stops without any error in logs.

I have just to restart it, and it works . then it stops again after a certain period....

Please, do you have any idea about this problem and how to fix it?

---

<div class="post-metadata">

**Author:** ![Deh\_Man](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/deh_man/32/104398_2.png) [@Deh\_Man](https://discuss.elastic.co/u/Deh_Man)\
**Post date:** [April 14, 2022, 12:31pm UTC](https://discuss.elastic.co/t/twitter-logstash-pipeline-stops-after-a-certain-period/302425/2 "2022-04-14T12:31:21Z")

</div>

I have a similar issue.

We are using Logstash (on Docker) to fetch some Twitter data which we'll then insert into OpenSearch. Everything was working fine until we noticed that the pipeline was not generating any new indices in OpenSearch. We checked the logs and we found 0 Errors.

Ironically, a temporary fix was to restart the Logstash Docker container which would automatically get things working again, until Logstash randomly stops fetching data and we'd have to restart it again, ...

I'm interested in knowing the source of the problem and how to fix the issue, rather than bypassing it by restarting the Logstash instance that we're running every time the problem occurs.

PS:

**Logstash Docker Image** opensearchproject/logstash-oss-with-opensearch-output-plugin:7.13.4

**OpenSearch Docker Image** opensearchproject/opensearch:1.2.0

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 14, 2022, 12:31pm UTC](https://discuss.elastic.co/t/twitter-logstash-pipeline-stops-after-a-certain-period/302425/3 "2022-04-14T12:31:21Z")

</div>

OpenSearch/OpenDistro are AWS run products and differ from the original Elasticsearch and Kibana products that Elastic builds and maintains. You may need to contact them directly for further assistance.

(This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns :elasticheart: )

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 12, 2022, 12:32pm UTC](https://discuss.elastic.co/t/twitter-logstash-pipeline-stops-after-a-certain-period/302425/4 "2022-05-12T12:32:07Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.