# Logstash is slow for mulitiple pipelines

**URL:** <https://discuss.elastic.co/t/logstash-is-slow-for-mulitiple-pipelines/207491>\
**Category:** Logstash\
**Created:** [November 12, 2019, 10:41am UTC](https://discuss.elastic.co/t/logstash-is-slow-for-mulitiple-pipelines/207491 "2019-11-12T10:41:37Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![nuwancs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nuwancs/32/46419_2.png) [@nuwancs](https://discuss.elastic.co/u/nuwancs)\
**Post date:** [November 12, 2019, 10:41am UTC](https://discuss.elastic.co/t/logstash-is-slow-for-mulitiple-pipelines/207491/1 "2019-11-12T10:41:37Z")

</div>

Hi There,  
I am using two pipelines to process my data coming from same server but different set of files. let's say A and B. A has a very high tps and it goes over 1000EPS(events per sec) B has 40EPS max. They push data to two separate indexes at elastisearch.  
I see a big delay on pipeline B when events are visible on kibana dashboard via elasticsearch. I don't see a delay on pipeline A though!  
As the pipeline A data isn't that critical, I tried to slow down it's processing by  
changing pipeline A settings ,

> increase the `pipeline.batch.delay`  
> `pipeline.workers` to 1  
> reducing `pipeline.batch.size`

while pipeline B settings were left at default values.

The result was pipeline A EPS came down to 50 and pipeline B also went below 1.

I didn't see memory or cpu going above 50%.

can someone help me how to change the pririty of the pipelines when they handle data?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 10, 2019, 10:51am UTC](https://discuss.elastic.co/t/logstash-is-slow-for-mulitiple-pipelines/207491/2 "2019-12-10T10:51:25Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
