# Redis, Logstash indexer, elasticsearch bottleneck

**URL:** <https://discuss.elastic.co/t/redis-logstash-indexer-elasticsearch-bottleneck/32113>\
**Category:** Logstash\
**Created:** [October 13, 2015, 7:22pm UTC](https://discuss.elastic.co/t/redis-logstash-indexer-elasticsearch-bottleneck/32113 "2015-10-13T19:22:57Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ktella](https://avatars.discourse-cdn.com/v4/letter/k/71e660/32.png) [@ktella](https://discuss.elastic.co/u/ktella)\
**Post date:** [October 13, 2015, 7:22pm UTC](https://discuss.elastic.co/t/redis-logstash-indexer-elasticsearch-bottleneck/32113/1 "2015-10-13T19:22:57Z")

</div>

I have made a setup of ELK like below.  
LS(reading from file) --\> REDIS --\> LS(indexer) --\> ELS

I'm using a bench mark script from here to generate a 1M logs lines to measure performance.

> **[aseigneurin/logstash\_benchmark](https://github.com/aseigneurin/logstash_benchmark)**
>
> Contribute to logstash\_benchmark development by creating an account on GitHub.

1. I'm monitoring redis list length with help of LLEN command  
/usr/local/bin/redis-cli -h xxx.xxx.xxx.xxx LLEN "logstash-redis"
2. I'm monitoring the records in ELS with ruby script which uses stats page, which prints COUNT for every second.

What i have observed is that REDIS LIST is empty very quick almost in a ~65 seconds. I can only see only ~60% which ~600K records in ELS.

I'm trying to find the bottleneck here.  
Does that mean 400K records are still in LS-indexer queue or in ELS ? How can i speed the things up ?

Is it possible its to do with performance of ES indexing ?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:26am UTC](https://discuss.elastic.co/t/redis-logstash-indexer-elasticsearch-bottleneck/32113/2 "2017-07-06T05:26:37Z")

</div>