# Elastic production architecture with redis?

**URL:** <https://discuss.elastic.co/t/elastic-production-architecture-with-redis/33993>\
**Category:** Elasticsearch\
**Created:** [November 6, 2015, 1:32pm UTC](https://discuss.elastic.co/t/elastic-production-architecture-with-redis/33993 "2015-11-06T13:32:05Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![ashwin2011](https://avatars.discourse-cdn.com/v4/letter/a/c4cdca/32.png) [@ashwin2011](https://discuss.elastic.co/u/ashwin2011)\
**Post date:** [November 6, 2015, 1:32pm UTC](https://discuss.elastic.co/t/elastic-production-architecture-with-redis/33993/1 "2015-11-06T13:32:05Z")

</div>

Hi, Im a bit confuse with the redis server as a broker.

Im planning to setup a production architecture to centralised all the logs of different application of 3000 server on ELK but something is confusing me.

Here is my configs :

3 nodes elasticsearch 1.7x (ES cluster)  
2 node logstash indexer 1.5 (multiple ES node output for on each LS nodes| serve as load balanced if I or remove a node)  
logstash-forwarded on each servers

1000 servers will be using one LS node and 2000 servers will use the second LS node.

Does logstash-forwarder have a buffer if I lose connection between the server and the LS indexer ?

If I setup a redis server will I be able to use logstash forwarded ?

Does how much can logstash hold if I lose connection between LS and ES nodes ?

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [November 6, 2015, 2:30pm UTC](https://discuss.elastic.co/t/elastic-production-architecture-with-redis/33993/2 "2015-11-06T14:30:15Z")

</div>

> Does logstash-forwarder have a buffer if I lose connection between the server and the LS indexer ?

The files themselves act as a buffer. LSF will simply stop reading from them.

> If I setup a redis server will I be able to use logstash forwarded ?

Yes, but you need a Logstash instance to receive the messages from LSF and submit them to Redis.

> Does how much can logstash hold if I lose connection between LS and ES nodes ?

Logstash itself has no internal queue so messages will queue up in Redis.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:40pm UTC](https://discuss.elastic.co/t/elastic-production-architecture-with-redis/33993/3 "2017-07-05T23:40:09Z")

</div>


