# SIEM deployment design advise

**URL:** <https://discuss.elastic.co/t/siem-deployment-design-advise/54041>\
**Category:** Logstash\
**Created:** [June 27, 2016, 12:45pm UTC](https://discuss.elastic.co/t/siem-deployment-design-advise/54041 "2016-06-27T12:45:30Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Tal\_Bar\_Or](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tal_bar_or/32/5127_2.png) [@Tal\_Bar\_Or](https://discuss.elastic.co/u/Tal_Bar_Or)\
**Post date:** [June 27, 2016, 12:45pm UTC](https://discuss.elastic.co/t/siem-deployment-design-advise/54041/1 "2016-06-27T12:45:31Z")

</div>

Hello All,

I am in the process of building of SIEM (Security information and event management ) based on the ELK technology.  
For that purpose i would like to carefully design the deployment so it can accommodate to medium to large volume of events feed.

Most of my my sensors are Snort based that send data over syslog , I was reading that there is recommendation when having to deal with large volume data events to use Redis or similar queue management facility.  
So my question regarding above information what is the best practice recommended from which volume of events or events per second is recommended of using such queue management ?  
In addition what would be best to feed order Syslog \>\> Redis\>\>logstash\>\>elasticsearch or Syslog\>\>Logstash\>\>Redis\>\>Elasticsearch ?

Please advise  
Thanks

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [June 30, 2016, 6:31pm UTC](https://discuss.elastic.co/t/siem-deployment-design-advise/54041/2 "2016-06-30T18:31:40Z")

</div>

> Most of my my sensors are Snort based that send data over syslog , I was reading that there is recommendation when having to deal with large volume data events to use Redis or similar queue management facility.

Yes, that's frequently used to distribute load across multiple Logstash servers as well as being more resilient against traffic spikes.

> So my question regarding above information what is the best practice recommended from which volume of events or events per second is recommended of using such queue management ?

It depends.

> In addition what would be best to feed order Syslog \>\> Redis\>\>logstash\>\>elasticsearch or Syslog\>\>Logstash\>\>Redis\>\>Elasticsearch ?

AFAIK Elasticsearch can't get data from Redis (unless it's a recently added ingest node feature) so that option is out. If you can get your syslog daemon to log directly to Redis that sounds like a good idea.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:50am UTC](https://discuss.elastic.co/t/siem-deployment-design-advise/54041/3 "2017-07-06T04:50:04Z")

</div>

Closed on July 6, 2017, 4:50am UTC


