# Logstash, collectd and avoiding duplicated data in the ES

**URL:** <https://discuss.elastic.co/t/logstash-collectd-and-avoiding-duplicated-data-in-the-es/52548>\
**Category:** Logstash\
**Created:** [June 12, 2016, 10:01pm UTC](https://discuss.elastic.co/t/logstash-collectd-and-avoiding-duplicated-data-in-the-es/52548 "2016-06-12T22:01:39Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jasonh](https://avatars.discourse-cdn.com/v4/letter/j/e0b2c6/32.png) [@jasonh](https://discuss.elastic.co/u/jasonh)\
**Post date:** [June 12, 2016, 10:01pm UTC](https://discuss.elastic.co/t/logstash-collectd-and-avoiding-duplicated-data-in-the-es/52548/1 "2016-06-12T22:01:39Z")

</div>

Hi  
Architectural question here  
I'm setting up an ELK environment  
There are 2 logstash servers feeding into the ES cluster  
Each of the Logstash will have a collectd instance plugin snmp polling the same devices for data redundancy.  
I'm trying to work out how to setup the ELK environment to avoid duplicating that collectd polled data.  
I see that in filebeat we can use HA concepts but having trouble working out a process with Collected from 2 logstash instances not duplicating polled SNMP data in the ES environment  
Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:53am UTC](https://discuss.elastic.co/t/logstash-collectd-and-avoiding-duplicated-data-in-the-es/52548/2 "2017-07-06T04:53:27Z")

</div>