# Data duplication happening when using multiple configuration for logstash with different input ports

**URL:** <https://discuss.elastic.co/t/data-duplication-happening-when-using-multiple-configuration-for-logstash-with-different-input-ports/322799>\
**Category:** Logstash\
**Created:** [January 10, 2023, 8:06am UTC](https://discuss.elastic.co/t/data-duplication-happening-when-using-multiple-configuration-for-logstash-with-different-input-ports/322799 "2023-01-10T08:06:41Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![asambasivan](https://avatars.discourse-cdn.com/v4/letter/a/5f8ce5/32.png) [@asambasivan](https://discuss.elastic.co/u/asambasivan)\
**Post date:** [January 10, 2023, 8:06am UTC](https://discuss.elastic.co/t/data-duplication-happening-when-using-multiple-configuration-for-logstash-with-different-input-ports/322799/1 "2023-01-10T08:06:41Z")

</div>

Hello,

We have two logstash configurations with two different input ports 5044 and 5045 for accepting connections, but while the filebeat is sending logs to logstash via port 5045 the data is getting duplicated and we are receiving two copies of the actual data.

Is this an expected behavior, if so then is there any option to mention multiple input ports by using the beats input option.

---

<div class="post-metadata">

**Author:** ![ShubhamKumarJena](https://avatars.discourse-cdn.com/v4/letter/s/b782af/32.png) [@ShubhamKumarJena](https://discuss.elastic.co/u/ShubhamKumarJena)\
**Post date:** [January 10, 2023, 10:22am UTC](https://discuss.elastic.co/t/data-duplication-happening-when-using-multiple-configuration-for-logstash-with-different-input-ports/322799/2 "2023-01-10T10:22:25Z")

</div>

Hey Akhil !

Can you send the filebeat output section from your filebeat.yml ? I hope you are using the in built load-balancer feature of filebeat.

Regards,  
Shubham

---

<div class="post-metadata">

**Author:** ![asambasivan](https://avatars.discourse-cdn.com/v4/letter/a/5f8ce5/32.png) [@asambasivan](https://discuss.elastic.co/u/asambasivan)\
**Post date:** [January 10, 2023, 11:05am UTC](https://discuss.elastic.co/t/data-duplication-happening-when-using-multiple-configuration-for-logstash-with-different-input-ports/322799/3 "2023-01-10T11:05:32Z")

</div>

Currently pointing to a single node out of 3 node cluster of logstash. The moment we start using load balance feature in the output section, the ingestion rate falls down. This again is another issue that's persisting.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 7, 2023, 11:06am UTC](https://discuss.elastic.co/t/data-duplication-happening-when-using-multiple-configuration-for-logstash-with-different-input-ports/322799/4 "2023-02-07T11:06:31Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.