# Getting duplicate Log entries in Redis

**URL:** <https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650>\
**Category:** Logstash\
**Created:** [July 4, 2016, 12:25pm UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650 "2016-07-04T12:25:35Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![gayathri](https://avatars.discourse-cdn.com/v4/letter/g/838e76/32.png) [@gayathri](https://discuss.elastic.co/u/gayathri)\
**Post date:** [July 4, 2016, 12:25pm UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/1 "2016-07-04T12:25:35Z")

</div>

Hi Team,

When I am trying to push the real time transaction logs to Redis server, redis recieves two copies of each log in production.....

I checked the conf.d folder, there was two config files...  
But when I tried to recreate the same on Development environment inorder to check the working, Its not happening... I have recreated by keeping more than one conf file in conf.d folder.  
But the Logs are pushing Normally....What could be the reason for duplicate entries in Production?

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [July 4, 2016, 12:49pm UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/2 "2016-07-04T12:49:56Z")

</div>

For chances of getting help I suggest you move this topic to the Logstash category since it's unrelated to the deprecated logstash-forwarder software.

Logstash will read _all_ files in /etc/logstash/conf.d. What was in your two files? Did you have two redis outputs?

---

<div class="post-metadata">

**Author:** ![gayathri](https://avatars.discourse-cdn.com/v4/letter/g/838e76/32.png) [@gayathri](https://discuss.elastic.co/u/gayathri)\
**Post date:** [July 5, 2016, 4:56am UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/3 "2016-07-05T04:56:16Z")

</div>

Hi,

I am getting two entries of same log on appenonly.aof of Redis....  
So how we can assume its related to Logstash, since redis comes before Logstash...

Thanks,  
Gayathri

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [July 5, 2016, 6:12am UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/4 "2016-07-05T06:12:17Z")

</div>

So what pushes the events to Redis?

---

<div class="post-metadata">

**Author:** ![gayathri](https://avatars.discourse-cdn.com/v4/letter/g/838e76/32.png) [@gayathri](https://discuss.elastic.co/u/gayathri)\
**Post date:** [July 5, 2016, 7:13am UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/5 "2016-07-05T07:13:54Z")

</div>

Logstash Forwader.....

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [July 5, 2016, 7:17am UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/6 "2016-07-05T07:17:42Z")

</div>

The logstash-forwarder software, [https://github.com/elastic/logstash-forwarder](https://github.com/elastic/logstash-forwarder), doesn't support Redis output. You're probably running Logstash, in which case my previous questions still apply and remain unanswered.

---

<div class="post-metadata">

**Author:** ![gayathri](https://avatars.discourse-cdn.com/v4/letter/g/838e76/32.png) [@gayathri](https://discuss.elastic.co/u/gayathri)\
**Post date:** [July 8, 2016, 6:15am UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/7 "2016-07-08T06:15:53Z")

</div>

Hi magnus,

Now its working fine, deleted extra files from conf.d folder

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:48am UTC](https://discuss.elastic.co/t/getting-duplicate-log-entries-in-redis/54650/8 "2017-07-06T04:48:57Z")

</div>


