# Duplicate field entries - multiple times even! **URL:** \ **Category:** Logstash\ **Created:** [May 12, 2015, 10:38am UTC](https://discuss.elastic.co/t/duplicate-field-entries-multiple-times-even/543 "2015-05-12T10:38:38Z")\ **Posts on this page:** 2\ **Page:** 1
**Author:** ![JeremyinNC](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jeremyinnc/32/44868_2.png) [@JeremyinNC](https://discuss.elastic.co/u/JeremyinNC)\ **Post date:** [May 12, 2015, 10:38am UTC](https://discuss.elastic.co/t/duplicate-field-entries-multiple-times-even/543/1 "2015-05-12T10:38:39Z")
So far I have ~300 hosts forwarding their log4j and syslogs to Logstash, along with a handful of other log types. The log4j filters are kind of ugly and I think may be related to my problem. It started happening when I added Redis inline, right now the flow is Logstash Forwarder \> Logstash \> Redis \> Logstash with two boxes running Logstash & Redis (because sending logs directly to logstash with out redis was crashing the Logstash Forwarder input after a time). It's almost like break\_on\_match is not set - but there are times when it's even seeing the same log line multiple times, not just the field. So for timestamp (not @timestamp) XXX I will have multiple entries where (for instance) timestamp = [XXX, XXX, XXX] log\_level = [ERROR, ERROR, ERROR] and then timestamp = [XXX, XXX, XXX, XXX] log\_level = [ERROR, ERROR, ERROR, ERROR] even though the message is the same for both entries [Example of results](https://gist.github.com/JeremyShort/0de2900f1455191264c1) [Logstash configs](https://gist.github.com/JeremyShort/227ba4a3b768eccde859) [Logstash forwarder config](https://gist.github.com/JeremyShort/893ad2e07540af044517) Sorry, the logstash config is really ugly, I need to break out the grok filters but in this case they may be pertinent. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 5:40am UTC](https://discuss.elastic.co/t/duplicate-field-entries-multiple-times-even/543/2 "2017-07-06T05:40:00Z")