Looks like when change redis input plugin threads, it duplicate message exactly the same n times
this is in the redis-cli, only 1 record
redis-cli -h 127.0.0.1 PSUBSCRIBE ssh | grep 58.218.198.142
2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
with thread 16, I have exactly 16 times same message
2017-07-14T05:57:11.359Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.359Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.359Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.359Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.359Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
2017-07-14T05:57:11.360Z %{host} 2017-07-14T05:57:11+00:00 refused connect from 58.218.198.142 (58.218.198.142)
conf:
input {
redis {
host => "127.0.0.1"
data_type => "pattern_channel"
key => "sshd"
threads => 16
codec => "plain"
}
}
output {
stdout { }
}