Logstash keeps nonstop indexing data from redis to elasticsearch


(Daulet) #1

Hi. I am having troubles at indexing logs from
Redis, which takes data from log file as an input.(i.e. trying to
use shipper to Redis).

shipper.conf
input{
file{
type => "filelog"
path => ["directory/to/logfile/search.log","directory/to/log/file"]
}
}
filter{

}
output{
redis{
host => "redishost:6379"
data_type => "list"
key => "logstash"
codec => json
}
}

logsss.conf
input {
redis {
host => "redishost"
key => "logstash"
data_type => "list"
codec => json
type => "redis"
tags => ["redis"]
}
}
output {
elasticsearch {
hosts => ["elastichost:9200"]
sniffing => false
manage_template => false
index => "test"
document_type => "first"
}
}


(Daulet) #2

The issue was in the key of data. We must use static names , should use static(for example, type => "logstash%{type}").
Logstash can't blpop static named keys


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.