REDIS and LOGSTASH communication monitoring


#1

Hello, I'm using the configuration Logstash in one machine as a shipper and in other machine I have REDIS with logstash, elasticsearch and Kibana.
I would like to see how Redis comunicate with logstash in the second machine.
The connection between logstash shipper is made using the port 6379 (default configuration), but what about the connection between redis output and the second logstash? how could I see the messages that logstash is receiving from the redis input ?

I have tried using output{ file{...} elasticsearch{....} } but if I'm not mistaken, as far as I have seen this is made with 2 different workers (threads) and for that reason I don't have in the file all the messages that has been received in elasticsearch.


(Magnus B├Ąck) #2

I have tried using output{ file{...} elasticsearch{....} } but if I'm not mistaken, as far as I have seen this is made with 2 different workers (threads) and for that reason I don't have in the file all the messages that has been received in elasticsearch.

Unless you wrap outputs in conditionals all outputs receive all messages.


#3

Hi @magnusbaeck! Thank you for your response.
But not in my case...I have this output configuration :

output {
   elasticsearch
     {
        cluster => "logstash"
        host => "127.0.0.1"
        index => "logstash-zzzzz-%{+YYYY.MM.dd.HH.mm}"
      }

  file{
      path => "/etc/elk/logout/OUT-%{+YYYY.MM.dd.HH.mm}.log"
    }
 }

In have sent 10 messages, in elasticsearch I can see the 10 messages from elasticsearch head>

but in the output file I only have one message
{"message":"2015/11/26 09:15:59.360 .......}

How could I solve it?


(system) #4