How to monitor LOGSTASH logs in Kibana

Elastic Stack Logstash
1

I am using HTTP poller as input and HTTP poller as output.
Using get for input and post for output.

some time records are failure to load in HTTP output.

This failure and reason for failure I am able to see in logstash-json.log file

But daily I am transferring 1 lakh records, In that 20 thousand records are failing to check this I need to go through the full log file and getting the reason for failure each record.

I am thinking if I can see this logs and failure reason in kibana it will easy for me to see exactly failure.

I tried logstash-json.log file as input but I am not getting the exact result, in the log file generated format is different for different failure.

How can I achieve this, Please help me if you have any ideas.....

2

I tried logstash-json.log file as input but I am not getting the exact result, in the log file generated format is different for different failure.

Please explain this in greater detail and with examples. Are the JSON strings really that different? What are the differences between different kinds of failures?

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.