I am using HTTP poller as input and HTTP poller as output.
Using get for input and post for output.
some time records are failure to load in HTTP output.
This failure and reason for failure I am able to see in logstash-json.log file
But daily I am transferring 1 lakh records, In that 20 thousand records are failing to check this I need to go through the full log file and getting the reason for failure each record.
I am thinking if I can see this logs and failure reason in kibana it will easy for me to see exactly failure.
I tried logstash-json.log file as input but I am not getting the exact result, in the log file generated format is different for different failure.
How can I achieve this, Please help me if you have any ideas.....