I am running logstash from command prompt, Logstash reads CSV files from S3 bucket, I keep up and running command prompt for logstash because we are uploading CSV files frequently in a day, I am getting below error after couple of hours, And i am assuming that it might be reason "logstash missing some logs to process and sent data to elastic search".
Note: I am not running logstash as service in my windows box,
Error Message:
31mA plugin had an unrecoverable error. Will restart this plugin.
Logstash input:
input
{
s3
{
access_key_id => "XXXXX"
secret_access_key => "XXXXXXXXXXXXXXXXXX"
region => "XX"
bucket => "XXXXXXXXXXXXXXXXXX"
prefix => "XXXXXXXXXXXXXXXXXX"
delete => false
interval => 1 # seconds
sincedb_path => "C:/Test/logstash/aa.sincedb"
}
}