Files skipped in logstash but contained in Sincedb file

Elastic Stack Logstash
1

Hello,

My current setup reads gz files from coolpath and forwards them to elasticsearch.

However there are files being left behind in coolpath.

input {
  file {
    id => "my-id"
    path => "/coolpath/*.gz"
    mode => "read"
    sincedb_path => "/home/ftpuser/logstash.sdb"
    file_completed_action => "log_and_delete"
    file_completed_log_path => "/home/ftpuser/logstash.completed"
    sincedb_clean_after => 0.00069445
    file_sort_by => "path"
    discover_interval => 3
    stat_interval => 10
  }
}

These files do have entries inside of the sincedb file however..cat /home/ftpuser/logstash.sdb | grep 202005182003-3411.gz 134217875 0 2058 27050917 1589832337.023037 /home/ftpuser/tdr/input/rta-coll-rta1/local/202005182003-3411.gz.

Unsure how to go about remedying this.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.