I have tried many ways but still not able to get it work
basically, i have logstash to watching one folder and load into ES with read model
path => [
type => "stp"
tags => ["aa"]
mode => "read"
file_completed_action => "delete"
sincedb_clean_after => "2 min"
sincedb_path => "/env/.csvstp"
so first time when i load file aa.csv into the folder it get processed and file been deleted. this is expected
later i put different content into aa.csv and copy to /tm/ folder again, but logstash is not processing unless i restart and clear sincedb file.
I have tried to use sincedb to /dev/null, but it will only process file after restart logstash
is there anyway i can make it
- automatically process the file from /tmp/*csv
- delete it after process
- load the file again if the files with same filename copy to /tmp/ folder