Process same file multiple times

Elastic Stack Logstash
1

Hi there,

I am using logsatsh to parse our dataloading logs, which are text files but contains dynamic contents (not syslog nor apache), though for debugging i need to test the config settings i had to read this file (i.e. 201845.txt) few times, but log stash generates output file if i process file "201845.txt" for the first time, if i changed the config file and run again for same exact "201845.txt", there is not output file generated!!!! does logstash cache 201845 somewhere that does not allow to run config file against it few times?

2

It's due to https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html#_tracking_of_current_position_in_watched_files

Look at sincedb settings and other threads on that topic :slight_smile:

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.