Read a constantly overwritten file

gringo · February 23, 2017, 9:06am

I am currently reading a log file to parse it and send the parsed fields to elasticsearch.

The problem that I am facing now is that new lines are constantly being appended to the log file. I have ran into situations when Logstash stopped but the log file is still growing. i have re-run logstash in order to start parsing the newly added lines.

agrawalsaurabh · February 23, 2017, 10:15am

I am facing similar challenge where the newly added lines are not getting picked by LOGSTASH.

Also if i add a new log file in the same directory, the newly added log file is not getting picked up.

Any help in this regard is much appreciated.

Thanks.

gringo · February 23, 2017, 10:17am

I am currently reading a file on a mapped network drive which source is a linux file system server

agrawalsaurabh · February 23, 2017, 10:18am

In my case I am simply doing a proof of concept on my laptop which has windows 7 installed. So all software are running on same machine where the log directory is.

gringo · February 23, 2017, 10:21am

The version that I am using is 2.3.4. What version are you using?

agrawalsaurabh · February 23, 2017, 10:23am

filebeat-5.2.0
logstash-5.2.0

system · March 23, 2017, 10:23am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.