Monitoring files in a directory

(rohit) #1


I have a directory where files are being written really quick. Is there a way i can access the newly written file to that directory and then pass the information to elasticsearch.

(David Pilato) #2

Did you really mean to post this in #elasticsearch:rally?

What kind of files are they?

(rohit) #3

These files are my system logs files and there are number of files that gets generated based on timestamp. so i want to read the newly created file extract the data out of it and send the data to elasticsearch database.

(David Pilato) #4

Ok so I'm moving your question to #beats:filebeat.

(Adrian Serrano) #5

I suggest you try filebeat with a low value (1s) for the scan_frequency parameter.

It is important that you familiarise yourself with the settings for filebeat so you can tune it for your use case. Specially the close_* and clean_* parameters.

(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.