Monitoring files in a directory


(rohit) #1

Hi,

I have a directory where files are being written really quick. Is there a way i can access the newly written file to that directory and then pass the information to elasticsearch.


(David Pilato) #2

Did you really mean to post this in #elasticsearch:rally?

What kind of files are they?


(rohit) #3

These files are my system logs files and there are number of files that gets generated based on timestamp. so i want to read the newly created file extract the data out of it and send the data to elasticsearch database.


(David Pilato) #4

Ok so I'm moving your question to #beats:filebeat.


(Adrian Serrano) #5

I suggest you try filebeat with a low value (1s) for the scan_frequency parameter.

It is important that you familiarise yourself with the settings for filebeat so you can tune it for your use case. Specially the close_* and clean_* parameters.


(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.