Notification on successful load of data to elasticsearch

I need some help on one of the use case I am working on..

Basically, Its a simple use case where, log stash is reading data from the csv file from a directory and loading into the elastic search. Every time when there is a new file available in directory, it will be loaded to the same index. So input is the file and output is the elastic search.

Now I have a separate piece of python script , which I want to be executed , upon every successful load of data into elastic search.

Is there any listener available in logstash or elastic search, which the python script can listen to, and starts its execution. Or if there is any way, a SNS topic can be used, which can be used to notify the python script.

Any help would be greatly appreciated

Take a look at https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html#plugins-inputs-file-mode

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.