I am using logstash with scheduling to load data from database to ElasticSearch daily, now I have a script that will do some machine learning stuff on my index, how can I call a python script whenever an index is updated or schedule a python script to run daily? I was reading: ES Python docs though …

Well, short of an Elasticsearch plugin there's no way to hook into each batch of documents (if that's even the correct trigger in your case). You could e.g. have a cron job that runs periodically but terminates immediately if nothing has happened since the last execution.

Call a python script from ElasticSearch daily

Elastic Stack Logstash

aashishgahlawat (Aashish Gahalwat) August 31, 2018, 2:14pm 9

Also there is no way to exec only once as mentioned by ES Community Here

Topic		Replies	Views
How to invoke python script from elasticsearc output plugin Logstash	1	1617	November 15, 2017
Is there a way to bulk upload without logstash - tried elasticsearch-py and stuck Elasticsearch	2	867	May 8, 2017
Logstash: call native script in elastic? Logstash	3	628	July 6, 2017
How to call python script from Logstash to process (partialy) logs Logstash	6	22366	July 6, 2017
Is it possible to call a python script in logstash? Logstash	2	199	April 13, 2023

Call a python script from ElasticSearch daily

Related topics