Hello guys,
I have deployed logstash to push data from postgres to elasticsearch but as the quantity of data has increased, pushing thousands of rows(all data in that db) every 60 seconds just for a small change or addition of a new row seems less correct and more resource wastage( intensive also). I want to find out whether it is possible to push only event based data where the event could a new row in db and pushing that particular row only to es instead of polling and pushing all the data every 60 seconds?
Thanks