Help import data using log-stash everyday

Elastic Stack Elasticsearch
1

I import the data from oracle db using log stash and add to the index.

everyday we have changes in the data. so, we want to update the index everyday.

what is the best way to add only the docs that have been changed in the elastic search.

But, currently deleting the index every time and creating it new one.

2

I shared most of my thoughts there: http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/

Basically, I'd recommend modifying the application layer if possible and send data to elasticsearch in the same "transaction" as you are sending your data to the database.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.