How to keep Database and Elasticsearch consistent using Logstash

I have a Relational database, I have used Logstash to migrate my Relational Postgres data to elasticsearch.

Now how can I keep my Database and Elasticsearch Server in sync?

I shared most of my thoughts there: http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/

Basically, I'd recommend modifying the application layer if possible and send data to elasticsearch in the same "transaction" as you are sending your data to the database.

@dadoonet Is there any other way of doing it ?

Did you read my blog? The start of it at least?

@dadoonet Yes I had gone through it earlier. The blog is very helpful. It is great help

I was able to find the solution I used 'record_last_run' to record the last run the logstash and used the scheduler to check for changes in the Database

Awesome.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.