I have a Relational database, I have used Logstash to migrate my Relational Postgres data to elasticsearch.
Now how can I keep my Database and Elasticsearch Server in sync?
I have a Relational database, I have used Logstash to migrate my Relational Postgres data to elasticsearch.
Now how can I keep my Database and Elasticsearch Server in sync?
I shared most of my thoughts there: http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/
Basically, I'd recommend modifying the application layer if possible and send data to elasticsearch in the same "transaction" as you are sending your data to the database.
@dadoonet Is there any other way of doing it ?
Did you read my blog? The start of it at least?
@dadoonet Yes I had gone through it earlier. The blog is very helpful. It is great help
I was able to find the solution I used 'record_last_run' to record the last run the logstash and used the scheduler to check for changes in the Database
Awesome.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.