# Data base Synchronize with elastic search in real time **URL:** \ **Category:** Elasticsearch\ **Created:** [February 16, 2018, 2:11pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192 "2018-02-16T14:11:04Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![dnguptha](https://avatars.discourse-cdn.com/v4/letter/d/f0a364/32.png) [@dnguptha](https://discuss.elastic.co/u/dnguptha)\ **Post date:** [February 16, 2018, 2:11pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/1 "2018-02-16T14:11:04Z")
Hi, I am new to elastic search, the data being inserted into the database I wanna load the data into elastic search. when new record has being inserted into database elastic search has to Synchronize with DB automatically. I was using DB2 what wil be the best practice. ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [February 16, 2018, 2:31pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/2 "2018-02-16T14:31:04Z")
I shared my thoughts there: [http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/](http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/) ---
**Author:** ![dnguptha](https://avatars.discourse-cdn.com/v4/letter/d/f0a364/32.png) [@dnguptha](https://discuss.elastic.co/u/dnguptha)\ **Post date:** [February 19, 2018, 11:10am UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/3 "2018-02-19T11:10:08Z")
Thank you, David. I need to synch elastic search because the data inserting into database is not form my application. It's from the Sterling Integrator so i need to sysnc it so could you suggest me the the best aproach. ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [February 19, 2018, 11:35am UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/4 "2018-02-19T11:35:02Z")
Then you need to use/build something which reads the database, transform to JSON and write to elasticsearch. - An ETL like Logstash with the `jdbc-input-plugin` - Your own code Then you can run that every 5 minutes for instance but as I explained, you have to deal with many things: - It's not real-time - You need a way to select data that changed since the last run. Probably it relies on a date field in your DB entities - You need to deal with Deletes. You need for that a specific technical table in your DB probably. Or you can choose to reindex the full database everytime. Be careful with the time it will take to read entities from your DB. May be you can do such a thing only once per day. May be you can play with DB triggers though to "wake up" your code. ---
**Author:** ![dnguptha](https://avatars.discourse-cdn.com/v4/letter/d/f0a364/32.png) [@dnguptha](https://discuss.elastic.co/u/dnguptha)\ **Post date:** [February 19, 2018, 4:10pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/5 "2018-02-19T16:10:27Z")
Thank you very much, David, I in some other blog I have seen using logstash I can load the data into the elasticsearch all at once. but I want to load the data when a new record has been inserted only the new record has to load into ES. It's a kind of trigger or something. Do I Have an option as I needed? ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [February 19, 2018, 4:26pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/6 "2018-02-19T16:26:44Z")
Anything which looks like a trigger basically depends from your database vendor. For example, CouchDB has this super nice changes API which streams changes over the wire. I don't know if something similar can exist in your DB. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [March 19, 2018, 4:26pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192/7 "2018-03-19T16:26:59Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.