I query some data from MySql, and then index those data to ElasticSearch.
While the data in MySql is updating (update and insert) all the time, so I
have to update ElasticSearch index accordingly.
I cannot afford to do full index (data is huge), and I should not do that
either. Does ElasticSearch provide any mechanism to simulate incremental
indexing? Or I have to
implement it by myself when importing data from MySql?
Elasticsearch will index or update any document you will send to it.
So get the delta on your side and send documents you want to update to elasticsearch.
Did I misunderstand the question?
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
I query some data from MySql, and then index those data to ElasticSearch.
While the data in MySql is updating (update and insert) all the time, so I have to update ElasticSearch index accordingly.
I cannot afford to do full index (data is huge), and I should not do that either. Does ElasticSearch provide any mechanism to simulate incremental indexing? Or I have to
implement it by myself when importing data from MySql?
David, thanks for your answer. You mean that I have to control what to send
to elasticsearch by myself ?!
I heard that solr can configure delta index, so I'm just looking for a
similar mechanism in elasicsearch.
Thank you one more time.
On Friday, February 21, 2014 2:32:42 PM UTC+8, David Pilato wrote:
Elasticsearch will index or update any document you will send to it.
So get the delta on your side and send documents you want to update to
elasticsearch.
Did I misunderstand the question?
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 21 févr. 2014 à 03:04, Daniel Guo <danie...@gmail.com <javascript:>> a
écrit :
Here is my problem:
I query some data from MySql, and then index those data to Elasticsearch.
While the data in MySql is updating (update and insert) all the time, so I
have to update Elasticsearch index accordingly.
I cannot afford to do full index (data is huge), and I should not do that
either. Does Elasticsearch provide any mechanism to simulate incremental
indexing? Or I have to
implement it by myself when importing data from MySql?
David, thanks for your answer. You mean that I have to control what to send to elasticsearch by myself ?!
I heard that solr can configure delta index, so I'm just looking for a similar mechanism in elasicsearch.
Thank you one more time.
On Friday, February 21, 2014 2:32:42 PM UTC+8, David Pilato wrote:
Elasticsearch will index or update any document you will send to it.
So get the delta on your side and send documents you want to update to elasticsearch.
Did I misunderstand the question?
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
I query some data from MySql, and then index those data to Elasticsearch.
While the data in MySql is updating (update and insert) all the time, so I have to update Elasticsearch index accordingly.
I cannot afford to do full index (data is huge), and I should not do that either. Does Elasticsearch provide any mechanism to simulate incremental indexing? Or I have to
implement it by myself when importing data from MySql?
On Friday, February 21, 2014 6:29:35 PM UTC+8, David Pilato wrote:
Yes.
But you can look at JDBC river although I won't use it in a production env
such as all other rivers.
I prefer to push docs from my legacy application (in real time that is)
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 21 févr. 2014 à 10:12, Daniel Guo <danie...@gmail.com <javascript:>> a
écrit :
David, thanks for your answer. You mean that I have to control what to
send to elasticsearch by myself ?!
I heard that solr can configure delta index, so I'm just looking for a
similar mechanism in elasicsearch.
Thank you one more time.
On Friday, February 21, 2014 2:32:42 PM UTC+8, David Pilato wrote:
Elasticsearch will index or update any document you will send to it.
So get the delta on your side and send documents you want to update to
elasticsearch.
Did I misunderstand the question?
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
I query some data from MySql, and then index those data to Elasticsearch.
While the data in MySql is updating (update and insert) all the time, so
I have to update Elasticsearch index accordingly.
I cannot afford to do full index (data is huge), and I should not do that
either. Does Elasticsearch provide any mechanism to simulate incremental
indexing? Or I have to
implement it by myself when importing data from MySql?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.