# I am speaking @HBase Conference 2013 on "Using HBase Coprocessors to Index Columns in an Elasticsearch Cluster" **URL:** \ **Category:** Elasticsearch\ **Created:** [June 5, 2013, 7:57pm UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287 "2013-06-05T19:57:53Z")\ **Posts on this page:** 14\ **Page:** 1
**Author:** ![Dibyendu\_Bhattachary](https://avatars.discourse-cdn.com/v4/letter/d/49beb7/32.png) [@Dibyendu\_Bhattachary](https://discuss.elastic.co/u/Dibyendu_Bhattachary)\ **Post date:** [June 5, 2013, 7:57pm UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/1 "2013-06-05T19:57:53Z")
For more details, see below link : > **[HBaseCon](http://hbase.apache.org/www.hbasecon.com/)** > > HBaseCon is the premier conference for the Apache HBase community—including committers/contributors, developers, operators, learners, and users (including some of those managing the largest deployments in the world). Regards, Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [June 5, 2013, 8:59pm UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/2 "2013-06-05T20:59:17Z")
Sounds interesting. Can you share the slides afterwards? Cheers, Ivan On Wed, Jun 5, 2013 at 12:57 PM, Dibyendu Bhattacharya \< [dibyendu.bhattachary@gmail.com](mailto:dibyendu.bhattachary@gmail.com)\> wrote: > For more details, see below link : > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > Regards, > Dibyendu > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Dibyendu\_Bhattachary](https://avatars.discourse-cdn.com/v4/letter/d/49beb7/32.png) [@Dibyendu\_Bhattachary](https://discuss.elastic.co/u/Dibyendu_Bhattachary)\ **Post date:** [June 5, 2013, 9:24pm UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/3 "2013-06-05T21:24:38Z")
Sure , I will share after the conference. Dibyendu On Wednesday, June 5, 2013 1:57:53 PM UTC-6, Dibyendu Bhattacharya wrote: > For more details, see below link : > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > Regards, > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [June 7, 2013, 10:50am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/4 "2013-06-07T10:50:27Z")
this is great! would love to see if we can generalize it (if its not already...) and integrate it to elasticsearch-Hadoop project! if it is possible, lets start a dicussion on an issue on elasticsearch-Hadoop project. On Wed, Jun 5, 2013 at 9:57 PM, Dibyendu Bhattacharya [dibyendu.bhattachary@gmail.com](mailto:dibyendu.bhattachary@gmail.com) wrote: > ## For more details, see below link : [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) Regards, Dibyendu > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Dibyendu\_Bhattachary](https://avatars.discourse-cdn.com/v4/letter/d/49beb7/32.png) [@Dibyendu\_Bhattachary](https://discuss.elastic.co/u/Dibyendu_Bhattachary)\ **Post date:** [June 8, 2013, 6:09pm UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/5 "2013-06-08T18:09:15Z")
Hi Thanks for showing interest in this idea. It is not yet generalized. But I have a plan to generalize it. We can definitely start discussion on elasticsearch-hadoop issues. I will share my presentation after the HBase Conf so that you will have better idea about this HBase Elasticsearch integration point. Regards, Dibyendu On Friday, June 7, 2013 4:50:27 AM UTC-6, kimchy wrote: > this is great! would love to see if we can generalize it (if its not > already...) and integrate it to elasticsearch-Hadoop project! > > if it is possible, lets start a dicussion on an issue on > elasticsearch-Hadoop project. > > On Wed, Jun 5, 2013 at 9:57 PM, Dibyendu Bhattacharya \< > [dibyendu.b...@gmail.com](mailto:dibyendu.b...@gmail.com) \\> wrote: > > > For more details, see below link : > > > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > > > Regards, > > Dibyendu > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [June 9, 2013, 1:57am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/6 "2013-06-09T01:57:12Z")
I've always wanted to implement this. 🙂 Dibyendu, please consider making an abstraction for the indexer piece, so people can plug other indexing engines, such as Solr(Cloud) in there. Oh, I guess this assumes you will open-source this, but I'm not sure if you are planning on doing that or not? ## Otis ELASTICSEARCH Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) On Wednesday, June 5, 2013 3:57:53 PM UTC-4, Dibyendu Bhattacharya wrote: > For more details, see below link : > > [http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > Regards, > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dancer](https://avatars.discourse-cdn.com/v4/letter/d/e5b9ba/32.png) [@dancer](https://discuss.elastic.co/u/dancer)\ **Post date:** [June 14, 2013, 2:02am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/7 "2013-06-14T02:02:33Z")
where is the ppt? thanks 在 2013年6月6日星期四UTC+8上午3时57分53秒，Dibyendu Bhattacharya写道： > For more details, see below link : > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > Regards, > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Dibyendu\_Bhattachary](https://avatars.discourse-cdn.com/v4/letter/d/49beb7/32.png) [@Dibyendu\_Bhattachary](https://discuss.elastic.co/u/Dibyendu_Bhattachary)\ **Post date:** [June 14, 2013, 3:22am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/8 "2013-06-14T03:22:51Z")
Here is the ppt . HBase Conf will upload the video soon in their website. Dibyendu On Thursday, June 13, 2013 7:02:33 PM UTC-7, dancer wrote: > where is the ppt? thanks > > 在 2013年6月6日星期四UTC+8上午3时57分53秒，Dibyendu Bhattacharya写道： > > > For more details, see below link : > > > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > > > Regards, > > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dancer](https://avatars.discourse-cdn.com/v4/letter/d/e5b9ba/32.png) [@dancer](https://discuss.elastic.co/u/dancer)\ **Post date:** [June 14, 2013, 5:01am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/9 "2013-06-14T05:01:25Z")
thanks 在 2013年6月14日星期五UTC+8上午11时22分51秒，Dibyendu Bhattacharya写道： > Here is the ppt . HBase Conf will upload the video soon in their website. > > Dibyendu > > On Thursday, June 13, 2013 7:02:33 PM UTC-7, dancer wrote: > > > where is the ppt? thanks > > > > 在 2013年6月6日星期四UTC+8上午3时57分53秒，Dibyendu Bhattacharya写道： > > > > > For more details, see below link : > > > > > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > > > > > Regards, > > > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dancer](https://avatars.discourse-cdn.com/v4/letter/d/e5b9ba/32.png) [@dancer](https://discuss.elastic.co/u/dancer)\ **Post date:** [June 14, 2013, 5:59am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/10 "2013-06-14T05:59:05Z")
THANKS for your share, but i have a question. how does it deal with the write failure when writed to hbase success but failed in ES? thanks. 在 2013年6月14日星期五UTC+8上午11时22分51秒，Dibyendu Bhattacharya写道： > Here is the ppt . HBase Conf will upload the video soon in their website. > > Dibyendu > > On Thursday, June 13, 2013 7:02:33 PM UTC-7, dancer wrote: > > > where is the ppt? thanks > > > > 在 2013年6月6日星期四UTC+8上午3时57分53秒，Dibyendu Bhattacharya写道： > > > > > For more details, see below link : > > > > > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > > > > > Regards, > > > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![william\_zhu](https://avatars.discourse-cdn.com/v4/letter/w/e56c9b/32.png) [@william\_zhu](https://discuss.elastic.co/u/william_zhu)\ **Post date:** [June 15, 2013, 2:57am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/11 "2013-06-15T02:57:35Z")
I have the same question as dancer. How could I deal with failures in inserting data to ES or HBase. Retry or RollBack? As we all know, RollBack in HBase or ES dose not easily especially that will happen in concurrent environment. 在 2013年6月14日星期五UTC+8上午11时22分51秒，Dibyendu Bhattacharya写道： > Here is the ppt . HBase Conf will upload the video soon in their website. > > Dibyendu > > On Thursday, June 13, 2013 7:02:33 PM UTC-7, dancer wrote: > > > where is the ppt? thanks > > > > 在 2013年6月6日星期四UTC+8上午3时57分53秒，Dibyendu Bhattacharya写道： > > > > > For more details, see below link : > > > > > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > > > > > Regards, > > > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![11120](https://avatars.discourse-cdn.com/v4/letter/1/ecb155/32.png) [@11120](https://discuss.elastic.co/u/11120)\ **Post date:** [June 15, 2013, 6:50am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/12 "2013-06-15T06:50:39Z")
hi, Dibyendu Nice to know your practice. We hope to build secondaryindex and search on HBase with Elasticsearch, and we are working on this. Could you share your experience when ES cluster getting big? the problems / bugs you encountered? is ES stable and high-performance in large-scale data? On Thursday, June 6, 2013 3:57:53 AM UTC+8, Dibyendu Bhattacharya wrote: > For more details, see below link : > > [HBaseCon](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > Regards, > Dibyendu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [June 15, 2013, 12:38pm UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/13 "2013-06-15T12:38:49Z")
Hello, We do Elasticsearch consulting all the time (see sig) and some of of clients have multi-billion document indices with high index and/or query rates. It's stable and works well most of the time. Like anything else, it has its quirks and requires some learning. We've seen our ES customers having issues with split brain and there are a couple of oldish issues open where others are reporting seeing the same. I imagine/hope ES is working on fixing this. ## Otis Performance Monitoring -- [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html) Solr & Elasticsearch Support -- [http://sematext.com/](http://sematext.com/) On Jun 15, 2013 2:50 AM, "伍照坤" [tonywutao@gmail.com](mailto:tonywutao@gmail.com) wrote: > hi, Dibyendu > > Nice to know your practice. > > We hope to build secondaryindex and search on HBase with Elasticsearch, > and we are working on this. > > Could you share your experience when ES cluster getting big? the problems > / bugs you encountered? is ES stable and high-performance in large-scale > data? > > On Thursday, June 6, 2013 3:57:53 AM UTC+8, Dibyendu Bhattacharya wrote: > > > For more details, see below link : > > > > [http://www.hbasecon.com/\*\*sessions/using-coprocessors-\*\*to-index-columns/](http://www.hbasecon.com/ **sessions/using-coprocessors-** to-index-columns/)[http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/](http://www.hbasecon.com/sessions/using-coprocessors-to-index-columns/) > > > > Regards, > > Dibyendu > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/quUP1srwMtA/unsubscribe](https://groups.google.com/d/topic/elasticsearch/quUP1srwMtA/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:31am UTC](https://discuss.elastic.co/t/i-am-speaking-hbase-conference-2013-on-using-hbase-coprocessors-to-index-columns-in-an-elasticsearch-cluster/12287/14 "2017-07-06T02:31:04Z")