# Need help for Hadoop and ES integration **URL:** \ **Category:** Elasticsearch\ **Created:** [April 3, 2014, 9:36am UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783 "2014-04-03T09:36:24Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Chetana](https://avatars.discourse-cdn.com/v4/letter/c/dbc845/32.png) [@Chetana](https://discuss.elastic.co/u/Chetana)\ **Post date:** [April 3, 2014, 9:36am UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/1 "2014-04-03T09:36:24Z")
I have downloaded elasticsearch-hadoop-1.2.0.jar from github and trying to search. The code to search looks like * * * Configuration conf = new Configuration(); conf.set("es.nodes", "localhost"); conf.set("es.port", "9200"); conf.set("es.resource", "test\_index/test\_mapping"); conf.set("es.query", "{"query":{"term":{"test.field1":"test"}}}"); Job job = Job.getInstance(conf); job.setJobName(ESIndexContoller.class.getSimpleName()); job.setJarByClass(ESIndexContoller.class); job.setInputFormatClass(EsInputFormat.class); job.setOutputFormatClass(EsOutputFormat.class); job.setOutputKeyClass(Text.class); job.setOutputValueClass(MapWritable.class); job.setSpeculativeExecution(false); job.waitForCompletion(true); * * * I have hadoop 2.2 from hortonworks and ES 0.90.2. But when I run 'hadoop jar' command it throws 'IllegalStateException: Job in state DEFINE instead of RUNNING' I believe one needs to create custom Mapper and Reducer. If so, can someone tell me how the code should look like inside map() and reduce() Thanks, -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c70d3f45-27a7-4f38-9615-7cce19c956c4%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c70d3f45-27a7-4f38-9615-7cce19c956c4%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [April 3, 2014, 9:45am UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/2 "2014-04-03T09:45:59Z")
You are using the wrong version of elasticserach-hadoop. Double check the docs [1]. P.S. I recommend upgrading to the latest ES 0.90 (or 1.1.0 even). And if possible, using the latest snapshot of master - downloadable through maven [2] (note there's no need for using the yarn classifier in that case, there's only one jar that works across both Hadoop 1 and 2). Cheers, [1] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/index.html) [2] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/install.html) On 4/3/14 12:36 PM, Chetana wrote: > I have downloaded elasticsearch-hadoop-1.2.0.jar from github and trying to search. The code to search looks like > > * * * > > Configuration conf = new Configuration(); > conf.set("es.nodes", "localhost"); > conf.set("es.port", "9200"); > conf.set("es.resource", "test\_index/test\_mapping"); > conf.set("es.query", "{"query":{"term":{"test.field1":"test"}}}"); > Job job = Job.getInstance(conf); > job.setJobName(ESIndexContoller.class.getSimpleName()); > job.setJarByClass(ESIndexContoller.class); > > job.setInputFormatClass(EsInputFormat.class); > job.setOutputFormatClass(EsOutputFormat.class); > job.setOutputKeyClass(Text.class); > job.setOutputValueClass(MapWritable.class); > job.setSpeculativeExecution(false); > job.waitForCompletion(true); > > * * * > > I have hadoop 2.2 from hortonworks and ES 0.90.2. But when I run 'hadoop jar' command it throws 'IllegalStateException: > Job in state DEFINE instead of RUNNING' > I believe one needs to create custom Mapper and Reducer. If so, can someone tell me how the code should look like inside > map() and reduce() > Thanks, > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/c70d3f45-27a7-4f38-9615-7cce19c956c4%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c70d3f45-27a7-4f38-9615-7cce19c956c4%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/c70d3f45-27a7-4f38-9615-7cce19c956c4%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c70d3f45-27a7-4f38-9615-7cce19c956c4%40googlegroups.com?utm_medium=email&utm_source=footer). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > -- > Costin -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/533D2DD7.4030802%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/533D2DD7.4030802%40gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![M\_20](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/m_20/32/1371_2.png) [@M\_20](https://discuss.elastic.co/u/M_20)\ **Post date:** [July 25, 2014, 8:10pm UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/3 "2014-07-25T20:10:20Z")
Hi Chetana, Could you please share with me a java sample code of Map/reduce on Elastcisearch-Hadoop? Regards On Thursday, April 3, 2014 4:36:24 AM UTC-5, Chetana wrote: > I have downloaded elasticsearch-hadoop-1.2.0.jar from github and trying to > search. The code to search looks like > > * * * > > Configuration conf = new Configuration(); > conf.set("es.nodes", "localhost"); > conf.set("es.port", "9200"); > conf.set("es.resource", "test\_index/test\_mapping"); > conf.set("es.query", > "{"query":{"term":{"test.field1":"test"}}}"); > Job job = Job.getInstance(conf); > job.setJobName(ESIndexContoller.class.getSimpleName()); > job.setJarByClass(ESIndexContoller.class); > > job.setInputFormatClass(EsInputFormat.class); > job.setOutputFormatClass(EsOutputFormat.class); > job.setOutputKeyClass(Text.class); > job.setOutputValueClass(MapWritable.class); > job.setSpeculativeExecution(false); > job.waitForCompletion(true); > > * * * > > I have hadoop 2.2 from hortonworks and ES 0.90.2. But when I run 'hadoop > jar' command it throws 'IllegalStateException: Job in state DEFINE instead > of RUNNING' > > I believe one needs to create custom Mapper and Reducer. If so, can > someone tell me how the code should look like inside map() and reduce() > > Thanks, -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [July 25, 2014, 8:25pm UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/4 "2014-07-25T20:25:02Z")
M\_20, I've already replied to your initial query on where you can find some example - the official docs: > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. There's also google which points to other resources outside Elasticsearch. On Fri, Jul 25, 2014 at 11:10 PM, M\_20 [rastegar.83@gmail.com](mailto:rastegar.83@gmail.com) wrote: > Hi Chetana, > > Could you please share with me a java sample code of Map/reduce on > Elastcisearch-Hadoop? > > Regards > > On Thursday, April 3, 2014 4:36:24 AM UTC-5, Chetana wrote: > > > I have downloaded elasticsearch-hadoop-1.2.0.jar from github and trying > > to search. The code to search looks like > > > > * * * > > > > Configuration conf = new Configuration(); > > conf.set("es.nodes", "localhost"); > > conf.set("es.port", "9200"); > > conf.set("es.resource", "test\_index/test\_mapping"); > > conf.set("es.query", "{"query":{"term":{"test. > > field1":"test"}}}"); > > Job job = Job.getInstance(conf); > > job.setJobName(ESIndexContoller.class.getSimpleName()); > > job.setJarByClass(ESIndexContoller.class); > > > > job.setInputFormatClass(EsInputFormat.class); > > job.setOutputFormatClass(EsOutputFormat.class); > > job.setOutputKeyClass(Text.class); > > job.setOutputValueClass(MapWritable.class); > > job.setSpeculativeExecution(false); > > job.waitForCompletion(true); > > > > * * * > > > > I have hadoop 2.2 from hortonworks and ES 0.90.2. But when I run 'hadoop > > jar' command it throws 'IllegalStateException: Job in state DEFINE instead > > of RUNNING' > > > > I believe one needs to create custom Mapper and Reducer. If so, can > > someone tell me how the code should look like inside map() and reduce() > > > > Thanks, > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAJogdmefELVCohXiJQJOJFyPHfEw%3DPYSLivA9ULrKHd6TxGC4A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAJogdmefELVCohXiJQJOJFyPHfEw%3DPYSLivA9ULrKHd6TxGC4A%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![M\_20](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/m_20/32/1371_2.png) [@M\_20](https://discuss.elastic.co/u/M_20)\ **Post date:** [July 25, 2014, 9:19pm UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/5 "2014-07-25T21:19:14Z")
Costin, Thank you for your reply. I've read the official docs before. But it seems I am missing something. So, I wanted to see a complete example to make sure I am understanding ES-hadoop correctly. For example, in the official docs, it talks about writing data to ES, and this is the mapper ///////////////////////////////////// public void map(Object key, Object value, OutputCollector output, Reporter reporter) throws IOException { // create the MapWritable object MapWritable doc = new MapWritable(); ... // write the result to the output collector // one can pass whatever value to the key; EsOutputFormat ignores it output.collect(NullWritable.get(), map); }} ///////////////////////////////////// Could you please tell me what's map in output.collect(NullWritable.get(), map); Also, could you please tell me a little bit about "MapWritable doc"? How its format should be? Regards On Friday, July 25, 2014 3:25:21 PM UTC-5, Costin Leau wrote: > M\_20, I've already replied to your initial query on where you can find > some example - the official docs: > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/mapreduce.html) > There's also google which points to other resources outside Elasticsearch. > > On Fri, Jul 25, 2014 at 11:10 PM, M\_20 \<[raste...@gmail.com](mailto:raste...@gmail.com) \\> > wrote: > > > Hi Chetana, > > > > Could you please share with me a java sample code of Map/reduce on > > Elastcisearch-Hadoop? > > > > Regards > > > > On Thursday, April 3, 2014 4:36:24 AM UTC-5, Chetana wrote: > > > > > I have downloaded elasticsearch-hadoop-1.2.0.jar from github and trying > > > to search. The code to search looks like > > > > > > * * * > > > > > > Configuration conf = new Configuration(); > > > conf.set("es.nodes", "localhost"); > > > conf.set("es.port", "9200"); > > > conf.set("es.resource", "test\_index/test\_mapping"); > > > conf.set("es.query", "{"query":{"term":{"test. > > > field1":"test"}}}"); > > > Job job = Job.getInstance(conf); > > > job.setJobName(ESIndexContoller.class.getSimpleName()); > > > job.setJarByClass(ESIndexContoller.class); > > > > > > job.setInputFormatClass(EsInputFormat.class); > > > job.setOutputFormatClass(EsOutputFormat.class); > > > job.setOutputKeyClass(Text.class); > > > job.setOutputValueClass(MapWritable.class); > > > job.setSpeculativeExecution(false); > > > job.waitForCompletion(true); > > > > > > * * * > > > > > > I have hadoop 2.2 from hortonworks and ES 0.90.2. But when I run 'hadoop > > > jar' command it throws 'IllegalStateException: Job in state DEFINE instead > > > of RUNNING' > > > > > > I believe one needs to create custom Mapper and Reducer. If so, can > > > someone tell me how the code should look like inside map() and reduce() > > > > > > Thanks, > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/377ea0b8-ea98-4a38-9f83-a58849135667%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/377ea0b8-ea98-4a38-9f83-a58849135667%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [July 26, 2014, 10:25am UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/6 "2014-07-26T10:25:16Z")
Quoting from the same docs again: "EsOutputFormat expects a Map\ representing a _document_ value that is converted interally into a JSON document and indexed in Elasticsearch. Hadoop OutputFormat requires implementations to expect a key and a value however, since for Elasticsearch only the document (that is the value) is necessary, EsOutputFormat ignores the key." As for MapWritable, it's Hadoop Map implementation - other than that, it's just a map. It's not something es-hadoop provides but rather Hadoop. I recommend spending some time getting familiar with Hadoop since es-hadoop leverages many of its classes and concepts; after all it's a dedicated 'connector' to Elasticsearch for Hadoop. P.S. In the future, please don't `hijack` old threads but rather start your own - it's easier for everyone. On Sat, Jul 26, 2014 at 12:19 AM, M\_20 [rastegar.83@gmail.com](mailto:rastegar.83@gmail.com) wrote: > Costin, > > Thank you for your reply. I've read the official docs before. But it seems > I am missing something. So, I wanted to see a complete example to make sure > I am understanding ES-hadoop correctly. > For example, in the official docs, it talks about writing data to ES, and > this is the mapper > > ///////////////////////////////////// > > public void map(Object key, Object value, OutputCollector output, > Reporter reporter) throws IOException { > // create the MapWritable object > MapWritable doc = new MapWritable(); > ... > // write the result to the output collector > // one can pass whatever value to the key; EsOutputFormat ignores it > output.collect(NullWritable.get(), map); > }} > ///////////////////////////////////// > > Could you please tell me what's map in > output.collect(NullWritable.get(), map); > > Also, could you please tell me a little bit about "MapWritable doc"? How its format should be? > > Regards > > On Friday, July 25, 2014 3:25:21 PM UTC-5, Costin Leau wrote: > > > M\_20, I've already replied to your initial query on where you can find > > some example - the official docs: > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/) > > current/mapreduce.html > > There's also google which points to other resources outside Elasticsearch. > > > > On Fri, Jul 25, 2014 at 11:10 PM, M\_20 [raste...@gmail.com](mailto:raste...@gmail.com) wrote: > > > > > Hi Chetana, > > > > > > Could you please share with me a java sample code of Map/reduce on > > > Elastcisearch-Hadoop? > > > > > > Regards > > > > > > On Thursday, April 3, 2014 4:36:24 AM UTC-5, Chetana wrote: > > > > > > > I have downloaded elasticsearch-hadoop-1.2.0.jar from github and trying > > > > to search. The code to search looks like > > > > > > > > * * * > > > > > > > > Configuration conf = new Configuration(); > > > > conf.set("es.nodes", "localhost"); > > > > conf.set("es.port", "9200"); > > > > conf.set("es.resource", "test\_index/test\_mapping"); > > > > conf.set("es.query", "{"query":{"term":{"test. > > > > field1":"test"}}}"); > > > > Job job = Job.getInstance(conf); > > > > job.setJobName(ESIndexContoller.class.getSimpleName()); > > > > job.setJarByClass(ESIndexContoller.class); > > > > > > > > job.setInputFormatClass(EsInputFormat.class); > > > > job.setOutputFormatClass(EsOutputFormat.class); > > > > job.setOutputKeyClass(Text.class); > > > > job.setOutputValueClass(MapWritable.class); > > > > job.setSpeculativeExecution(false); > > > > job.waitForCompletion(true); > > > > > > > > * * * > > > > > > > > I have hadoop 2.2 from hortonworks and ES 0.90.2. But when I run > > > > 'hadoop jar' command it throws 'IllegalStateException: Job in state DEFINE > > > > instead of RUNNING' > > > > > > > > I believe one needs to create custom Mapper and Reducer. If so, can > > > > someone tell me how the code should look like inside map() and reduce() > > > > > > > > Thanks, > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > > > msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116% > > > [40googlegroups.com](http://40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c54ca61b-26d8-4cad-91ee-80552ae13116%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/377ea0b8-ea98-4a38-9f83-a58849135667%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/377ea0b8-ea98-4a38-9f83-a58849135667%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/377ea0b8-ea98-4a38-9f83-a58849135667%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/377ea0b8-ea98-4a38-9f83-a58849135667%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAJogdmd-4CZSPdrRxr%3DS\_J7SgvUP7%2BusqeN0XMASh18CBpc2Mw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAJogdmd-4CZSPdrRxr%3DS_J7SgvUP7%2BusqeN0XMASh18CBpc2Mw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:12am UTC](https://discuss.elastic.co/t/need-help-for-hadoop-and-es-integration/16783/7 "2017-07-06T01:12:57Z")