# Is it beneficial to use ES-Hadoop over ES when you are not an hadoop user already? **URL:** \ **Category:** Elasticsearch\ **Created:** [July 29, 2014, 3:34pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951 "2014-07-29T15:34:47Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![im\_khosravi](https://avatars.discourse-cdn.com/v4/letter/i/f05b48/32.png) [@im\_khosravi](https://discuss.elastic.co/u/im_khosravi)\ **Post date:** [July 29, 2014, 3:34pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951/1 "2014-07-29T15:34:47Z")
Dear all I have a question in my mind about es-hadoop and it's benefits over running ES lonely. The question is if we are not a hadoop user already, is this a good idea to use es-hadoop? In other words is there any performance or reliability gain that will come in hadoop edition that we missed when using ES lonely? until now i thought that maybe the es-hadoop is good for those who has hadoop clusters up and running and now they could integrate their ES environments with hadoop. Thanks in advance -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [July 29, 2014, 5:35pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951/2 "2014-07-29T17:35:16Z")
To answer your initial question, no. Disclaimer: I am leading the es-hadoop project so clearly I'm biased 🙂 es-hadoop is a 'connector' between es and Hadoop (whether it's traditional Map/Reduce or the new real-time approaches like Spark). If you are not using the above, then simply start using ES as is. In both cases, ES is exactly the same. Unless there's a (functional) requirement, the extra hardware can be allocated to ES (to improve performance and handle even more data). That being said, if you do find yourself using Hadoop or its ilk, then do give es-hadoop a try since it's likely to simplify a LOT of things and leverage the distributed architecture (aka Hadoop). On Tue, Jul 29, 2014 at 6:34 PM, [im.khosravi@gmail.com](mailto:im.khosravi@gmail.com) wrote: > Dear all > > I have a question in my mind about es-hadoop and it's benefits over > running ES lonely. > > The question is if we are not a hadoop user already, is this a good idea > to use es-hadoop? > In other words is there any performance or reliability gain that will come > in hadoop edition that we missed when using ES lonely? > > until now i thought that maybe the es-hadoop is good for those who has > hadoop clusters up and running and now they could integrate their ES > environments with hadoop. > > Thanks in advance > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAJogdmeGocfgvpUg-CpocVm0FC-k%3DO1wxxR%3Dx3LUUrdyyJwTzA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAJogdmeGocfgvpUg-CpocVm0FC-k%3DO1wxxR%3Dx3LUUrdyyJwTzA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![im\_khosravi](https://avatars.discourse-cdn.com/v4/letter/i/f05b48/32.png) [@im\_khosravi](https://discuss.elastic.co/u/im_khosravi)\ **Post date:** [July 29, 2014, 6:54pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951/3 "2014-07-29T18:54:22Z")
Thanks Costin, fair anwser 🙂 I've been using ES for more than a year and i think I'm good with it. On Tuesday, July 29, 2014 10:05:29 PM UTC+4:30, Costin Leau wrote: > To answer your initial question, no. > > Disclaimer: I am leading the es-hadoop project so clearly I'm biased 🙂 > > es-hadoop is a 'connector' between es and Hadoop (whether it's traditional > Map/Reduce or the new real-time approaches like Spark). If you are not > using the above, then simply start using ES as is. In both cases, ES is > exactly the same. > > Unless there's a (functional) requirement, the extra hardware can be > allocated to ES (to improve performance and handle even more data). > > That being said, if you do find yourself using Hadoop or its ilk, then do > give es-hadoop a try since it's likely to simplify a LOT of things and > leverage the distributed architecture (aka Hadoop). > > On Tue, Jul 29, 2014 at 6:34 PM, \<[im.kh...@gmail.com](mailto:im.kh...@gmail.com) \\> wrote: > > > Dear all > > > > I have a question in my mind about es-hadoop and it's benefits over > > running ES lonely. > > > > The question is if we are not a hadoop user already, is this a good idea > > to use es-hadoop? > > In other words is there any performance or reliability gain that will > > come in hadoop edition that we missed when using ES lonely? > > > > until now i thought that maybe the es-hadoop is good for those who has > > hadoop clusters up and running and now they could integrate their ES > > environments with hadoop. > > > > Thanks in advance > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/df68552b-8743-4f02-a480-80d3bd8407de%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/470e2482-aec4-4d5a-a8ed-11a9ea609f2a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/470e2482-aec4-4d5a-a8ed-11a9ea609f2a%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![jconlon](https://avatars.discourse-cdn.com/v4/letter/j/f475e1/32.png) [@jconlon](https://discuss.elastic.co/u/jconlon)\ **Post date:** [October 15, 2015, 7:20pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951/4 "2015-10-15T19:20:12Z")
Hi Costin, I too have a similar question, modified by the fact that we will have streaming, (Kafka?) and ETL integration requirements hitting us within the next 6 months. So I have been looking at Spark and am very impressed with Spark programming model and your ES-Hadoop connector. Problem domain is IOT/sensor data and our primary datastore is an Eclipse EMF/CDO model repository and supporting services running in an OSGi Eqinox framework on Java 8. Will be syncing this primary datasource to ES. Now the question is do I jump right into Spark and use it to do the Model Repo-\>ES even though our first use case could get by without it and probably just use the Java API and bulk indexing? thanks, John ---
**Author:** ![gsaray101](https://avatars.discourse-cdn.com/v4/letter/g/df788c/32.png) [@gsaray101](https://discuss.elastic.co/u/gsaray101)\ **Post date:** [December 9, 2015, 5:24pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951/5 "2015-12-09T17:24:57Z")
we have ES and will forward data that is older than 90 days to the hadoop hdfs. How would I access this data in hdfs using es-hadoop? Does es-hadoop have http api? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 5, 2017, 11:32pm UTC](https://discuss.elastic.co/t/is-it-beneficial-to-use-es-hadoop-over-es-when-you-are-not-an-hadoop-user-already/18951/6 "2017-07-05T23:32:13Z")