# Elasticsearch & hadoop
**URL:** https://discuss.elastic.co/t/elasticsearch-hadoop/90202
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [June 21, 2017, 6:28am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202 "2017-06-21T06:28:11Z")
**Posts on this page:** 8
**Page:** 1
### Author:  [@JIELOGAN](https://discuss.elastic.co/u/JIELOGAN)
#### Post date: [June 21, 2017, 6:28am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/1 "2017-06-21T06:28:11Z")
Hi,recently I need to integrate ES and hadoop via elasticsearch-hadoop, What about the performance of reading data from ES to hadoop, and the performance of reading data from hadoop to ES？Let‘s say that I have 100G data per day need to process. What should i chose? 1.data-hadoop-ES. or 2.data- ES-hadoop.
THANKS
---
### Author:  [@Mike.Barretta](https://discuss.elastic.co/u/Mike.Barretta)
#### Post date: [June 28, 2017, 2:00pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/2 "2017-06-28T14:00:39Z")
@JIELOGAN, is your question about which version of Hadoop to use, v1 or v2?
If so, that's not an ES-Hadoop question as the answer depends on which version of Hadoop you are running, 1.x or 2.x. If you're starting new with Hadoop, I'd definitely recommend going with the most current version, 2.8 (assuming you're not limited to a given version via some other requirement)
With regards to write performance from Hadoop into Elasticsearch, see: [https://www.elastic.co/guide/en/elasticsearch/hadoop/current/arch.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/arch.html). In short, the level of parallelism for the writing is based on the number of splits and mappers in your dataset/cluster: more splits == more mappers == more parallelism
---
### Author:  [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [June 29, 2017, 2:10pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/3 "2017-06-29T14:10:07Z")
@JIELOGAN I would use Hadoop 2.7.x if you are planning on using ES-Hadoop. 2.8 is not yet supported.
---
### Author:  [@Mike.Barretta](https://discuss.elastic.co/u/Mike.Barretta)
#### Post date: [June 29, 2017, 2:12pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/4 "2017-06-29T14:12:18Z")
Doh, thanks for the clarification, @james.baiera!
---
### Author:  [@JIELOGAN](https://discuss.elastic.co/u/JIELOGAN)
#### Post date: [July 25, 2017, 2:03am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/5 "2017-07-25T02:03:29Z")
thank you for your help
---
### Author:  [@JIELOGAN](https://discuss.elastic.co/u/JIELOGAN)
#### Post date: [July 25, 2017, 2:04am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/6 "2017-07-25T02:04:08Z")
thanks, i also used 2.7.x
---
### Author:  [@Samy\_Nathan](https://discuss.elastic.co/u/Samy_Nathan)
#### Post date: [August 14, 2017, 11:26am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/7 "2017-08-14T11:26:44Z")
Hi ,
i have large amount of data in ES (2.4.1) index .i need the index data moved into hadoop hdfs stroage. how to do the task .
following steps iam doing
Es version 2.4.1
Apache hadoop version 2.7.3
/elasticsearch-2.4.1$ bin/plugin install elasticsearch/elasticsearch-repository-hdfs/2.4.1
Start the elasticsearch
start hadoop
after what iam doing ???
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 11, 2017, 11:27am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop/90202/8 "2017-09-11T11:27:34Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.