# Pulling data from HDFS to elasticsearch

**URL:** <https://discuss.elastic.co/t/pulling-data-from-hdfs-to-elasticsearch/43544>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [March 4, 2016, 6:40pm UTC](https://discuss.elastic.co/t/pulling-data-from-hdfs-to-elasticsearch/43544 "2016-03-04T18:40:57Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![bishaka](https://avatars.discourse-cdn.com/v4/letter/b/e480ec/32.png) [@bishaka](https://discuss.elastic.co/u/bishaka)\
**Post date:** [March 4, 2016, 6:40pm UTC](https://discuss.elastic.co/t/pulling-data-from-hdfs-to-elasticsearch/43544/1 "2016-03-04T18:40:57Z")

</div>

Hi everyone,  
How do i read data from HDFS..then send them to elasticsearch and display on kibana dashboard?

I know there is a connector in ES-hadoop which works bidirectionally to to send data out/recieve....but my question is in the first stage **Pulling data from HDFS**

What are the most feasible options? Please provide me with couple of options..

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [March 8, 2016, 7:38am UTC](https://discuss.elastic.co/t/pulling-data-from-hdfs-to-elasticsearch/43544/2 "2016-03-08T07:38:31Z")

</div>

If you are using Hadoop, then you can use the various libraries out there such as Map/Reduce, Hive, Pig, Spark, Cascading.  
If you are not, then using any client that connects to HDFS will do (Logstash for example).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:25pm UTC](https://discuss.elastic.co/t/pulling-data-from-hdfs-to-elasticsearch/43544/3 "2017-07-06T13:25:52Z")

</div>


