# Index HDFS data

**URL:** <https://discuss.elastic.co/t/index-hdfs-data/28651>\
**Category:** Elasticsearch\
**Created:** [September 4, 2015, 5:55am UTC](https://discuss.elastic.co/t/index-hdfs-data/28651 "2015-09-04T05:55:53Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![logic4fun](https://avatars.discourse-cdn.com/v4/letter/l/74df32/32.png) [@logic4fun](https://discuss.elastic.co/u/logic4fun)\
**Post date:** [September 4, 2015, 5:55am UTC](https://discuss.elastic.co/t/index-hdfs-data/28651/1 "2015-09-04T05:55:53Z")

</div>

Sorry if this is a gross repeat of the question but I am trying to get my answers straight. I have CSV files coming into hadoop/hdfs. I would like to create an index for this data (incremental index)

One option is Create External table on folder and use Hive Plugin  
Another is PIG.

Is there an way to directly index without using Hive or Pig ? If so do i have to convert data to JSON ?

Thanks  
Logic4fun

---

<div class="post-metadata">

**Author:** ![Joshua\_Rich](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/joshua_rich/32/44953_2.png) [@Joshua\_Rich](https://discuss.elastic.co/u/Joshua_Rich)\
**Post date:** [September 4, 2015, 6:14am UTC](https://discuss.elastic.co/t/index-hdfs-data/28651/2 "2015-09-04T06:14:43Z")

</div>

Have you tried the [ES-Hadoop connector](https://www.elastic.co/downloads/hadoop)? It supports reading data in HDFS into Elasticsearch.

---

<div class="post-metadata">

**Author:** ![logic4fun](https://avatars.discourse-cdn.com/v4/letter/l/74df32/32.png) [@logic4fun](https://discuss.elastic.co/u/logic4fun)\
**Post date:** [September 4, 2015, 4:08pm UTC](https://discuss.elastic.co/t/index-hdfs-data/28651/3 "2015-09-04T16:08:45Z")

</div>

I did not. Let me download and look into it.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:52pm UTC](https://discuss.elastic.co/t/index-hdfs-data/28651/4 "2017-07-05T23:52:03Z")

</div>


