# Create index to HDFS from ElasticSearch

**URL:** <https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229>\
**Category:** Elasticsearch\
**Created:** [February 8, 2016, 9:51pm UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229 "2016-02-08T21:51:18Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![Roberto\_Sancho\_Rojas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/roberto_sancho_rojas/32/12999_2.png) [@Roberto\_Sancho\_Rojas](https://discuss.elastic.co/u/Roberto_Sancho_Rojas)\
**Post date:** [February 8, 2016, 9:51pm UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/1 "2016-02-08T21:51:18Z")

</div>

Hi:

I want to index the data from HDFS and show to the kibana.  
Actaully elastic and kibana are working in locally directory, but can I search from HDFS JSON files?? How??

Thanks

---

<div class="post-metadata">

**Author:** ![Dylan\_Johnson1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dylan_johnson1/32/7640_2.png) [@Dylan\_Johnson1](https://discuss.elastic.co/u/Dylan_Johnson1)\
**Post date:** [February 9, 2016, 3:47am UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/2 "2016-02-09T03:47:02Z")

</div>

[https://www.elastic.co/products/hadoop](https://www.elastic.co/products/hadoop)

---

<div class="post-metadata">

**Author:** ![Roberto\_Sancho\_Rojas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/roberto_sancho_rojas/32/12999_2.png) [@Roberto\_Sancho\_Rojas](https://discuss.elastic.co/u/Roberto_Sancho_Rojas)\
**Post date:** [February 9, 2016, 6:12am UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/3 "2016-02-09T06:12:27Z")

</div>

Thanks but what i need is store the data and index there like a gateway, but i have readed its deprecated, so i dont need a snapshop or restore.

Wich plugin and configuration i need??

Many thanks

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 9, 2016, 6:55am UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/4 "2016-02-09T06:55:36Z")

</div>

You need to write a process which will read your data from HDFS, transform to JSON then send to elasticsearch.  
Or you can use `es-hadoop` to do it.

Data needs to be indexed into elasticsearch before you can use Kibana.

I'd suggest looking at this video: [https://www.elastic.co/webinars/elasticsearch-and-apache-hadoop](https://www.elastic.co/webinars/elasticsearch-and-apache-hadoop)

Might help.

---

<div class="post-metadata">

**Author:** ![Roberto\_Sancho\_Rojas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/roberto_sancho_rojas/32/12999_2.png) [@Roberto\_Sancho\_Rojas](https://discuss.elastic.co/u/Roberto_Sancho_Rojas)\
**Post date:** [February 9, 2016, 7:28am UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/5 "2016-02-09T07:28:50Z")

</div>

Hi:  
Actually i need index the data from HDFS and store the data and index also into HDFS, is posible??? i dont want store any file into local filesystem.

I read Gateway but is just to store metadata.

Thanks

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 9, 2016, 7:42am UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/6 "2016-02-09T07:42:31Z")

</div>

You could may be [mount an HDFS file system](https://wiki.apache.org/hadoop/MountableHDFS) on your machine and put your indices in it but **it's absolutely not recommended!**

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [February 10, 2016, 1:14am UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/7 "2016-02-10T01:14:02Z")

</div>

Yeah I'd definitely stay away from that.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:17pm UTC](https://discuss.elastic.co/t/create-index-to-hdfs-from-elasticsearch/41229/8 "2017-07-05T23:17:47Z")

</div>


