# Store indexes in ES while the data stays in HDFS

**URL:** <https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [May 11, 2016, 10:27am UTC](https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752 "2016-05-11T10:27:54Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![a\_raj](https://avatars.discourse-cdn.com/v4/letter/a/50afbb/32.png) [@a\_raj](https://discuss.elastic.co/u/a_raj)\
**Post date:** [May 11, 2016, 10:27am UTC](https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752/1 "2016-05-11T10:27:54Z")

</div>

Is there a way to index data from an HDFS location into elasticsearch without moving/copying the same to ES? es-hadoop seems to copy the data into ES cluster there by making a copy of the same big chunk of data. Is there a config that I am missing out? Or is it that the whole idea is absurd?

It'd be helpful to know if this is possible, and if yes, a detailing about the same would be much appreciated.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 11, 2016, 10:59am UTC](https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752/2 "2016-05-11T10:59:12Z")

</div>

No there is not.

---

<div class="post-metadata">

**Author:** ![a\_raj](https://avatars.discourse-cdn.com/v4/letter/a/50afbb/32.png) [@a\_raj](https://discuss.elastic.co/u/a_raj)\
**Post date:** [May 11, 2016, 11:25am UTC](https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752/3 "2016-05-11T11:25:04Z")

</div>

So, there's no way but to have two individual copies of the data in HDFS and ES, right?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 11, 2016, 8:56pm UTC](https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752/4 "2016-05-11T20:56:09Z")

</div>

That is correct.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:24pm UTC](https://discuss.elastic.co/t/store-indexes-in-es-while-the-data-stays-in-hdfs/49752/5 "2017-07-06T13:24:44Z")

</div>