# How to store only metadata in elasticsearch and indexes in the HDFS

**URL:** <https://discuss.elastic.co/t/how-to-store-only-metadata-in-elasticsearch-and-indexes-in-the-hdfs/75524>\
**Category:** Elasticsearch\
**Created:** [February 17, 2017, 3:34pm UTC](https://discuss.elastic.co/t/how-to-store-only-metadata-in-elasticsearch-and-indexes-in-the-hdfs/75524 "2017-02-17T15:34:04Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![irri](https://avatars.discourse-cdn.com/v4/letter/i/e95f7d/32.png) [@irri](https://discuss.elastic.co/u/irri)\
**Post date:** [February 17, 2017, 3:34pm UTC](https://discuss.elastic.co/t/how-to-store-only-metadata-in-elasticsearch-and-indexes-in-the-hdfs/75524/1 "2017-02-17T15:34:04Z")

</div>

Huge amount of Data is residing in the hdfs . we have used hive storage handler to store the data in elastic search. Ultimate goal is to use kibana to visualize the data. Now due to storage and security concerns, WE want to keep only metadata in the elastic search and refer to the data in the hdfs, so when we query, data must be read from hdfs not from ES. Is there any such provision available in the ES, or any plugins which will come for rescue in the situation.

Right Now enitire data is sitting in the ES if we are using Hive storage handler. Any help would be appreciated.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [February 18, 2017, 10:14pm UTC](https://discuss.elastic.co/t/how-to-store-only-metadata-in-elasticsearch-and-indexes-in-the-hdfs/75524/2 "2017-02-18T22:14:27Z")

</div>

You'd need to handle that on the client layer I think.

[https://www.elastic.co/guide/en/elasticsearch/hadoop/current/index.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/index.html) may also help.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 18, 2017, 10:14pm UTC](https://discuss.elastic.co/t/how-to-store-only-metadata-in-elasticsearch-and-indexes-in-the-hdfs/75524/3 "2017-03-18T22:14:53Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.