# How to query hdfs data from elasticsearch using es-hadoop.? **URL:** \ **Category:** Elasticsearch\ **Tags:** es-hadoop\ **Created:** [February 21, 2016, 4:37pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339 "2016-02-21T16:37:28Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![sdaruna](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sdaruna/32/7289_2.png) [@sdaruna](https://discuss.elastic.co/u/sdaruna)\ **Post date:** [February 21, 2016, 4:37pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/1 "2016-02-21T16:37:28Z")
I have data in hdfs and how can i retried the hdfs data and perform realtime queries on hdfs data.? @magnusbaeck Could you please help me out.? @zachary_tong Could you please help me out.? This will be very import for our esteemed client. We want to build solution using elastic search with hdfs as data repository. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 21, 2016, 5:19pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/2 "2016-02-21T17:19:23Z")
Please avoid addressing specific individuals when posting. In order to make your data searchable in Elasticsearch, it needs to be indexed into Elasticsearch. When dealing with Hadoop data, this is commonly achieved through the [Elasticsearch Hadoop connector](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/index.html). ---
**Author:** ![sdaruna](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sdaruna/32/7289_2.png) [@sdaruna](https://discuss.elastic.co/u/sdaruna)\ **Post date:** [February 21, 2016, 5:38pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/3 "2016-02-21T17:38:32Z")
Hi Christian, I understand that we need to use elastic search hadoop connector. There is a way posted in github about hdfs-repository. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 21, 2016, 9:34pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/4 "2016-02-21T21:34:14Z")
Then I am not sure I understand your question. Could you please clarify or be more specific? ---
**Author:** ![sdaruna](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sdaruna/32/7289_2.png) [@sdaruna](https://discuss.elastic.co/u/sdaruna)\ **Post date:** [February 21, 2016, 9:43pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/5 "2016-02-21T21:43:19Z")
Thanks @Christian_Dahlqvist Thanks for giving me chance to explain the problem. We want to propose elasticsearch to our client for one of the requirement. We want to keep HDFS as a data repository. Every raw data gets moved to ES. Once the data has been moved to HDFS. We want to query hdfs data from elastic search. Splunk has a way to do it using virtual indexes. There is part of elastic search-hadoop solution (repository-hdfs), which speaks the same terms. You can create hdfs repository Here is the detail: > **[elastic/elasticsearch-hadoop](https://github.com/elastic/elasticsearch-hadoop/tree/master/repository-hdfs)** > > elasticsearch-hadoop - :elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop I tried it and added repository in elasticsearch.yml. However, i dont understand the way to query the data. How could i access the data from hdfs in elasticsearch through query or through kibana.? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 21, 2016, 10:04pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/6 "2016-02-21T22:04:41Z")
The HDFS repository allows you to create snapshots (backups) located on HDFS and restore them from HDFS, so it does not do what you seem to be expecting. All data that is to be actively queried however need to reside in the Elasticsearch cluster. ---
**Author:** ![guantau](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/guantau/32/11660_2.png) [@guantau](https://discuss.elastic.co/u/guantau)\ **Post date:** [August 29, 2016, 2:05pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/7 "2016-08-29T14:05:09Z")
@sdaruna I have the same requirement with you. Have you found any solution? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:23pm UTC](https://discuss.elastic.co/t/how-to-query-hdfs-data-from-elasticsearch-using-es-hadoop/42339/8 "2017-07-06T13:23:31Z")