# HDFS to Elastic search - User Triggered Data Load

**URL:** <https://discuss.elastic.co/t/hdfs-to-elastic-search-user-triggered-data-load/21610>\
**Category:** Elasticsearch\
**Created:** [January 13, 2015, 3:13pm UTC](https://discuss.elastic.co/t/hdfs-to-elastic-search-user-triggered-data-load/21610 "2015-01-13T15:13:35Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![rinugoldjin](https://avatars.discourse-cdn.com/v4/letter/r/898d66/32.png) [@rinugoldjin](https://discuss.elastic.co/u/rinugoldjin)\
**Post date:** [January 13, 2015, 3:13pm UTC](https://discuss.elastic.co/t/hdfs-to-elastic-search-user-triggered-data-load/21610/1 "2015-01-13T15:13:35Z")

</div>

Hi All

We are using flume, sqoop, hadoop, elastic-search and kibana to perform real time analytic. However we are wondering how to dynamically query/retrieve data's in hdfs from elastic-search via kibana. Currently we have pushed the data's from hadoop to elastic-search using map-reduce. But how can we pull the data from hdfs from ES via kibana?

The intention was to use Hadoop to persist longer data (60 days) and ES to store for the last 3 days of data with this as a use case how can we retrieve data older than 3 days?

Any help would be helpful in progressing further.

Regards  
Rinu

---

<div class="post-metadata">

**Author:** ![rinugoldjin](https://avatars.discourse-cdn.com/v4/letter/r/898d66/32.png) [@rinugoldjin](https://discuss.elastic.co/u/rinugoldjin)\
**Post date:** [January 18, 2015, 6:59am UTC](https://discuss.elastic.co/t/hdfs-to-elastic-search-user-triggered-data-load/21610/2 "2015-01-18T06:59:26Z")

</div>

Hi All,

Any pointers to this would be really helpful.

Regards  
Rinu

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:38am UTC](https://discuss.elastic.co/t/hdfs-to-elastic-search-user-triggered-data-load/21610/3 "2017-07-06T00:38:12Z")

</div>


