# Integration of hadoop (specifically HDFS files) with ELK stack
**URL:** https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [July 29, 2019, 3:01am UTC](https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596 "2019-07-29T03:01:28Z")
**Posts on this page:** 3
**Page:** 1
### Author:  [@Yukti\_Agrawal](https://discuss.elastic.co/u/Yukti_Agrawal)
#### Post date: [July 29, 2019, 3:01am UTC](https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596/1 "2019-07-29T03:01:28Z")
I am trying to integrate hadoop with ELK stack. My use case is " i have to get a data from a file present in HDFS path (AVRO format) and show the contents on kibana dashboard"
Anybody is having any article with step by step process?
---
### Author:  [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [August 14, 2019, 7:07pm UTC](https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596/2 "2019-08-14T19:07:12Z")
Unfortunately I don't have any step-by-step content for doing this, but assuming that you are hosting YARN with your distribution of HDFS, the easiest process for this might be to use something like Spark to read the AVRO files in parallel and ship it to Elasticsearch using ES-Hadoop.
I think the fact that the data is in AVRO format will be more of a limiting factor than the fact that it lives on HDFS. Spark and other Hadoop ecosystem technologies are usually better suited to ETL of that kind of data than other out of the box tools.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 11, 2019, 7:07pm UTC](https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596/3 "2019-09-11T19:07:14Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.