# Hadoop/Mapr and ELK

**URL:** https://discuss.elastic.co/t/hadoop-mapr-and-elk/204912
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [October 23, 2019, 4:35pm UTC](https://discuss.elastic.co/t/hadoop-mapr-and-elk/204912 "2019-10-23T16:35:01Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![lcui\_dxc](https://avatars.discourse-cdn.com/v4/letter/l/8edcca/32.png) [@lcui\_dxc](https://discuss.elastic.co/u/lcui_dxc)
#### Post date: [October 23, 2019, 4:35pm UTC](https://discuss.elastic.co/t/hadoop-mapr-and-elk/204912/1 "2019-10-23T16:35:01Z")

</div>

Hello there:

We have a request to use ELK to access/fetch some log files stored on a Mapr cluster file system (HDFS or MFS), but don't know how and where to setup the ES for Hadoop...

Any suggestions on how to fetch (like filebeat does) log files on HDFS and send to Logstash (or Elasticsearch nodes)?

Thank you very much

Li

---

<div class="post-metadata">

### Author: ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [November 14, 2019, 8:47pm UTC](https://discuss.elastic.co/t/hadoop-mapr-and-elk/204912/2 "2019-11-14T20:47:18Z")

</div>

ES-Hadoop is only run from within data processing frameworks like Hadoop's Map Reduce, Hive, or Spark. If you want to use ES-Hadoop, you will need to have one of those frameworks installed to read the data off of HDFS/MFS before it is sent to Elasticsearch.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 12, 2019, 8:47pm UTC](https://discuss.elastic.co/t/hadoop-mapr-and-elk/204912/3 "2019-12-12T20:47:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
