# How to send Logs from Apache Spark ( HDInsight Cluster in Azure) to Elastic Search / Kibana

**URL:** <https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [June 1, 2017, 10:20pm UTC](https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996 "2017-06-01T22:20:36Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![arvindsing](https://avatars.discourse-cdn.com/v4/letter/a/a6a055/32.png) [@arvindsing](https://discuss.elastic.co/u/arvindsing)\
**Post date:** [June 1, 2017, 10:20pm UTC](https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996/1 "2017-06-01T22:20:36Z")

</div>

Our logs are at DFS and we can access them using ....  
hadoop fs -cat wasbs://yourcontainer@youraccount.blob.core.windows.net/testDir/testFile  
test file content

Now we want to configure filebeats here so that we can ship logs / or contents to logstash. How to configure filebeats here..I mean how to give command in filebeats so that it finally reaches to Kibana portal....

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 2, 2017, 12:54am UTC](https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996/2 "2017-06-02T00:54:56Z")

</div>

Please don't cross post - [How to Configure FileBeat for Spark Headnode ( HDInsight Cluster in Azure)](https://discuss.elastic.co/t/how-to-configure-filebeat-for-spark-headnode-hdinsight-cluster-in-azure/87995)

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 2, 2017, 12:55am UTC](https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996/3 "2017-06-02T00:55:00Z")

</div>


