How to send Logs from Apache Spark ( HDInsight Cluster in Azure) to Elastic Search / Kibana

Please don't cross post - How to Configure FileBeat for Spark Headnode ( HDInsight Cluster in Azure)