# ElasticSearch on Azure - How to Logstash and install plugins? **URL:** \ **Category:** Elasticsearch\ **Created:** [December 12, 2017, 10:31am UTC](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300 "2017-12-12T10:31:31Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Joff](https://avatars.discourse-cdn.com/v4/letter/j/8797f3/32.png) [@Joff](https://discuss.elastic.co/u/Joff)\ **Post date:** [December 12, 2017, 10:31am UTC](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300/1 "2017-12-12T10:31:31Z")
Hi, We are trying to develop a PoC for Elastic on Azure Cloud We installed the Elastic template from Azure Marketplace, selected 3 nodes and now we have following configuration: 1 Kibana VM 3 Data VM 3 Master VM What we can do so far: - Connect and log in to Kibana (create simple index pattern from console) - Connect to VMs via bash ssh **What is still open and we desperately look for clear documentation:** 1. On which VM runs logstash? 2. How to start logstash? 3. Where to store the config files (for logstash but also if using jdbc plugin)? 4. Installation of Kibana plugins: when trying to install for example [https://github.com/Nico-DF/kibana-plugin-traffic-sg](https://github.com/Nico-DF/kibana-plugin-traffic-sg) I always get 'operation not permitted' even if I am logged in as the owner of the directory Is it impossible to install extra plugins on VMs? 5. Installation of ES plugings like like [https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azurewadtable](https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azurewadtable) or [https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azureblob](https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azureblob) On which VM it should be installed? Master-0 I assume? But then under which directory? Currently the documentation I can find for setting ELK on Azure is mostly > **[Getting Started with Elasticsearch and the Elastic Stack on Microsoft Azure](https://www.elastic.co/blog/getting-started-with-elasticsearch-and-the-elastic-stack-on-microsoft-azure)** > > Learn how to get started with Elasticsearch and the Elastic Stack on Microsoft Azure. and > **[Get started with Elasticsearch on Azure](https://docs.microsoft.com/en-us/azure/architecture/elasticsearch/)** > > How to install, configure, and run Elasticsearch on Azure. But all these are not giving us answers. Can anyone direct us to a more comprehensive (for dummies) guidelines/tutorial Or at least reply to our questions? thx ---
**Author:** ![forloop](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/forloop/32/9021_2.png) [@forloop](https://discuss.elastic.co/u/forloop)\ **Post date:** [December 15, 2017, 4:38am UTC](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300/2 "2017-12-15T04:38:34Z")
I work on the Elastic Azure ARM Marketplace template so let me see if I can answer your questions: > [@Joff](#): > > On which VM runs logstash? The template currently deploys **only** Elasticsearch and Kibana, so if you would like to also use Logstash and Beats, you will need to install those separately. We have discussed including Logstash in the template in future and I have opened [an issue on github to track this](https://github.com/elastic/azure-marketplace/issues/157). > [@Joff](#): > > How to start logstash? See above. If you're deploying Logstash to Ubuntu 16.04 on Azure, you'll probably [use systemd to run Logstash](https://www.elastic.co/guide/en/logstash/5.6/running-logstash.html). > [@Joff](#): > > Where to store the config files (for logstash but also if using jdbc plugin)? On the VM(s) running Logstash. > [@Joff](#): > > Installation of Kibana plugins: when trying to install for example [GitHub - Nico-DF/kibana-plugin-traffic-sg: Plugin for Kibana Version 4.x and 5.x](https://github.com/Nico-DF/kibana-plugin-traffic-sg) I always get 'operation not permitted' even if I am logged in as the owner of the directory > > Is it impossible to install extra plugins on VMs? Yes. ssh into the Kibana VM. Typically, you install plugins through the `kibana-plugin` script for a 5.x version: ```sh sudo /usr/share/kibana/bin/kibana-plugin install ``` and restart Kibana service afterwards ```sh sudo service kibana restart ``` but that particular plugin's instructions use [git to clone the repository](https://github.com/Nico-DF/kibana-plugin-traffic-sg#installation) to the plugins directory. It looks like there is an [open PR for that plugin to fix an issue with Kibana 5.5.x and 5.6.x though](https://github.com/sbeyn/kibana-plugin-traffic-sg/pull/7), so you may need to wait for that to be merged before you can use it. Since we don't maintain that plugin, I would recommend keeping an eye on that github repository. > [@Joff](#): > > Installation of ES plugings like like [https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azurewadtable](https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azurewadtable) or [https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azureblob](https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azureblob) > > On which VM it should be installed? Master-0 I assume? > > But then under which directory? Those are logstash plugins, so you would [install them onto the VM(s) that are running Logstash.](https://www.elastic.co/guide/en/logstash/5.6/working-with-plugins.html) Check out the blog posts that we have about the Azure Marketplace and ARM template offering: - [Spinning up a cluster with Elastic's Azure Marketplace template](https://www.elastic.co/blog/spinning-up-a-cluster-with-elastics-azure-marketplace-template) - [Elasticsearch and Kibana Deployments on Azure](https://www.elastic.co/blog/elasticsearch-and-kibana-deployments-on-azure) ---
**Author:** ![Joff](https://avatars.discourse-cdn.com/v4/letter/j/8797f3/32.png) [@Joff](https://discuss.elastic.co/u/Joff)\ **Post date:** [December 15, 2017, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300/3 "2017-12-15T08:07:32Z")
Thx a lot @forloop After some more research and attempts I did managed yesterday to install Logstash and many plugins for both Kibana and Logstash I'm still stuck with the jdbc plugin but I'll investigate this still a bit more Now there is still something I still do not understand 100% What is the best approach for Logstash? Currently I only installed Logstash on my Kibana VM (I actually installed everything on Kibana VM only so far). Was this a mistake or correct move? Would it be better to have Logstash installed on all my 3 Data VMs or on all my 3 Master VMs instead? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 12, 2018, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300/4 "2018-01-12T08:07:49Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.