# Multiple instances on one config file

**URL:** https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245
**Category:** Logstash
**Created:** [May 10, 2017, 12:57pm UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245 "2017-05-10T12:57:15Z")
**Posts on this page:** 12
**Page:** 1

<div class="post-metadata">

### Author: ![bertvervaele](https://avatars.discourse-cdn.com/v4/letter/b/8e7dd6/32.png) [@bertvervaele](https://discuss.elastic.co/u/bertvervaele)
#### Post date: [May 10, 2017, 12:57pm UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/1 "2017-05-10T12:57:15Z")

</div>

I was using logstash-5.2.2 but did an upgrade today to logstash-5.4.0 .  
In 5.2.2 I could just do

> bin/logstash -f oracle.conf  
> and  
> bin/logstash -f linux.conf

without a problem. But now on 5.4.0 when I try the second command I get  
` [2017-05-10T14:47:51,092][FATAL][logstash.runner] Logstash could not be started because there is already another instance using the configured data directory. If you wish to run multiple instances, you must change the "path.data" setting.`

So how can I run those 2 config files without maken a whole new directory.

Greatings Bert

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [May 10, 2017, 1:59pm UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/2 "2017-05-10T13:59:43Z")

</div>

The `--path.data` option can be used to set the data directory uniquely for each instance.

[https://www.elastic.co/guide/en/logstash/5.4/running-logstash-command-line.html](https://www.elastic.co/guide/en/logstash/5.4/running-logstash-command-line.html)

---

<div class="post-metadata">

### Author: ![bertvervaele](https://avatars.discourse-cdn.com/v4/letter/b/8e7dd6/32.png) [@bertvervaele](https://discuss.elastic.co/u/bertvervaele)
#### Post date: [May 10, 2017, 2:04pm UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/3 "2017-05-10T14:04:45Z")

</div>

Is this new in 5.4? didn't have to do this in 5.2  
And thnaks

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [May 10, 2017, 2:08pm UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/4 "2017-05-10T14:08:35Z")

</div>

I don't know. Check the release notes.

---

<div class="post-metadata">

### Author: ![Guru\_Raja\_Y](https://avatars.discourse-cdn.com/v4/letter/g/848f3c/32.png) [@Guru\_Raja\_Y](https://discuss.elastic.co/u/Guru_Raja_Y)
#### Post date: [May 29, 2017, 5:31am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/5 "2017-05-29T05:31:10Z")

</div>

Looks like this is new issue in 5.4. I am also facing same problem

---

<div class="post-metadata">

### Author: ![tomx1](https://avatars.discourse-cdn.com/v4/letter/t/779978/32.png) [@tomx1](https://discuss.elastic.co/u/tomx1)
#### Post date: [June 12, 2017, 1:59pm UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/6 "2017-06-12T13:59:52Z")

</div>

Same here ☹

---

<div class="post-metadata">

### Author: ![tomx1](https://avatars.discourse-cdn.com/v4/letter/t/779978/32.png) [@tomx1](https://discuss.elastic.co/u/tomx1)
#### Post date: [June 13, 2017, 6:25am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/7 "2017-06-13T06:25:42Z")

</div>

As far as i can see nothing is mentioned about this in the release notes:

[https://www.elastic.co/guide/en/logstash/current/logstash-5-4-0.html](https://www.elastic.co/guide/en/logstash/current/logstash-5-4-0.html)  
[https://www.elastic.co/guide/en/logstash/current/logstash-5-4-1.html](https://www.elastic.co/guide/en/logstash/current/logstash-5-4-1.html)

But i assume this has something to to with the new persistent queue feature which may require uniqe path.data. I downgraded now to 5.3.

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [June 13, 2017, 7:22am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/8 "2017-06-13T07:22:46Z")

</div>

> I downgraded now to 5.3.

I don't understand. Why not just use different data directories for your different instances?

---

<div class="post-metadata">

### Author: ![tomx1](https://avatars.discourse-cdn.com/v4/letter/t/779978/32.png) [@tomx1](https://discuss.elastic.co/u/tomx1)
#### Post date: [June 13, 2017, 7:45am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/9 "2017-06-13T07:45:45Z")

</div>

In my case i have modified the logstash initscript to start each config file in /etc/logstash/conf.d in a different instance using the same logstash service configfile (/etc/logstash/logstash.yml).  
path.data is specified in logstash.yml, so to get this working again, i would have to modify the initskript to create a logstash.yml for each logstash config on the fly using differnt path.data setting for each instance,...

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [June 13, 2017, 7:50am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/10 "2017-06-13T07:50:36Z")

</div>

I don't think you need a unique logstash.yml for each instance. Passing a unique value for the `--path.data` command line option should be enough.

---

<div class="post-metadata">

### Author: ![tomx1](https://avatars.discourse-cdn.com/v4/letter/t/779978/32.png) [@tomx1](https://discuss.elastic.co/u/tomx1)
#### Post date: [June 13, 2017, 7:56am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/11 "2017-06-13T07:56:36Z")

</div>

I will give that a try, thanks!

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 11, 2017, 7:56am UTC](https://discuss.elastic.co/t/multiple-instances-on-one-config-file/85245/12 "2017-07-11T07:56:45Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
