# \[SOLVED\] Multiple Instances for Logstash

**URL:** <https://discuss.elastic.co/t/solved-multiple-instances-for-logstash/65539>\
**Category:** Logstash\
**Created:** [November 9, 2016, 6:23pm UTC](https://discuss.elastic.co/t/solved-multiple-instances-for-logstash/65539 "2016-11-09T18:23:36Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![fabian](https://avatars.discourse-cdn.com/v4/letter/f/f6c823/32.png) [@fabian](https://discuss.elastic.co/u/fabian)\
**Post date:** [November 9, 2016, 6:23pm UTC](https://discuss.elastic.co/t/solved-multiple-instances-for-logstash/65539/1 "2016-11-09T18:23:36Z")

</div>

Hey,

I'm using two Instances of Logstash on one Debian Server and I want to upgrade to v5. I'm using the repositories 2.3 now. With version 2.3 all I had to do was copy and edit the init script files and using two different config folders. Is there a easy way of doing this with version 5.0?  
I copied the /etc/systemd/system/logstash.service and edited it this way:  
[Unit]  
Description=logstash.shipper

```
[Service]
Type=simple
User=logstash
Group=logstash
# Load env vars from /etc/default/ and /etc/sysconfig/ if they exist.
# Prefixing the path with '-' makes it try to load, but if the file doesn't
# exist, it continues onward.
EnvironmentFile=-/etc/default/logstash.shipper
EnvironmentFile=-/etc/sysconfig/logstash
ExecStart=/usr/share/logstash/bin/logstash "--path.settings" "/etc/logstash/conf.shipper"
Restart=always
WorkingDirectory=/

[Install]
WantedBy=multi-user.target

```

I also copied logstash.yml, startup.option and log4j.properties in /etc/logstash/conf.shipper but this wont help. Can someone help me with installing multiple logstash5 instances?

---

<div class="post-metadata">

**Author:** ![theuntergeek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/theuntergeek/32/44961_2.png) [@theuntergeek](https://discuss.elastic.co/u/theuntergeek)\
**Post date:** [November 9, 2016, 6:50pm UTC](https://discuss.elastic.co/t/solved-multiple-instances-for-logstash/65539/2 "2016-11-09T18:50:14Z")

</div>

There's a terrific way to do this.

You should make a duplicate of the `/etc/logstash` directory somewhere, or at least copy `log4j2.properties`, `logstash.yml`, and `startup.options` to a new directory.

You should edit the configuration in `logstash.yml` and `startup.options` so that `path.data` and `path.logs` are separate from the others, so as not to cause collisions. I use a subdirectory of `/var/log/logstash`. You need to define where `path.config` is, which is your path to logstash pipeline configuration files (like `/etc/logstash/conf.d`). If you plan on monitoring Logstash, you may want to manually set the `http.port` and/or `http.host` so you know which instance is which. If you do not set `path.data` to be different, there are potential collisions from plugins stored data, but that will depend on configuration.

In `startup.options`, you at need to define `LS_SETTINGS_DIR` to point to where you put `logstash.yml` and such, plus `SERVICE_NAME` and `SERVICE_DESCRIPTION` (I use `logstash_in` for both options on one instance, and `logstash_out` for both on my other instance). If `LS_HOME` is the package dir of `/usr/share/logstash`, then you can either hard-code or leave it blank.

Now, if you've made these edits to this directory, you can create another systemd instance (like the one you have) by running:

```auto
/usr/share/logstash/bin/system-install /path/to/settings/dir

```

You should then be able to run `systemctl status ${SERVICE_NAME}` substituting whatever you used for `SERVICE_NAME` and see the status.

Sorry for the rough instructions. Haven't made the blog post detailing this process yet.

**UPDATE:** This method can still be used, though its applications may be more limited. The suggested method now in 6.x is to use [`pipelines.yml`](https://www.elastic.co/guide/en/logstash/6.1/multiple-pipelines.html) and have a single instance of Logstash run multiple, separate pipelines in parallel. With this approach, you don't _need_ to have separate JVMs to have independent pipelines. Of course, if you want it that way, the above description still works.

---

<div class="post-metadata">

**Author:** ![fabian](https://avatars.discourse-cdn.com/v4/letter/f/f6c823/32.png) [@fabian](https://discuss.elastic.co/u/fabian)\
**Post date:** [November 11, 2016, 4:10pm UTC](https://discuss.elastic.co/t/solved-multiple-instances-for-logstash/65539/3 "2016-11-11T16:10:47Z")

</div>

Hi Aaron,

sorry for late reply. It worked lika a charm.

Thanks a lot!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 9, 2016, 4:11pm UTC](https://discuss.elastic.co/t/solved-multiple-instances-for-logstash/65539/4 "2016-12-09T16:11:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.