# Logstash multiple pipelines in k8s

**URL:** <https://discuss.elastic.co/t/logstash-multiple-pipelines-in-k8s/241497>\
**Category:** Logstash\
**Created:** [July 16, 2020, 3:57pm UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-in-k8s/241497 "2020-07-16T15:57:32Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![digma89](https://avatars.discourse-cdn.com/v4/letter/d/c77e96/32.png) [@digma89](https://discuss.elastic.co/u/digma89)\
**Post date:** [July 16, 2020, 3:57pm UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-in-k8s/241497/1 "2020-07-16T15:57:32Z")

</div>

I'm trying to run multiple pipelines on my custom docker image in k8s, but doesn't seems to be working.

**On the config map in k8s I have:**

```
apiVersion: v1
kind: ConfigMap
metadata:
  name: logstashffs-${trigger.resolvedExpectedArtifacts[0].boundArtifact.version.split("_")[0]}
  namespace: ${parameters.namespace}
  labels:
    oiqclient: logstashffs-${trigger.resolvedExpectedArtifacts[0].boundArtifact.version.split("_")[0]}
data:
      logstash.yml: |
        http.host: "0.0.0.0"
        path.config: /usr/share/logstash/pipe

  logstash.conf: |

---

```

**If we look inside my docker image, we can see the file with the different pipelines:**

```
sh-4.2$ cd /usr/share/logstash/pipe
sh-4.2$ ls -la
total 20
drwxr-sr-x 1 logstash root 4096 Jul 16 13:53 .
drwxrwsr-x 1 logstash root 4096 Jul 14 20:22 ..
-rw-r--r-- 1 root root 6148 Jul 10 16:07 .DS_Store
-rw-r--r-- 1 root root 613 Jul 15 20:18 logstash.yml
sh-4.2$ cat logstash.yml 
- pipeline.id: ffs2bcaWatchlist
  path.config: "/usr/share/logstash/configurations/dev/ffsWatchlist.cfg"
  pipeline.workers: 25
  pipeline.batch.size: 125
- pipeline.id: ffs2bcaCorporate
  path.config: "/usr/share/logstash/configurations/dev/ffsCorporate.cfg"
  pipeline.workers: 25
  pipeline.batch.size: 125
- pipeline.id: ffs2bcaRegulatory
  path.config: "/usr/share/logstash/configurations/dev/ffsRegulatory.cfg"
  pipeline.workers: 25
  pipeline.batch.size: 125
- pipeline.id: ffs2bcaAward
  path.config: "/usr/share/logstash/configurations/dev/ffsAward.cfg"
  pipeline.workers: 25
  pipeline.batch.size: 125

```

**But when I run the pod it seems that is trying to look for the main pipeline and cannot find it:**

 ![Screen Shot 2020-07-16 at 11.54.04 AM](https://us1.discourse-cdn.com/elastic/original/3X/a/0/a0ab9f0de751861cffce39a8c6b897781e145e10.png)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 13, 2020, 3:57pm UTC](https://discuss.elastic.co/t/logstash-multiple-pipelines-in-k8s/241497/2 "2020-08-13T15:57:43Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.