# \[Resolved\] LS pipeline.id not being honoured in logstash.yml

**URL:** <https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760>\
**Category:** Logstash\
**Tags:** docker\
**Created:** [July 9, 2024, 6:06am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760 "2024-07-09T06:06:18Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![blueren](https://avatars.discourse-cdn.com/v4/letter/b/ecae2f/32.png) [@blueren](https://discuss.elastic.co/u/blueren)\
**Post date:** [July 9, 2024, 6:06am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/1 "2024-07-09T06:06:18Z")

</div>

I have a logstash instance running as a docker continer. Since it is using only a single pipeline, I've not bothered configuring the pipeline.yml. Instead, I've defined the pipeline params in the logstash.yml file itself:

path.data: path.data: /usr/share/logstash/data  
pipeline.id: log\_my\_stash  
pipeline.batch.size: 250  
pipeline.batch.delay: 5  
pipeline.workers: 24

When I observe the logstash instance and the pipeline via a separate LS monitoring instance, the name of the pipeline is always "main". Even the logs generated by LS is always having "main" as the pipeline name. What gives? The official doc suggests that pipeline.id is what should be used to change the name of the pipeline.

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [July 9, 2024, 6:12am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/2 "2024-07-09T06:12:01Z")

</div>

Yes, it's by default. If you want to change it, set pipeline.id as you did.  
In log will something like this:  
`[INFO][logstash.javapipeline][ls] Starting pipeline {:pipeline_id=>"ls", "pipeline.workers"=>...`

No sure what do you expect.

---

<div class="post-metadata">

**Author:** ![blueren](https://avatars.discourse-cdn.com/v4/letter/b/ecae2f/32.png) [@blueren](https://discuss.elastic.co/u/blueren)\
**Post date:** [July 9, 2024, 6:57am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/3 "2024-07-09T06:57:29Z")

</div>

What I expect is that the name of the pipeline be "log\_my\_stash" and not "main". And yet, I see "main" printing all over the logs.

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [July 9, 2024, 7:30am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/4 "2024-07-09T07:30:17Z")

</div>

Have you restated LS?

---

<div class="post-metadata">

**Author:** ![blueren](https://avatars.discourse-cdn.com/v4/letter/b/ecae2f/32.png) [@blueren](https://discuss.elastic.co/u/blueren)\
**Post date:** [July 9, 2024, 8:03am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/5 "2024-07-09T08:03:16Z")

</div>

A gazillion times, since I've been making changes to the pipelines. Just want to make sure i'm not missing something trivial

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [July 9, 2024, 10:14am UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/6 "2024-07-09T10:14:25Z")

</div>

> [@blueren](#):
>
> pipeline.id: log\_my\_stash

Have you check that you have the same param already somewhere in logstash.yml?

Try to set `log.level: debug` and see what path.settings is set to.  
I didn't have any issue after changing. Restart and that's all folks.

> Every file in the host directory ~/pipeline/ will then be parsed by Logstash as pipeline configuration.

---

<div class="post-metadata">

**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\
**Post date:** [July 9, 2024, 12:10pm UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/7 "2024-07-09T12:10:26Z")

</div>

Please share your logs from logstash and also how you are starting your logstash container.

Are you using docker compose or just cli?

If the pipeline id name is not changing, it is probably not reading your updated `logstash.yml` file.

---

<div class="post-metadata">

**Author:** ![blueren](https://avatars.discourse-cdn.com/v4/letter/b/ecae2f/32.png) [@blueren](https://discuss.elastic.co/u/blueren)\
**Post date:** [July 9, 2024, 12:28pm UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/8 "2024-07-09T12:28:39Z")

</div>

It's a simple docker-compose.yml file with the service. I know that it's reading the pipeline files. As for the logstash.yml, I believe it's reading the file since I was experimenting with the batch and timeout parameters. A restart promptly applys those changs.

---

<div class="post-metadata">

**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\
**Post date:** [July 9, 2024, 1:12pm UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/9 "2024-07-09T13:12:34Z")

</div>

Please share the your docker compose and fresh logstash logs.

Not possible to troubleshoot without those information.

---

<div class="post-metadata">

**Author:** ![blueren](https://avatars.discourse-cdn.com/v4/letter/b/ecae2f/32.png) [@blueren](https://discuss.elastic.co/u/blueren)\
**Post date:** [July 9, 2024, 3:38pm UTC](https://discuss.elastic.co/t/resolved-ls-pipeline-id-not-being-honoured-in-logstash-yml/362760/10 "2024-07-09T15:38:32Z")

</div>

Thx. I had a gut feel it was something trivial. The docker container had a pipeline.yml which had main in it. So it took that into account. Whatever was not part of pipeline.yml, it refered to my logstash.yml. Hence I was able to set all my batch and workers, but just not the pipeline id.

Issue stands resolved
