# Logstash pipeline creation is behaving differently for different outputs

**URL:** <https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351>\
**Category:** Logstash\
**Created:** [October 7, 2024, 1:22pm UTC](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351 "2024-10-07T13:22:02Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![sasikiranvaddi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sasikiranvaddi/32/134584_2.png) [@sasikiranvaddi](https://discuss.elastic.co/u/sasikiranvaddi)\
**Post date:** [October 7, 2024, 1:22pm UTC](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351/1 "2024-10-07T13:22:02Z")

</div>

We have two deployments where lumberjack is configured as output for one of the deployment and syslog is configured as output for another deployment.

In both the deployments the outputs are down when Logstash is initiated, following is the behavior observed.

1. With Syslog as output, we could see Pipeline creation has been instantiated and the downstream queue started to fill.
2. With lumberjack as output, Pipeline creation has not been instantiated, and the upstream queue started to fill before downstream.

When we observe the corresponding plugin code.  
For syslog[1](https://github.com/logstash-plugins/logstash-output-syslog/blob/main/lib/logstash/outputs/syslog.rb#L237) when there is a connection failure, a exception is raised rather performing indefinite retries unlike for other output like lumberjack[2](https://github.com/logstash-plugins/logstash-output-lumberjack/blob/v3.1.9/lib/logstash/outputs/lumberjack.rb#L91)

Could someone provide some insights on why there is a difference b/n syslog and lumberjack.

---

<div class="post-metadata">

**Author:** ![sasikiranvaddi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sasikiranvaddi/32/134584_2.png) [@sasikiranvaddi](https://discuss.elastic.co/u/sasikiranvaddi)\
**Post date:** [October 10, 2024, 6:52am UTC](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351/2 "2024-10-10T06:52:28Z")

</div>

We build a logstash-output-lumberjack by commenting the retry [1](https://github.com/logstash-plugins/logstash-output-lumberjack/blob/v3.1.9/lib/logstash/outputs/lumberjack.rb#L91) and then performed following test.  
Instantiated logstash without having lumberjack output available, we could see downstream pipeline i.e., lumberjack pipeline starting to fill.  
The same test has been tried with vanila logstash-output-lumberjack plugin and we noticed "Pipeline has not created" and the upstream pipeline started to fill but downstream queue is empty.

---

<div class="post-metadata">

**Author:** ![grumo35](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/grumo35/32/59451_2.png) [@grumo35](https://discuss.elastic.co/u/grumo35)\
**Post date:** [October 10, 2024, 8:23am UTC](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351/3 "2024-10-10T08:23:23Z")

</div>

Hi,

Can you share the logstash starting logs suggesting there might be an issue with the pipeline ? also can you share lumberjack output configurations ?

---

<div class="post-metadata">

**Author:** ![sasikiranvaddi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sasikiranvaddi/32/134584_2.png) [@sasikiranvaddi](https://discuss.elastic.co/u/sasikiranvaddi)\
**Post date:** [October 14, 2024, 7:19am UTC](https://discuss.elastic.co/t/logstash-pipeline-creation-is-behaving-differently-for-different-outputs/368351/4 "2024-10-14T07:19:46Z")

</div>

Hi @grumo35 ,

We have total 3 outputs configured, in the reference deployment

1. Search Engine
2. Lumberjack 1
3. Lumberjact 2  
As part of this test Lumberjack 2 is not available during instantiating of logstash process.

Please find the logs and configurations that are requested

1. [Lumberjack 2 output configuration](https://pastebin.com/zHWGnauj)
2. [Logstash logs](https://pastebin.com/TFzVg0hH)
