Logstash doesn't start when config is bigger than threshold

Elastic Stack Logstash
1

Running Logstash 5.4.1 on Ubuntu 14.04 (JVM 1.8.0_131, heap 1G, 10 workers on EC2 with 4 CPUs/16GB RAM).
Till now we had about 60 config files under conf.d, with about 2.8K lines, 125KB. In this configuration Logstash starts in about 2-3 minutes.
We noticed that when we add more configs, Logstash doesn't start (I waited for 10 minutes).
Threshold seems be about 170KB configs, 3.7K lines. I.e. when configuration is bigger, service doesn't start.

Any ideas why we see this behavior? How to debug/fix it?

Another, but probably related issue, which we saw in other environment - Logstash starts with more configuration, but runs 5-6 times slower.

TIA,
Vitaly

2

Answering my own question - increasing JVM heap size solves both issues.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.