# Logstash with JDBC performance
**URL:** https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984
**Category:** Logstash
**Created:** [February 11, 2022, 2:11pm UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984 "2022-02-11T14:11:50Z")
**Posts on this page:** 9
**Page:** 1
### Author:  [@HerveSavard](https://discuss.elastic.co/u/HerveSavard)
#### Post date: [February 11, 2022, 2:11pm UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/1 "2022-02-11T14:11:50Z")
Hello,
I use Logstash with JDBC connector.
I have 6 pipelines defined in my pipeline.yml.
pipeline1 have 14 SQL
pipeline2 have 10 SQL
pipeline3 have 2 SQL
pipeline4 have 8 SQL
pipeline5 have 1 SQL
pipeline6 have 1 SQL
When i want add a new SQL or new pipeline, my server does not work anymore.
System configuration:
4 proc
32 GB
What do you suggest?
More CPU , MEM?
or 1 more logstash?
I will add many new SQL request in the future
Many thanks in advance.
Herve
---
### Author:  [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)
#### Post date: [February 12, 2022, 1:53pm UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/2 "2022-02-12T13:53:05Z")
Hello,
> [@HerveSavard](#):
>
> my server does not work anymore
What does this mean? Detail should be needed for further discussion.
---
### Author:  [@HerveSavard](https://discuss.elastic.co/u/HerveSavard)
#### Post date: [February 13, 2022, 8:02am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/3 "2022-02-13T08:02:40Z")
> [@Tomo\_M](#):
>
> What does this mean? Detail should be needed for further discussion.
Hello,
Sorry, it's not easy to explain.
All SQL executed by Logstash is no more operational.
Logstash don't retrieve any result SQL when i add a new SQL request in my pipeline.
Thanks
Herve
---
### Author:  [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)
#### Post date: [February 13, 2022, 9:03am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/4 "2022-02-13T09:03:56Z")
How about logs when you add a new SQL or new pipeline? Are there something different?
> **[Logging | Logstash Reference \[8.0\] | Elastic](https://www.elastic.co/guide/en/logstash/current/logging.html)**
You may enable slowlog and check them.
---
### Author:  [@HerveSavard](https://discuss.elastic.co/u/HerveSavard)
#### Post date: [February 14, 2022, 8:43am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/5 "2022-02-14T08:43:35Z")
> [@Tomo\_M](#):
>
> How about logs when you add a new SQL or new pipeline? Are there something different?
Hello,
This new SQL create a new index.
But this SQL connect on 55 systems and retrieve the information needed.
I have a same setup on Logstash DEV but for only 20 connections without any problem.
But with my Logstash Prod with 55 connections the problem occur.
Can you help me to enable Slow Log please?
Is it in log4j2.properties?
Pipeline.yml?
What i need specify?
Many thanks in advace.
Herve
---
### Author:  [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)
#### Post date: [February 14, 2022, 8:55am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/6 "2022-02-14T08:55:58Z")
[Slowlog here](https://www.elastic.co/guide/en/logstash/current/logging.html#_slowlog).
Please use the correct terminology to avoid confusion. What is "new SQL"? A new pipeline with JDBC input plugin?
That said, you may first specify the problem is about adding ANY jdbc requests or a problem of just that specific pipeline.
---
### Author:  [@HerveSavard](https://discuss.elastic.co/u/HerveSavard)
#### Post date: [February 14, 2022, 9:02am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/7 "2022-02-14T09:02:37Z")
Hello,
Config of my pipeline.yml.
cat pipelines.yml
# This file is where you define your pipelines. You can define multiple.
# For more information on multiple pipelines, see the documentation:
# [Multiple Pipelines | Logstash](https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html)
- pipeline.id: KPI
path.config: "/etc/logstash/conf.d/KPI.conf"
- pipeline.id: check
path.config: "/etc/logstash/conf.d/CHECK.conf"
- pipeline.id: Check2
path.config: "/etc/logstash/conf.d/CHECK2.conf"
- pipeline.id: Check3
path.config: "/etc/logstash/conf.d/CHECK3.conf"
- pipeline.id: IBMi\_information
path.config: "/etc/logstash/conf.d/IBMI\_INFORMATION.conf"
- pipeline.id: RUNCHECK
path.config: "/etc/logstash/conf.d/RUNCHECK.conf"
- pipeline.id: RUNCHECKBRMS
path.config: "/etc/logstash/conf.d/RUNCHECKBRMS.conf"
Each config contain Input output with JDBC config with SQL query.
When i try to add a new conf file in my pipeline, all is very slow very slow.
I hope it's more clear.
Many thanks
Herve
---
### Author:  [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)
#### Post date: [February 14, 2022, 9:10am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/8 "2022-02-14T09:10:21Z")
What will happen if you add a pipeline with JDBC input of some simple SQL query. You may specify the problem is about adding ANY SQL requests or a problem of just that added specific pipeline.
Are you sure every new SQL queries included in the new pipeline are reasonably fast?? Doesn't it contain too slow queries and congested?
This is the first step of [Performance Troubleshooting of Logstash](https://www.elastic.co/guide/en/logstash/current/performance-troubleshooting.html).
> 1. **Check the performance of input sources and output destinations:**
>
> - Logstash is only as fast as the services it connects to. Logstash can only consume and produce data as fast as its input and output destinations can!
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 14, 2022, 9:11am UTC](https://discuss.elastic.co/t/logstash-with-jdbc-performance/296984/9 "2022-03-14T09:11:07Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.