# Randomly missing events

**URL:** <https://discuss.elastic.co/t/randomly-missing-events/297377>\
**Category:** Logstash\
**Created:** [February 16, 2022, 2:18pm UTC](https://discuss.elastic.co/t/randomly-missing-events/297377 "2022-02-16T14:18:21Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Nasser](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nasser/32/99437_2.png) [@Nasser](https://discuss.elastic.co/u/Nasser)\
**Post date:** [February 16, 2022, 2:18pm UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/1 "2022-02-16T14:18:21Z")

</div>

Hi  
i have one pipeline processing 16 `.conf file`  
in each file i have 2 jdbc  
the issue is sometimes randomly i see logstash miss some jdbc !  
i check the `logstash-plain.log` but nothing abnormal !

i tired to update logstash to latest version but still the issue appear  
please your help ☹

---

<div class="post-metadata">

**Author:** ![Tomo\_M](https://avatars.discourse-cdn.com/v4/letter/t/848f3c/32.png) [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)\
**Post date:** [February 16, 2022, 2:55pm UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/2 "2022-02-16T14:55:39Z")

</div>

> [@Nasser](#):
>
> miss some jdbc

What does this mean? Logstash miss some rows in SQL?  
Can you share the pipelien?

---

<div class="post-metadata">

**Author:** ![Nasser](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nasser/32/99437_2.png) [@Nasser](https://discuss.elastic.co/u/Nasser)\
**Post date:** [February 16, 2022, 9:46pm UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/3 "2022-02-16T21:46:27Z")

</div>

thanks for your reply  
The scenario is sometimes all input run, and sometimes some of the input run and the other input not  
there is no pattern for input running

also if you can see from my dashboard there is gaps  
there is no issue in the elastic, because the input didn't get triggered in the first place !

![CS](https://us1.discourse-cdn.com/elastic/original/3X/b/b/bb196819922d70088236be3cc6778141300ee665.png)

here one of my file

```auto
input {
  jdbc {
    jdbc_driver_library => "/opt/ojdbc7.jar"
    jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"
    jdbc_connection_string => "jdbc:oracle:thin:@*:*/*"
    jdbc_user => "*"
              jdbc_password => "*"
    schedule => "* * * * *"
    statement => "select * from my table"

  }
}
##############################################
input {
jdbc {
    jdbc_driver_library => "/opt/ojdbc7.jar"
    jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"
    jdbc_connection_string => "jdbc:oracle:thin:@*/*"
    jdbc_user => "*"
              jdbc_password => "*"
    schedule => "* * * * *"
    statement => "select * from my table"

  }
}

```

my pipeline file as default

```auto
- pipeline.id: my-pipeline_1
  path.config: "my config path"

```

i hope my issue clear

---

<div class="post-metadata">

**Author:** ![Tomo\_M](https://avatars.discourse-cdn.com/v4/letter/t/848f3c/32.png) [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)\
**Post date:** [February 17, 2022, 7:01am UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/4 "2022-02-17T07:01:12Z")

</div>

Isn't it just because there is no data in the daytime histogram buckets? Does data in gaps exist in the SQL?

---

<div class="post-metadata">

**Author:** ![Nasser](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nasser/32/99437_2.png) [@Nasser](https://discuss.elastic.co/u/Nasser)\
**Post date:** [February 17, 2022, 7:49am UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/5 "2022-02-17T07:49:31Z")

</div>

no it's not exist in sql  
if i run the sql query i will have a result  
but the issue logstash didn't execute the sql query

---

<div class="post-metadata">

**Author:** ![Tomo\_M](https://avatars.discourse-cdn.com/v4/letter/t/848f3c/32.png) [@Tomo\_M](https://discuss.elastic.co/u/Tomo_M)\
**Post date:** [February 20, 2022, 11:07am UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/6 "2022-02-20T11:07:04Z")

</div>

It is possibly something related to this topic: "[Dealing With Large Result-sets](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#_dealing_with_large_result_sets)". That SQL query returns all the rows?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 20, 2022, 11:07am UTC](https://discuss.elastic.co/t/randomly-missing-events/297377/7 "2022-03-20T11:07:14Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.