# Excessive time to recreate the index

**URL:** <https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699>\
**Category:** Kibana\
**Created:** [March 15, 2022, 8:36am UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699 "2022-03-15T08:36:53Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![hrodriguez](https://avatars.discourse-cdn.com/v4/letter/h/e47774/32.png) [@hrodriguez](https://discuss.elastic.co/u/hrodriguez)\
**Post date:** [March 15, 2022, 8:36am UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/1 "2022-03-15T08:36:53Z")

</div>

Hi!

I am working with Kibana and I have some problems with my index.

I use two index one is allways correct and never lost data.  
These index are made by a consult to PosgreSQL this only take 100ms but on kibana the data disappear for 10 min aprox until it recreate the index.

We have checked the logs and it doesn´t seem nothing unusual.

Additional information:

- Kibana version: 6.8.23
- Elasticsearch version: 6.8.23
- Lucene version: 7.7.3
- Logstash version: 6.8.23
- jdbc version: 42.3.3

Thank you in advance for your help.

---

<div class="post-metadata">

**Author:** ![nickpeihl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nickpeihl/32/112622_2.png) [@nickpeihl](https://discuss.elastic.co/u/nickpeihl)\
**Post date:** [March 15, 2022, 1:02pm UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/2 "2022-03-15T13:02:50Z")

</div>

Hi @hrodriguez. I don't have enough information from you. Can you share your Logstash configuration?

---

<div class="post-metadata">

**Author:** ![hrodriguez](https://avatars.discourse-cdn.com/v4/letter/h/e47774/32.png) [@hrodriguez](https://discuss.elastic.co/u/hrodriguez)\
**Post date:** [March 15, 2022, 3:51pm UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/3 "2022-03-15T15:51:09Z")

</div>

Of course.

On **logstash.yml** :

```auto
# ------------ Data path ------------------
#
# Which directory should be used by logstash and its plugins
# for any persistent needs. Defaults to LOGSTASH_HOME/data
#
path.data: /var/lib/logstash

# ------------ Debugging Settings --------------
#
# Options for log.level:
# * fatal
# * error
# * warn
# * info (default)
# * debug
# * trace
#
# log.level: info
path.logs: /var/log/logstash

```

And the **.conf** that has the problem is:

```auto

input {
jdbc {
jdbc_connection_string => "jdbc:postgresql://localhost:5432/my_ddbb"
jdbc_user => "postgres"
jdbc_password => " ****"
jdbc_driver_class => "org.postgresql.Driver"
clean_run => false
use_column_value => true
tracking_column => "column"
schedule => "*/30 * * * *"
statement_filepath => "/opt/elastic/indexes/my_select.sql"
}
}
output {
elasticsearch {
hosts => ["http://my_host"]
index => "my_index"
document_id => "my_index%{column}"
doc_as_upsert => true
#user => “es_user”
#password => “es_password”
}
}

```

If you need further information do not hesitate to ask for it.

---

<div class="post-metadata">

**Author:** ![nickpeihl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nickpeihl/32/112622_2.png) [@nickpeihl](https://discuss.elastic.co/u/nickpeihl)\
**Post date:** [March 15, 2022, 6:55pm UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/4 "2022-03-15T18:55:06Z")

</div>

Thanks. If I understand correctly, your `schedule` is running every 30 minutes. Is that not what is causing the issue?

---

<div class="post-metadata">

**Author:** ![hrodriguez](https://avatars.discourse-cdn.com/v4/letter/h/e47774/32.png) [@hrodriguez](https://discuss.elastic.co/u/hrodriguez)\
**Post date:** [March 17, 2022, 6:31am UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/5 "2022-03-17T06:31:43Z")

</div>

I doubt it, because I have tried with different schedules, without it and had the same problem. It seems that when the other index runs this one too.

---

<div class="post-metadata">

**Author:** ![nickpeihl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nickpeihl/32/112622_2.png) [@nickpeihl](https://discuss.elastic.co/u/nickpeihl)\
**Post date:** [March 17, 2022, 12:00pm UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/6 "2022-03-17T12:00:49Z")

</div>

Hi @hrodriguez. I'm not sure if this is an issue with Kibana or Logstash? Does the data exist in Elasticsearch, but not appear in Kibana? If the data is not getting added to Elasticsearch we may want to move this to the Logstash forum for a wider audience.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 14, 2022, 12:01pm UTC](https://discuss.elastic.co/t/excessive-time-to-recreate-the-index/299699/7 "2022-04-14T12:01:16Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.