# Data lost in Elasticsearch index

**URL:** <https://discuss.elastic.co/t/data-lost-in-elasticsearch-index/57466>\
**Category:** Elasticsearch\
**Created:** [August 8, 2016, 11:14am UTC](https://discuss.elastic.co/t/data-lost-in-elasticsearch-index/57466 "2016-08-08T11:14:41Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![MrAV](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mrav/32/557_2.png) [@MrAV](https://discuss.elastic.co/u/MrAV)\
**Post date:** [August 8, 2016, 11:14am UTC](https://discuss.elastic.co/t/data-lost-in-elasticsearch-index/57466/1 "2016-08-08T11:14:41Z")

</div>

Hi,  
I'm using elasticsearch-jdbc importer, which inserts data from MS SQL to Elasticsearch indexes.  
Today I've faced an issue: data losts in one of the indexes.

Neither elasticsearch-jdbc not elasticsearch.log contains any error messages.

A part of the elasticsearch-jdbc importer is below:

```
 [13:31:00,772][DEBUG][importer.jdbc.source.standard][pool-3-thread-1] org.xbib.elasticsearch.jdbc.strategy.standard.StandardSource@4d4773ed using read connection ConnectionID:1 ClientConnectionId: ae7ffaa4-c262-483f-bbc5-eaa2ac199ae6 for executing query
 [13:42:12,218][DEBUG][importer.jdbc.source.standard][pool-3-thread-1] merged 1893926 rows
[13:42:12,219][DEBUG][importer.jdbc.source.standard][pool-3-thread-1] shutdown
[13:42:12,219][DEBUG][importer.jdbc.source.standard][pool-3-thread-1] read connection closed
[13:42:12,219][DEBUG][importer.jdbc.source.standard][pool-3-thread-1] write connection closed

```

And some information about index:

**before import**

```
health status index pri rep docs.count docs.deleted store.size pri.store.size
green open alltrades 5 0 113443017 553746 18.5gb 18.5gb

```

**after import**

```
health status index pri rep docs.count docs.deleted store.size pri.store.size
green open alltrades 5 0 115336943 553746 19.3gb 19.3gb

```

So index had increased for 1893926 records (the same number as "MSSQL exporter" sent to Elsticsearch ) but Kibana/Grafana couldn't find these data.

Can you please advise how to find these data and avoid this kind of issue?

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [August 8, 2016, 9:47pm UTC](https://discuss.elastic.co/t/data-lost-in-elasticsearch-index/57466/2 "2016-08-08T21:47:23Z")

</div>

JDBC importer executes a refresh after each cycle, so the docs should be searchable.

To be extra safe, you could execute a refresh again, and check the index with curl or sense or another tool besides Kibana.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:29pm UTC](https://discuss.elastic.co/t/data-lost-in-elasticsearch-index/57466/3 "2017-07-05T22:29:16Z")

</div>


