# Loosing data in elasticsearch

**URL:** <https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433>\
**Category:** Elasticsearch\
**Created:** [July 10, 2017, 9:07am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433 "2017-07-10T09:07:38Z")\
**Posts on this page:** 6\
**Page:** 2

<div class="post-metadata">

**Author:** ![Idarlington](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/idarlington/32/19887_2.png) [@Idarlington](https://discuss.elastic.co/u/Idarlington)\
**Post date:** [July 10, 2017, 11:10am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433/21 "2017-07-10T11:10:41Z")

</div>

This makes sense, this would be from the kafka elasticsearch connector as I don't have any delete function enabled.

---

<div class="post-metadata">

**Author:** ![Idarlington](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/idarlington/32/19887_2.png) [@Idarlington](https://discuss.elastic.co/u/Idarlington)\
**Post date:** [July 10, 2017, 11:38am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433/22 "2017-07-10T11:38:44Z")

</div>

Here is the index setting:

```auto
{"grits":{"settings":{"index":{"creation_date":"1493658495456","number_of_shards":"5","number_of_replicas":"1","uuid":"EZ6LmCbxS3WSXlt20Q8HXw","version":{"created":"2000099"}}}}}

```

Can't find anything on ttl

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [July 10, 2017, 11:52am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433/23 "2017-07-10T11:52:33Z")

</div>

That is good, because it was deprecated for a reason. I notice that you have a lot of nested fields. As each of the nested documents is stored as a separate document in Elasticsearch and all documents are updated when the main document is, it can mean that updating a single document will lead to multiple documents being updated and shown as deleted in the stats.

---

<div class="post-metadata">

**Author:** ![rmoff](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rmoff/32/20212_2.png) [@rmoff](https://discuss.elastic.co/u/rmoff)\
**Post date:** [July 19, 2017, 6:08am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433/24 "2017-07-19T06:08:48Z")

</div>

For reference, related discussion : [https://stackoverflow.com/questions/45018344/using-elasticsearch-generated-ids-in-kafka-elasticsearch-connector/45182181#45182181](https://stackoverflow.com/questions/45018344/using-elasticsearch-generated-ids-in-kafka-elasticsearch-connector/45182181#45182181)

---

<div class="post-metadata">

**Author:** ![Idarlington](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/idarlington/32/19887_2.png) [@Idarlington](https://discuss.elastic.co/u/Idarlington)\
**Post date:** [July 20, 2017, 10:27am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433/25 "2017-07-20T10:27:11Z")

</div>

Thanks @Christian_Dahlqvist and @warkolm, It seems the problem has been resolved by changing to a different elasticsearch connector.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 17, 2017, 10:27am UTC](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433/26 "2017-08-17T10:27:42Z")

</div>

Closed on August 17, 2017, 10:27am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/loosing-data-in-elasticsearch/92433.md?page=1)