# Some times data Loss in elasticsearch

**URL:** <https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624>\
**Category:** Elasticsearch\
**Created:** [June 13, 2019, 11:13am UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624 "2019-06-13T11:13:35Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Rajitha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rajitha/32/53972_2.png) [@Rajitha](https://discuss.elastic.co/u/Rajitha)\
**Post date:** [June 13, 2019, 11:13am UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624/1 "2019-06-13T11:13:35Z")

</div>

sometimes we are having a data loss issue in our elastic environment. when we debug the environment we have found out that all the data that is sent by the filebeat is going through the logstash filter and the out put plugin and also saved in the csv file. but some of them are not published to the elasticsearch and that data are not visible in the kibana dashboard. other data are successfully published to the elasticsearch.

In our environment we have used elasticsearch 7.0, kibana 7.0, logstash 6.3 and filebeat 6.3. we have using cloud elasticearch stack.

Please help

---

<div class="post-metadata">

**Author:** ![harshbajaj16](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/harshbajaj16/32/44970_2.png) [@harshbajaj16](https://discuss.elastic.co/u/harshbajaj16)\
**Post date:** [June 13, 2019, 11:17am UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624/2 "2019-06-13T11:17:52Z")

</div>

Hi @Rajitha,

Could you please tell the reason behind using different version. I think you should use same version of all components.

> [@](#):
>
> In our environment we have used elasticsearch 7.0, kibana 7.0, logstash 6.3 and filebeat 6.3. we have using cloud elasticearch stack.

However, For data loss have you checked the elasticsearch and logstash logs???

Regards,  
Harsh Bajaj

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 13, 2019, 11:32am UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624/3 "2019-06-13T11:32:06Z")

</div>

> [@Rajitha](#):
>
> but some of them are not published to the elasticsearch

How do you know that?

---

<div class="post-metadata">

**Author:** ![Rajitha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rajitha/32/53972_2.png) [@Rajitha](https://discuss.elastic.co/u/Rajitha)\
**Post date:** [June 13, 2019, 12:24pm UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624/5 "2019-06-13T12:24:47Z")

</div>

> [@harshbajaj16](#):
>
> h logs???

yes i have checked in the logstash logs and its not giving any error. some of same data types are already publishing to the elasticsearch. data loss happens only in some period of time.  
And i dont know how to read elasticsearch logs in the cloud ELK stack dashboard. so i couldn't read the elasticsearch logs.  
thanks

---

<div class="post-metadata">

**Author:** ![Rajitha](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rajitha/32/53972_2.png) [@Rajitha](https://discuss.elastic.co/u/Rajitha)\
**Post date:** [June 13, 2019, 12:25pm UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624/6 "2019-06-13T12:25:23Z")

</div>

that data are not available in the kibana dashboard.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 11, 2019, 12:25pm UTC](https://discuss.elastic.co/t/some-times-data-loss-in-elasticsearch/185624/7 "2019-07-11T12:25:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
