# Data Loss in elasticsearch in high load

**URL:** <https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515>\
**Category:** Elasticsearch\
**Created:** [January 8, 2018, 11:48am UTC](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515 "2018-01-08T11:48:07Z")\
**Posts on this page:** 5\
**Page:** 2

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 9, 2018, 12:27pm UTC](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515/22 "2018-01-09T12:27:33Z")

</div>

Why not simply `GET service_transaction/_count`? Since all documents have a different ID, that should do the work, shouldn't it?

---

<div class="post-metadata">

**Author:** ![paramlogicoy](https://avatars.discourse-cdn.com/v4/letter/p/e5b9ba/32.png) [@paramlogicoy](https://discuss.elastic.co/u/paramlogicoy)\
**Post date:** [January 9, 2018, 12:31pm UTC](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515/23 "2018-01-09T12:31:48Z")

</div>

> [@val](#):
>
> GET service\_transaction/\_count?

Not exactly.

If you see my code.

The top most for loop is generating transaction ids.

for this transaction ids i will have say 5 document. [Inner for loop] . This count will varies. Sometime 5, sometime 500. For simple example i made static values. But My JMX program is like that.

so the transaction id is : 10000  
but document inserted are 50000

i need to know how many unique transaction id generated from GET.

---

<div class="post-metadata">

**Author:** ![val](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/val/32/138203_2.png) [@val](https://discuss.elastic.co/u/val)\
**Post date:** [January 9, 2018, 12:35pm UTC](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515/24 "2018-01-09T12:35:30Z")

</div>

It would be easier to read it if you formatted your code properly 🙂 You can use the "preformatted text" function of the editor.

---

<div class="post-metadata">

**Author:** ![paramlogicoy](https://avatars.discourse-cdn.com/v4/letter/p/e5b9ba/32.png) [@paramlogicoy](https://discuss.elastic.co/u/paramlogicoy)\
**Post date:** [January 9, 2018, 12:36pm UTC](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515/25 "2018-01-09T12:36:46Z")

</div>

Sorry !! Will try here.

import java.io.IOException;  
import java.util.HashMap;  
import java.util.HashSet;  
import java.util.Map;  
import java.util.Set;  
import java.util.UUID;  
import java.util.logging.Level;  
import java.util.logging.Logger;  
import org.apache.http.HttpHost;  
import org.elasticsearch.action.bulk.BulkRequest;  
import org.elasticsearch.action.index.IndexRequest;  
import org.elasticsearch.client.RestClient;  
import org.elasticsearch.client.RestHighLevelClient;

/\*\*

- @author Param  
\*/  
public class SampleLoadProgram {

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 6, 2018, 12:36pm UTC](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515/26 "2018-02-06T12:36:48Z")

</div>

Closed on February 6, 2018, 12:36pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/data-loss-in-elasticsearch-in-high-load/114515.md?page=1)