# Imported records in Elasticsearch surpassed the original count in csv

**URL:** <https://discuss.elastic.co/t/imported-records-in-elasticsearch-surpassed-the-original-count-in-csv/130185>\
**Category:** Elasticsearch\
**Created:** [May 2, 2018, 6:20am UTC](https://discuss.elastic.co/t/imported-records-in-elasticsearch-surpassed-the-original-count-in-csv/130185 "2018-05-02T06:20:44Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![StephenC](https://avatars.discourse-cdn.com/v4/letter/s/8e8cbc/32.png) [@StephenC](https://discuss.elastic.co/u/StephenC)\
**Post date:** [May 2, 2018, 6:20am UTC](https://discuss.elastic.co/t/imported-records-in-elasticsearch-surpassed-the-original-count-in-csv/130185/1 "2018-05-02T06:20:44Z")

</div>

I am using Hive-Elasticsearch Integration to import csv of 500gb which consists of 550 million records.  
I have 5 nodes cluster, with index set as: Replica=0, shards=10., refresh\_interval = -1.

My job ran for around 35 hours and my count of records going in to ES surpassed 550million. I had to stop the job, and the state when I stopped the job was:  
Count of records:- 645 million & size of index = 490gb.

I am unable to figure out why the job dint end when it imported 50 million records? How much longer do I need to wait for it to complete?  
Any help would be appreciated.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 30, 2018, 6:20am UTC](https://discuss.elastic.co/t/imported-records-in-elasticsearch-surpassed-the-original-count-in-csv/130185/2 "2018-05-30T06:20:48Z")

</div>

Closed on May 30, 2018, 6:20am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.