# Missing Records

**URL:** <https://discuss.elastic.co/t/missing-records/3988>\
**Category:** Elasticsearch\
**Created:** [February 26, 2011, 7:35am UTC](https://discuss.elastic.co/t/missing-records/3988 "2011-02-26T07:35:45Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jagmee](https://avatars.discourse-cdn.com/v4/letter/j/ecd19e/32.png) [@Jagmee](https://discuss.elastic.co/u/Jagmee)\
**Post date:** [February 26, 2011, 7:35am UTC](https://discuss.elastic.co/t/missing-records/3988/1 "2011-02-26T07:35:45Z")

</div>

I have import 4 set of data in one indices(DB), each set contain  
10,00,000 records, first 3 set of importing data no issues. After the  
4th importing Completed I saw 40,00,000 records in this DB and the  
cluster health was ,"status":"red", "initializing\_shards":2 ,  
unfortunately I was stop the ES service. After the ES restart I see  
only 30,96,990 records remaining 9,03,010 records missed. I have  
checked all imports id finally I found the missing records were  
founded in 4th set of Import .

1. Is this problem raised due to Stopping of the ES Service at the  
time shards Initialization, if yes means how we can recover the  
missing records.
2. If no means please let me what is the problem.

as mentioned below index & gateway details  
index :  
number\_of\_shards : 2  
number\_of\_replicas : 0

Gateway type : FS

Version: ElasticSearch is 0.14.3

Thankyou

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [February 26, 2011, 10:29pm UTC](https://discuss.elastic.co/t/missing-records/3988/2 "2011-02-26T22:29:34Z")

</div>

Were there memory problems in the nodes? Did you see failures? Also, are you configuring the FS gateway on a _shared_ file system that both nodes see?  
On Saturday, February 26, 2011 at 9:35 AM, Jagmee wrote:

> I have import 4 set of data in one indices(DB), each set contain  
> 10,00,000 records, first 3 set of importing data no issues. After the  
> 4th importing Completed I saw 40,00,000 records in this DB and the  
> cluster health was ,"status":"red", "initializing\_shards":2 ,  
> unfortunately I was stop the ES service. After the ES restart I see  
> only 30,96,990 records remaining 9,03,010 records missed. I have  
> checked all imports id finally I found the missing records were  
> founded in 4th set of Import .
> 
> 1. Is this problem raised due to Stopping of the ES Service at the  
> time shards Initialization, if yes means how we can recover the  
> missing records.
> 2. If no means please let me what is the problem.
> 
> as mentioned below index & gateway details  
> index :  
> number\_of\_shards : 2  
> number\_of\_replicas : 0
> 
> Gateway type : FS
> 
> Version: Elasticsearch is 0.14.3
> 
> Thankyou

---

<div class="post-metadata">

**Author:** ![Jagmee](https://avatars.discourse-cdn.com/v4/letter/j/ecd19e/32.png) [@Jagmee](https://discuss.elastic.co/u/Jagmee)\
**Post date:** [February 28, 2011, 9:17am UTC](https://discuss.elastic.co/t/missing-records/3988/3 "2011-02-28T09:17:15Z")

</div>

There were no symptoms of memory problems, I have seen all 40,00,000  
documents after indexing completed. Also, there was no failures.  
I have configured the FS gateway in a shared location where both the  
nodes can access it.  
-- Jagmee

On Feb 27, 3:29 am, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote:

> Were there memory problems in the nodes? Did you see failures? Also, are you configuring the FS gateway on a _shared_ file system that both nodes see?
> 
> On Saturday, February 26, 2011 at 9:35 AM, Jagmee wrote:
> 
> > I have import 4 set of data in one indices(DB), each set contain  
> > 10,00,000 records, first 3 set of importing data no issues. After the  
> > 4th importing Completed I saw 40,00,000 records in this DB and the  
> > cluster health was ,"status":"red", "initializing\_shards":2 ,  
> > unfortunately I was stop the ES service. After the ES restart I see  
> > only 30,96,990 records remaining 9,03,010 records missed. I have  
> > checked all imports id finally I found the missing records were  
> > founded in 4th set of Import .
> 
> > 1. Is this problem raised due to Stopping of the ES Service at the  
> > time shards Initialization, if yes means how we can recover the  
> > missing records.
> > 2. If no means please let me what is the problem.
> 
> > as mentioned below index & gateway details  
> > index :  
> > number\_of\_shards : 2  
> > number\_of\_replicas : 0
> 
> > Gateway type : FS
> 
> > Version: Elasticsearch is 0.14.3
> 
> > Thankyou- Hide quoted text -
> 
> - Show quoted text -

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:11am UTC](https://discuss.elastic.co/t/missing-records/3988/4 "2017-07-06T04:11:17Z")

</div>


