# Elastricsearch missing data from couchdb

**URL:** <https://discuss.elastic.co/t/elastricsearch-missing-data-from-couchdb/8636>\
**Category:** Elasticsearch\
**Created:** [August 5, 2012, 2:01am UTC](https://discuss.elastic.co/t/elastricsearch-missing-data-from-couchdb/8636 "2012-08-05T02:01:52Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![zuhaib\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zuhaib_2/32/1896_2.png) [@zuhaib\_2](https://discuss.elastic.co/u/zuhaib_2)\
**Post date:** [August 5, 2012, 2:01am UTC](https://discuss.elastic.co/t/elastricsearch-missing-data-from-couchdb/8636/1 "2012-08-05T02:01:52Z")

</div>

Hello,

I have setup a test env with couchdb and Elastricsearch seeing if we can  
use it in place of couchdb-lucene. But I am seeing a major problem.

After a few days of running in my VM suddenly Elastricsearch stopped seeing  
changes from couchdb, seeing nothing in the log i restarted Elastricsearch  
and suddenly it started to get new documents getting inserted but all the  
doc inserted prior to that did not get index at all. Checking the changes  
on couchdb with the seq id in Elastricsearch shows no changes and it is the  
current according to couchdb. My question is how can I get the old  
documents that Elastricsearch did not index in to be reindexed easily.

A follow up to that is in productions lets say the connections from my  
couchdb to Elastricsearch goes down but docs are still getting inserted in  
to couchdb and then after x time the link goes back up, should all the  
information added to couchdb be index by Elastricsearch or will I have the  
problem I see above?

Thanks  
Zuhaib

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [August 5, 2012, 4:06am UTC](https://discuss.elastic.co/t/elastricsearch-missing-data-from-couchdb/8636/2 "2012-08-05T04:06:56Z")

</div>

I think you are hitting the same issue as here: [Rediriger vers Google&nbsp;Groupes](https://groups.google.com/forum/?hl=fr&fromgroups&nomobile=true#!msg/elasticsearch/WWNIATEqWho/ZZzwL8v77xYJ)

## David

Le 5 août 2012 à 04:01, zuhaib [zsiddique@atlassian.com](mailto:zsiddique@atlassian.com) a écrit :

> Hello,
> 
> I have setup a test env with couchdb and Elastricsearch seeing if we can use it in place of couchdb-lucene. But I am seeing a major problem.
> 
> After a few days of running in my VM suddenly Elastricsearch stopped seeing changes from couchdb, seeing nothing in the log i restarted Elastricsearch and suddenly it started to get new documents getting inserted but all the doc inserted prior to that did not get index at all. Checking the changes on couchdb with the seq id in Elastricsearch shows no changes and it is the current according to couchdb. My question is how can I get the old documents that Elastricsearch did not index in to be reindexed easily.
> 
> A follow up to that is in productions lets say the connections from my couchdb to Elastricsearch goes down but docs are still getting inserted in to couchdb and then after x time the link goes back up, should all the information added to couchdb be index by Elastricsearch or will I have the problem I see above?
> 
> Thanks  
> Zuhaib

---

<div class="post-metadata">

**Author:** ![zuhaib\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zuhaib_2/32/1896_2.png) [@zuhaib\_2](https://discuss.elastic.co/u/zuhaib_2)\
**Post date:** [August 6, 2012, 7:13pm UTC](https://discuss.elastic.co/t/elastricsearch-missing-data-from-couchdb/8636/3 "2012-08-06T19:13:44Z")

</div>

That seems close but not the same, in that case it seems the River plugin  
would actually crash. In my case the couchdb river is still running but it  
seems new data does not get pulled in if ES was down or the link was cut.

On Saturday, August 4, 2012 9:06:56 PM UTC-7, David Pilato wrote:

> I think you are hitting the same issue as here:  
> [Rediriger vers Google&nbsp;Groupes](https://groups.google.com/forum/?hl=fr&fromgroups&nomobile=true#!msg/elasticsearch/WWNIATEqWho/ZZzwL8v77xYJ)
> 
> ## David
> 
> Le 5 août 2012 à 04:01, zuhaib [zsiddique@atlassian.com](mailto:zsiddique@atlassian.com) a écrit :
> 
> Hello,
> 
> I have setup a test env with couchdb and Elastricsearch seeing if we can  
> use it in place of couchdb-lucene. But I am seeing a major problem.
> 
> After a few days of running in my VM suddenly Elastricsearch stopped  
> seeing changes from couchdb, seeing nothing in the log i  
> restarted Elastricsearch and suddenly it started to get new documents  
> getting inserted but all the doc inserted prior to that did not get index  
> at all. Checking the changes on couchdb with the seq id in Elastricsearch  
> shows no changes and it is the current according to couchdb. My question  
> is how can I get the old documents that Elastricsearch did not index in to  
> be reindexed easily.
> 
> A follow up to that is in productions lets say the connections from my  
> couchdb to Elastricsearch goes down but docs are still getting inserted in  
> to couchdb and then after x time the link goes back up, should all the  
> information added to couchdb be index by Elastricsearch or will I have the  
> problem I see above?
> 
> Thanks  
> Zuhaib

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:17am UTC](https://discuss.elastic.co/t/elastricsearch-missing-data-from-couchdb/8636/4 "2017-07-06T03:17:35Z")

</div>


