# Couchdb river index performance slows down after a few hours

**URL:** <https://discuss.elastic.co/t/couchdb-river-index-performance-slows-down-after-a-few-hours/11023>\
**Category:** Elasticsearch\
**Created:** [March 5, 2013, 7:55pm UTC](https://discuss.elastic.co/t/couchdb-river-index-performance-slows-down-after-a-few-hours/11023 "2013-03-05T19:55:07Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![zuhaib\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zuhaib_2/32/1896_2.png) [@zuhaib\_2](https://discuss.elastic.co/u/zuhaib_2)\
**Post date:** [March 5, 2013, 7:55pm UTC](https://discuss.elastic.co/t/couchdb-river-index-performance-slows-down-after-a-few-hours/11023/1 "2013-03-05T19:55:07Z")

</div>

Hey,

I asked about this long ago and got no traction so I thought let me try  
again but with new info. We are trying to import ~400m docs from couchdb  
to ES using the couchdb-river. Things start out super fast (2,000 docs/s  
according to bigdesk) but after a few hours (4-12 hr) it will fall down to  
50 docs/s. Restarting ES and boom back to the fast indexing. I am using  
the following settings for couchdb river

```
    "bulk_size": "2500",
    "bulk_timeout": "40ms"

```

And I have tuned (i think) ES to be as fast as possible for the indexing.  
I have followed the info  
here: [http://www.elasticsearch.org/blog/2011/03/23/update-settings.html](http://www.elasticsearch.org/blog/2011/03/23/update-settings.html)  
already and set number\_of\_shards: 20, number\_of\_replicas:  
0, indices.memory.index\_buffer\_size: 65 in attempts to help the indexing.  
The box is also pretty beefy, its a m1.xlarge with a 2000IOPS EBS mounted  
to it and I am using the ES cookbook so it already setup the HEAP  
correctly. Watching things like disk and cpu have power to spare.

Any idea what I am missing? I am pretty sure others have used the  
couchdb-river to import large number of docs at decent speed.

Zuhaib

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:48am UTC](https://discuss.elastic.co/t/couchdb-river-index-performance-slows-down-after-a-few-hours/11023/2 "2017-07-06T02:48:13Z")

</div>


