# Dumping index is slow as hell

**URL:** <https://discuss.elastic.co/t/dumping-index-is-slow-as-hell/16009>\
**Category:** Elasticsearch\
**Created:** [February 25, 2014, 1:11pm UTC](https://discuss.elastic.co/t/dumping-index-is-slow-as-hell/16009 "2014-02-25T13:11:58Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Attila\_Bukor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/attila_bukor/32/1667_2.png) [@Attila\_Bukor](https://discuss.elastic.co/u/Attila_Bukor)\
**Post date:** [February 25, 2014, 1:11pm UTC](https://discuss.elastic.co/t/dumping-index-is-slow-as-hell/16009/1 "2014-02-25T13:11:58Z")

</div>

Hey guys,

I needed to migrate an index to a new cluster and after a lot of hesitating  
I decided to give it a try to taskrabbit's elasticsearch-dump:

> **[taskrabbit/elasticsearch-dump](https://github.com/taskrabbit/elasticsearch-dump)**
>
> elasticsearch-dump - Import and export tools for elasticsearch

I tested it with 10k documents, which worked fine, so I decided to migrate  
the real data to the new cluster with the following command:

elasticdump --input=http://oldcluster:9200/my\_index   
--output=http://newcluster:9200/my\_index

"my\_index" contains ~5 million documents, so I expected it to take a while,  
but not _this_ long. It's been running since 10 AM UTC+1 yesterday and it's  
migrated only a bit over 1.5 million docs so far - in roughly 28 hours.

When it started, it indexed around 100 docs per second, by the time I went  
home from work (around 5 PM UTC+1), it was only around 30 docs/s, now it's  
around 10 docs/s.

Being a newbie with ElasticSearch, I don't even know how to diagnose what is  
the reason of this slowness. Could you help me with this?

Keep in mind that I'm at work for 2 or 3 more hours today, but after that,  
I won't have access to the servers until next Monday. Feel free to suggest  
anything in that time too, I will read it and try to reply, but can't look  
into anything or do anything about it.

Regards,  
Attila Bukor

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/lei4qh%24370%241%40ger.gmane.org](https://groups.google.com/d/msgid/elasticsearch/lei4qh%24370%241%40ger.gmane.org).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Binh\_Ly](https://avatars.discourse-cdn.com/v4/letter/b/ce7236/32.png) [@Binh\_Ly](https://discuss.elastic.co/u/Binh_Ly)\
**Post date:** [February 25, 2014, 3:33pm UTC](https://discuss.elastic.co/t/dumping-index-is-slow-as-hell/16009/2 "2014-02-25T15:33:30Z")

</div>

Not sure about the answer to your question, but if you're on ES 1.0, you  
might want to give snapshot/restore a try:

[http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-snapshots.html](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-snapshots.html)

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/220e04db-04d0-4fc3-bdaa-6792f4ddc6f9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/220e04db-04d0-4fc3-bdaa-6792f4ddc6f9%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [February 25, 2014, 7:43pm UTC](https://discuss.elastic.co/t/dumping-index-is-slow-as-hell/16009/3 "2014-02-25T19:43:28Z")

</div>

Have you benchmarked your cluster? How many docs can you index per second  
with bulk indexing?

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoH%3DEDqwhKC%3DgZXOwvdf%2B6FJ%3DBOrLmNFpSuraX2-JcTbYA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoH%3DEDqwhKC%3DgZXOwvdf%2B6FJ%3DBOrLmNFpSuraX2-JcTbYA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:47am UTC](https://discuss.elastic.co/t/dumping-index-is-slow-as-hell/16009/4 "2017-07-06T01:47:20Z")

</div>


