I have a very large Index in ES (millions of entries over 100s of GB) with
too few Shards.
And I want only to create the same Index but with more, smaller, efficient
And I would love it if this could happen quickly (minutes?)
My googling indicates that the elasticsearch-reindex Plugin
(https://github.com/karussell/elasticsearch-reindex) is the best approach.
Is that still the case??
Under the covers elasticsearch-reindex uses the recommended scan-and-scroll
But reading the doc/code in the elasticsearch-reindex Plugin, they
indicate that perhaps they should have implemented it as a River.
And I’ve not been able to find a River that accomplished this same task.
It seems that this might be a pretty common thing to need to do, and that
there may be a very efficient way to accomplish it that I am missing.
And it seems that it might be fastest to have some sort of very fast
streaming process that could essentially stream the entries of indexOld to
indexNew with a new number of Shards.
Is elasticsearch-reindex still the best tool for this job??
(I am on ES 1.0.2)
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to email@example.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/14711f9d-0848-4923-b00a-62cd85d8a337%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.