roger
October 23, 2014, 4:47pm
1
I'm reindexing a ElasticSearch base with 50m docs using the scroll-scan
Is there a way to redo the query to retrieve the left docs? Like using
Would the the internal order of the scan query be the same with a second
I can assure that no new docs were indexed in the old index since the
--elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/69ec11c9-774e-42df-be57-fd870d347743%40googlegroups.com .https://groups.google.com/d/optout .
The scroll is available based on a timeout value you give it. Everytimetime
You could track the last scroll id you used and try it again from there?
On Thursday, 23 October 2014 12:47:02 UTC-4, Roger de Cordova Farias wrote:
I'm reindexing a Elasticsearch base with 50m docs using the scroll-scan
Is there a way to redo the query to retrieve the left docs? Like using
Would the the internal order of the scan query be the same with a second
I can assure that no new docs were indexed in the old index since the
--elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/45b51276-daa4-4f39-b46c-017296db689a%40googlegroups.com .https://groups.google.com/d/optout .
roger
October 23, 2014, 7:43pm
3
Hmm, I was using a small ttl, just enough to process each scroll call, but
That is a good idea, thanks
2014-10-23 17:12 GMT-02:00 John Smith java.dev.mtl@gmail.com :
The scroll is available based on a timeout value you give it.
You could track the last scroll id you used and try it again from there?
On Thursday, 23 October 2014 12:47:02 UTC-4, Roger de Cordova Farias wrote:
I'm reindexing a Elasticsearch base with 50m docs using the scroll-scan
Is there a way to redo the query to retrieve the left docs? Like using
Would the the internal order of the scan query be the same with a second
I can assure that no new docs were indexed in the old index since the
--https://groups.google.com/d/topic/elasticsearch/NbshHCrBHoM/unsubscribe .elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/45b51276-daa4-4f39-b46c-017296db689a%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/45b51276-daa4-4f39-b46c-017296db689a%40googlegroups.com?utm_medium=email&utm_source=footer
For more options, visit https://groups.google.com/d/optout .
--elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/CAJp2532aT3fhY6axy%3DRwCG3Ukh9ivP1fmqoUs3pJa65e8oAs6A%40mail.gmail.com .https://groups.google.com/d/optout .
Small ttl is ok (well adjusted properly for you process) because everytime
I'm curious if you can re-use the scroll id. It's not specifically
On Thursday, 23 October 2014 15:44:04 UTC-4, Roger de Cordova Farias wrote:
Hmm, I was using a small ttl, just enough to process each scroll call, but
That is a good idea, thanks
2014-10-23 17:12 GMT-02:00 John Smith <java.d...@gmail.com <javascript:>>:
The scroll is available based on a timeout value you give it.
You could track the last scroll id you used and try it again from there?
On Thursday, 23 October 2014 12:47:02 UTC-4, Roger de Cordova Farias
I'm reindexing a Elasticsearch base with 50m docs using the scroll-scan
Is there a way to redo the query to retrieve the left docs? Like using
Would the the internal order of the scan query be the same with a second
I can assure that no new docs were indexed in the old index since the
--https://groups.google.com/d/topic/elasticsearch/NbshHCrBHoM/unsubscribe .elasticsearc...@googlegroups.com <javascript:>.https://groups.google.com/d/msgid/elasticsearch/45b51276-daa4-4f39-b46c-017296db689a%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/45b51276-daa4-4f39-b46c-017296db689a%40googlegroups.com?utm_medium=email&utm_source=footer
For more options, visit https://groups.google.com/d/optout .
--elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/ec345d9e-19b4-4d2c-985a-fbf245e31a19%40googlegroups.com .https://groups.google.com/d/optout .
roger
October 23, 2014, 8:48pm
5
I know it resets the ttl on each scroll call, but since I don't have an
I just tested the re-use of the scroll_id. Looks like after the first
So I can't use this approach, since I will always lose the last batch after
2014-10-23 18:20 GMT-02:00 John Smith java.dev.mtl@gmail.com :
Small ttl is ok (well adjusted properly for you process) because everytime
I'm curious if you can re-use the scroll id. It's not specifically
On Thursday, 23 October 2014 15:44:04 UTC-4, Roger de Cordova Farias wrote:
Hmm, I was using a small ttl, just enough to process each scroll call,
That is a good idea, thanks
2014-10-23 17:12 GMT-02:00 John Smith java.d...@gmail.com :
The scroll is available based on a timeout value you give it.
You could track the last scroll id you used and try it again from there?
On Thursday, 23 October 2014 12:47:02 UTC-4, Roger de Cordova Farias
I'm reindexing a Elasticsearch base with 50m docs using the scroll-scan
Is there a way to redo the query to retrieve the left docs? Like using
Would the the internal order of the scan query be the same with a
I can assure that no new docs were indexed in the old index since the
--https://groups.google.com/d/ elasticsearc...@googlegroups.com .https://groups.google.com/d/ 40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/45b51276-daa4-4f39-b46c-017296db689a%40googlegroups.com?utm_medium=email&utm_source=footer
For more options, visit https://groups.google.com/d/optout .
--https://groups.google.com/d/topic/elasticsearch/NbshHCrBHoM/unsubscribe .elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/ec345d9e-19b4-4d2c-985a-fbf245e31a19%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/ec345d9e-19b4-4d2c-985a-fbf245e31a19%40googlegroups.com?utm_medium=email&utm_source=footer
For more options, visit https://groups.google.com/d/optout .
--elasticsearch+unsubscribe@googlegroups.com .https://groups.google.com/d/msgid/elasticsearch/CAJp2532ZuYCP6%3DxqJeUmZGowAo9dzY%2BQGZkHKbfkTyCWxODF5w%40mail.gmail.com .https://groups.google.com/d/optout .
