BulkProcessor

Elastic Stack Elasticsearch
1

if I set Bulk size number of files at 5000, I feed it 5000, 5000, 5000,
what happens if the #of files for instance in the last batch is 2000. How
does it know that it needs to process the last 2000 ?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8c322041-783d-45fb-9595-38aa6a50d0eb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

There is a TimeOut so every x seconds whatever the number of docs in Bulk.

Also when the bulkprocessor is closed, remaining elements are processed.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 7 mars 2014 à 21:51, ZenMaster80 sabdalla80@gmail.com a écrit :

if I set Bulk size number of files at 5000, I feed it 5000, 5000, 5000, what happens if the #of files for instance in the last batch is 2000. How does it know that it needs to process the last 2000 ?

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8c322041-783d-45fb-9595-38aa6a50d0eb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D1B9782C-E0C2-426F-81CC-64B16B491E30%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

3

Thanks David, it answers my question.

On Friday, March 7, 2014 4:10:27 PM UTC-5, David Pilato wrote:

There is a TimeOut so every x seconds whatever the number of docs in Bulk.

Also when the bulkprocessor is closed, remaining elements are processed.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 7 mars 2014 à 21:51, ZenMaster80 <sabda...@gmail.com <javascript:>> a
écrit :

if I set Bulk size number of files at 5000, I feed it 5000, 5000, 5000,
what happens if the #of files for instance in the last batch is 2000. How
does it know that it needs to process the last 2000 ?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8c322041-783d-45fb-9595-38aa6a50d0eb%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/8c322041-783d-45fb-9595-38aa6a50d0eb%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/63281e09-2361-4bf4-8661-589979b33eae%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.