Preloading docs for cache warming


(Val Vakar) #1

Hello experts,

My impression so far is that there are two notable bottlenecks in ES:

  1. Disk I/O - loading documents
  2. CPU pegging while searching/filtering

Is there a good way to pre-load documents? In other words, if I don't want
to figure out the cache warming queries, can I at least pre-empt the disk
I/O problem?

Thanks,
Val

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Ivan Brusic) #2

There should be a feature coming out in the next version of elasticsearch
that will warm up new segments without needing a warming query.

Never used it myself (I don't work off master builds), but it might be what
you are requiring.

Cheers,

Ivan

On Wed, Oct 30, 2013 at 6:56 AM, Val Vakar val.vakar@gmail.com wrote:

Hello experts,

My impression so far is that there are two notable bottlenecks in ES:

  1. Disk I/O - loading documents
  2. CPU pegging while searching/filtering

Is there a good way to pre-load documents? In other words, if I don't want
to figure out the cache warming queries, can I at least pre-empt the disk
I/O problem?

Thanks,
Val

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #3