About frequently index writing in elasticsearch cluster

  1. the search will timeout when the ES merge the lucene segment, and
    the index write speed will to be slow. This time,the CPU load will
    uprise, our cluter can hardly provide search and index write.(Occur
    1~2 times every day)

Anybody can give us some suggestion for our system? Especially the
lucene segment merge.Thank you very much!

Merges can be very heavy IO wise. They can slow things down, which can
cause other index or search requests to build up, which can result in a
"thread explosion".

Advice:

  1. fastest disks possible - SSDs if you can
  2. Use fixed thread pools, rather than the default "cached", to avoid
    a slow process causing the generation of thousands of threads
    Elasticsearch Platform — Find real-time answers at scale | Elastic
  3. Configure merge throttling to slow down merges. This will prevent
    merges from swamping your I/O
    Elasticsearch Platform — Find real-time answers at scale | Elastic

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.