I do a lot of indexing and reindexing.
I'm not terribly bothered with consistency, but more with "eventual" consistency. I can go as long as 5 minutes before data needs to be consistent.
I thought maybe the re-indexing of lucene is the cause of much IO. Thought of maybe upping the refresh_interval or maybe the index.translog options - is that the right way to go?
I only get the number of shards, replicas. The elasticsearch.yml file does not tell what the defaults are. How would I know my changes took places, and what are the values now?
Help much appreciated as I cant find documentation for this.
I do a lot of indexing and reindexing.
I'm not terribly bothered with consistency, but more with "eventual"
consistency. I can go as long as 5 minutes before data needs to be
consistent.
I thought maybe the re-indexing of lucene is the cause of much IO. Thought
of maybe upping the refresh_interval or maybe the index.translog options -
is that the right way to go?
Should be. Another way to go is might be to increase
indices.memory.index_buffer_size:
Another way to go is to tweak merge policies (usually there's a trade-off
between search performance and CPU+I/O load here):
To get a more clear idea of where your ES cluster is busy, I'd say you
should monitor it with something like SPM:
My main problem is I do not know how to find out what my setting are. In
I only get the number of shards, replicas. The elasticsearch.yml file does
not tell what the defaults are. How would I know my changes took places,
and
what are the values now?
You should see there the settings you changed by using the Update Settings
API. If settings are not there, they should either be in the configuration
file or ES is using the defaults.
To find the defaults, you need to look in the documentation for each
option. For example, indices.memory.index_buffer_size defaults to 10% (from
the heap of the node). refresh_interval defaults to 1s, and index.translog
options are shown here:
Can you clarify how you get this information? Is it a single node only
with iowait? What is 50%? Is it constantly high or only peaks? Do you
use Linux? iostat? How are your disks organized?
If high iowait does not disappear and is constantly high, it may
indicate a drive failure in a RAID.
Hey, not sure how newrelic gets that data itself...
What do u see with iostat -x 1?
Ebs may or may not be enough, depending on your case. Are you using PIOpS
or std?
We've had great improvements by tweaking how often commits to index happen
( anything from 5 to 120 secs depending on use case), and good old RAID .
even RAID-0 on ephemeral disks is faster (and cheaper) than a single Ebs.
For higher loads, the sky is the limit (50+ EBS raided vols can push a heck
of a lot of iops..)
On 04/07/2013 3:09 AM, "eranid" eranid@gmail.com wrote:
@Jorg
Hi,
It is between 30-50% all the time (monitored by Newrelic). Single node on a
m3.xl machine on AWS.
It resides on an attached, non-root, EBS drive (non-EBS optimized).
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.