Hi all,
There are 50 indexes, each contains 3 primary shards and 1 replica. Some
threads running every 15 minutes to search and index a few documents(each
thread process at max 10 docs).
After some days, ES get into long GC pauses and at the end split brain
problem.
From the bigdesk we could see that more than 60% of heap is not used.
The only thing which we think could be a problem is many manually refresh
calls, but I'm not sure.
4 GB assigned to ES process, xms and xmx are set equally.
Total system memory is 12GB
3 other java processes using almost 4 GB.
ES version: 90.3
Java version: 1.7.0_25
Es vm configuration:
JAVA_OPTS="$JAVA_OPTS -XX:+UseParNewGC"
JAVA_OPTS="$JAVA_OPTS -XX:+UseConcMarkSweepGC"
JAVA_OPTS="$JAVA_OPTS -XX:CMSInitiatingOccupancyFraction=75"
JAVA_OPTS="$JAVA_OPTS -XX:+UseCMSInitiatingOccupancyOnly"
JAVA_OPTS="$JAVA_OPTS -XX:+UseCondCardMark"
JAVA_OPTS="$JAVA_OPTS -XX:+UseTLAB"
JAVA_OPTS="$JAVA_OPTS -XX:+CMSClassUnloadingEnabled"
JAVA_OPTS="$JAVA_OPTS -XX:MaxGCPauseMillis=10000"
ES configuration:
ndex.cache.filter.max_size: 10
index.store.throttle.type: merge
index.compound_format: false
index.cache.field.expire: 1m
index.merge.policy.merge_factor: 30
index.cache.filter.expire: 1m
index.refresh_interval: -1
index.number_of_replicas: 1
index.version.created: 200599
index.store.throttle.max_bytes_per_sec: 5mb
index.number_of_shards: 3
index.translog.flush_threshold_period: 60s
index.merge.policy.use_compound_file: false
index.store.compress.stored: true
index.cache.field.type: resident
index.indices.memory.index_buffer_size: 20%
bootstrap.mlockall is not configured yet, but I think there is no problem
with memory swapping atm.
Can someone help?
Thanks in advance,
Vahid
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/51a19985-4f36-44af-b4dd-b2fb27556717%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.