Using ES 5.4.2. Trying to setup a production grade cluster with 2 masters to start.
Here is my config....
# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
# Before you set out to tweak and tune the configuration, make sure you
# understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: mdm_dev_es
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: mdm_dev_esm_1
node.data: false
node.master: true
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
#path.data: /path/to/data
#
# Path to log files:
#
#path.logs: /path/to/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
#network.host: 10.127.79.68
network.host: _site_
#
# Set a custom port for HTTP:
#
http.port: 9200
transport.tcp.port: 9300
#transport.host: 10.127.79.68
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when new node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
discovery.zen.ping.unicast.hosts:
- 10.127.78.116:9300
#
# Prevent the "split brain" by configuring the majority of nodes (total number of master-eligible nodes / 2 + 1):
#
discovery.zen.minimum_master_nodes: 2
#
# For more information, consult the zen discovery module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
#
# For more information, consult the gateway module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true
#
I see the following issues in my logs.
version[5.4.2], pid[23945], build[929b078/2017-06-15T02:29:28.122Z], OS[Linux/3.10.0-514.21.1.el7.x86_64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_131/25.131-b12]
[2017-06-22T19:59:11,511][INFO ][o.e.n.Node ] [mdm_dev_esm_1] JVM arguments [-Xms2g, -Xmx2g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+DisableExplicitGC, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -XX:+HeapDumpOnOutOfMemoryError, -Des.path.home=/usr/share/elasticsearch]
[2017-06-22T19:59:12,252][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [aggs-matrix-stats]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [ingest-common]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [lang-expression]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [lang-groovy]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [lang-mustache]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [lang-painless]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [percolator]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [reindex]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [transport-netty3]
[2017-06-22T19:59:12,253][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] loaded module [transport-netty4]
[2017-06-22T19:59:12,254][INFO ][o.e.p.PluginsService ] [mdm_dev_esm_1] no plugins loaded
[2017-06-22T19:59:13,347][INFO ][o.e.d.DiscoveryModule ] [mdm_dev_esm_1] using discovery type [zen]
[2017-06-22T19:59:13,758][INFO ][o.e.n.Node ] [mdm_dev_esm_1] initialized
[2017-06-22T19:59:13,758][INFO ][o.e.n.Node ] [mdm_dev_esm_1] starting ...
[2017-06-22T19:59:13,879][INFO ][o.e.t.TransportService ] [mdm_dev_esm_1] publish_address {10.127.79.68:9300}, bound_addresses {10.127.79.68:9300}
[2017-06-22T19:59:13,885][INFO ][o.e.b.BootstrapChecks ] [mdm_dev_esm_1] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2017-06-22T19:59:13,886][ERROR][o.e.b.Bootstrap ] [mdm_dev_esm_1] node validation exception
[1] bootstrap checks failed
What is the correct basic configuration for a working 2 node master cluster.