Elasticsearch version:
5.2.1
Plugins installed: []
JVM version:
jdk:1.8.0_111
OS version:
centos7.0
configuration file as follows
cluster.name: tj-es-staging
node.master: true
node.data: true
node.name: ${HOSTNAME}
network.host: ${HOSTNAME}
http.port: 9200
path.data: /home/work/data1/data/es_data
path.logs: /home/work/log/es_log
discovery.zen.minimum_master_nodes: 1
discovery.zen.ping_timeout: 100s
discovery.zen.fd.ping_timeout: 100s
discovery.zen.ping.unicast.hosts: ["10...."]
#es head
http.cors.enabled: true
http.cors.allow-origin: "*"
gateway.expected_nodes: 5
gateway.recover_after_time: 10m
gateway.recover_after_nodes: 4
HI
when I start my es cluster, the health status always red.
curl 'http://XXX:9200/_cluster/health?pretty'
{
"cluster_name" : "tj-es-staging",
"status" : "red",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 0,
"active_shards" : 0,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : "NaN"
}
curl 'http://XXX:9200/_cat/indices?v'
{"error":{"root_cause":[{"type":"cluster_block_exception","reason":"blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];"}],"type":"cluster_block_exception","reason":"blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];"},"status":503}
I have other es clusters also using a similar configuration file,it's no problem.
I think there may be a problem with my server environment, but reported that the wrong I do not know how to troubleshoot
the server log
[2017-03-16T16:46:44,515][INFO ][o.e.n.Node ] [staging03] initializing ...
[2017-03-16T16:46:44,582][INFO ][o.e.e.NodeEnvironment ] [staging03] using [1] data paths, mounts [[/home/work/data1 (/dev/vdb1)]], net usable_space [934gb], net total_space [984.1gb], spins? [possibly], types [ext4]
[2017-03-16T16:46:44,582][INFO ][o.e.e.NodeEnvironment ] [staging03] heap size [30.8gb], compressed ordinary object pointers [true]
[2017-03-16T16:46:44,583][INFO ][o.e.n.Node ] [staging03] node name [staging03], node ID [WxccNuCbTTmyy1lRlApQDA]
[2017-03-16T16:46:44,585][INFO ][o.e.n.Node ] [staging03] version[5.2.1], pid[6933], build[db0d481/2017-02-09T22:05:32.386Z], OS[Linux/3.10.0-123.el7.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_111/25.111-b14]
[2017-03-16T16:46:45,237][INFO ][o.e.p.PluginsService ] [staging03] loaded module [aggs-matrix-stats]
[2017-03-16T16:46:45,237][INFO ][o.e.p.PluginsService ] [staging03] loaded module [ingest-common]
[2017-03-16T16:46:45,237][INFO ][o.e.p.PluginsService ] [staging03] loaded module [lang-expression]
[2017-03-16T16:46:45,237][INFO ][o.e.p.PluginsService ] [staging03] loaded module [lang-groovy]
[2017-03-16T16:46:45,237][INFO ][o.e.p.PluginsService ] [staging03] loaded module [lang-mustache]
[2017-03-16T16:46:45,238][INFO ][o.e.p.PluginsService ] [staging03] loaded module [lang-painless]
[2017-03-16T16:46:45,238][INFO ][o.e.p.PluginsService ] [staging03] loaded module [percolator]
[2017-03-16T16:46:45,238][INFO ][o.e.p.PluginsService ] [staging03] loaded module [reindex]
[2017-03-16T16:46:45,238][INFO ][o.e.p.PluginsService ] [staging03] loaded module [transport-netty3]
[2017-03-16T16:46:45,238][INFO ][o.e.p.PluginsService ] [staging03] loaded module [transport-netty4]
[2017-03-16T16:46:45,239][INFO ][o.e.p.PluginsService ] [staging03] no plugins loaded
[2017-03-16T16:46:47,977][INFO ][o.e.n.Node ] [staging03] initialized
[2017-03-16T16:46:47,978][INFO ][o.e.n.Node ] [staging03] starting ...
[2017-03-16T16:46:48,189][WARN ][i.n.u.i.MacAddressUtil ] Failed to find a usable hardware address from the network interfaces; using random bytes: c1:5c:67:35:da:13:34:d9
[2017-03-16T16:46:48,508][INFO ][o.e.t.TransportService ] [staging03] publish_address {xxx:9300}, bound_addresses {xxx:9300}
[2017-03-16T16:46:48,513][INFO ][o.e.b.BootstrapChecks ] [staging03] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2017-03-16T16:47:18,596][WARN ][o.e.n.Node ] [staging03] timed out while waiting for initial discovery state - timeout: 30s
[2017-03-16T16:47:18,606][INFO ][o.e.h.HttpServer ] [staging03] publish_address {xxx:9200}, bound_addresses {xxx:9200}
[2017-03-16T16:47:18,606][INFO ][o.e.n.Node ] [staging03] started
[2017-03-16T16:48:28,661][INFO ][o.e.c.s.ClusterService ] [staging03] new_master {staging03}{WxccNuCbTTmyy1lRlApQDA}{VZQBiKQESJ-a8mlYspuHaw}{staging03}{xxx:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)
[2017-03-16T16:49:41,519][WARN ][r.suppressed ] path: /_cat/indices, params: {}
org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:165) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:70) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:47) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.(TransportBroadcastByNodeAction.java:256) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:234) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:79) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:173) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:145) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:87) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:75) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:64) ~[elasticsearch-5.2.1.jar:5.2.1]
at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-5.2.1.jar:5.2.1]
at ....