3 node cluster setup

Hi
I have 3 nodes setup in my cluster.
One node.master = true and two node.data = true

Is this the right way to avoid split brain ?

I seem to get:
[WARN ][o.e.x.s.t.n.SecurityNetty4ServerTransport] [rg-app-prod-masterNode1] send message failed [channel: NettyTcpChannel{localAddress=0.0.0.0/0.0.0.0:9300, remoteAddress=/xx.x.xxx.13:41604}]
java.nio.channels.ClosedChannelException: null
at io.netty.channel.AbstractChannel$AbstractUnsafe.write(...)(Unknown Source) ~[?:?]

also see this:
[2019-04-15T12:36:02,819][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [rg-app-prod-masterNode1] fatal error in thread [Thread-51236], exiting
java.lang.OutOfMemoryError: Java heap space

and

[WARN ][o.e.c.a.s.ShardStateAction] [rg-app-prod-masterNode1] unexpected failure while sending request [internal:cluster/shard/failure] to [{rg-app-prod-dataNode2}{LbFMQnQgS0OZk2c-3XKOPw}{EtCHBmXSTwuY9QJmlMpx-g}{xx.x.xx.14}{xx.x.xxx.14:9300}{ml.machine_memory=8340840448, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}] for shard entry [shard id [[indice-2019.04.15][2]], allocation id [2mq4o_T2TQWlbqjhsyhASw], primary term [2], message [failed to perform indices:data/write/bulk[s] on replica [indice-2019.04.15][2], node[LbFMQnQgS0OZk2c-3XKOPw], [R], s[STARTED], a[id=2mq4o_T2TQWlbqjhsyhASw]], failure [RemoteTransportException[[rg-app-prod-dataNode2][xx.x.xxx.14:9300][indices:data/write/bulk[s][r]]]; nested: IllegalStateException[active primary shard [indice-2019.04.15][2], node[LbFMQnQgS0OZk2c-3XKOPw], [P], s[STARTED], a[id=2mq4o_T2TQWlbqjhsyhASw] cannot be a replication target before relocation hand off, state is [STARTED]]; ], markAsStale [true]]
org.elasticsearch.transport.RemoteTransportException: [rg-app-prod-dataNode2][xx.x.xxx.14:9300][internal:cluster/shard/failure]
Caused by: org.elasticsearch.cluster.action.shard.ShardStateAction$NoLongerPrimaryShardException: primary term [2] did not match current primary term [3]

Do I need to set node.data = false - on master, and node.master = false on data nodes ?

What version are you on?

Hi.
Thanks for replying and sorry for the delay. The version is 6.4.2 :blush:

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.