I run a 4 node cluster with 3 data nodes. The other node is used to load balance Kibana traffic. I keep getting Primary and Replica index on the same node and not sure how this is happening. Here is an example from a curl -X GET "10.200.100.100:9200/_cat/shards" command:
filebeat-6.6.2-2019.07.12 2 p STARTED 119997 21.7mb 10.200.100.102 elastic02
filebeat-6.6.2-2019.07.12 2 r STARTED 119997 21.7mb 10.200.100.103 elastic03
filebeat-6.6.2-2019.07.12 0 p STARTED 121126 22mb 10.200.100.101 elastic01
filebeat-6.6.2-2019.07.12 0 r STARTED 121126 21.9mb 10.200.100.102 elastic02
.monitoring-es-7-2019.08.01 0 p STARTED 763926 243.5mb 10.200.100.103 elastic03
.monitoring-es-7-2019.08.01 0 r UNASSIGNED
winlogbeat-6.4.2-2019.07.29 1 p STARTED 187 276.3kb 10.200.100.101 elastic01
winlogbeat-6.4.2-2019.07.29 1 r STARTED 187 252.6kb 10.200.100.103 elastic03
winlogbeat-6.4.2-2019.07.29 2 p STARTED 184 236.5kb 10.200.100.101 elastic01
winlogbeat-6.4.2-2019.07.29 2 r STARTED 184 236.5kb 10.200.100.102 elastic02
winlogbeat-6.4.2-2019.07.29 0 p STARTED 173 248.2kb 10.200.100.101 elastic01
Two issues, how to fix the data already there and where to look for the source?