# Shards not replicating to two nodes **URL:** \ **Category:** Elasticsearch\ **Created:** [January 16, 2015, 11:50am UTC](https://discuss.elastic.co/t/shards-not-replicating-to-two-nodes/21685 "2015-01-16T11:50:22Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Stewart\_Gray](https://avatars.discourse-cdn.com/v4/letter/s/5f9b8f/32.png) [@Stewart\_Gray](https://discuss.elastic.co/u/Stewart_Gray)\ **Post date:** [January 16, 2015, 11:50am UTC](https://discuss.elastic.co/t/shards-not-replicating-to-two-nodes/21685/1 "2015-01-16T11:50:22Z")
I have a new elasticsearch cluster with 4 nodes and for some reason I can't get the shards distributed across all of these. Shards are only being copied to 2/4 rather than all of them which is what I'm after. The config is the same on each: cluster.name: elasticsearch node.name: "xxxxx" gateway.expected\_nodes: 4 discovery.zen.minimum\_master\_nodes: 3 discovery.zen.ping.multicast.enabled: false discovery.zen.ping.unicast.hosts: ["1.1.1.1", "1.1.1.2", "1.1.1.3"] The rest is default. Any thoughts? [https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter\_353%2BJan.%2B16%2B11.44.jpg](https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter_353%2BJan.%2B16%2B11.44.jpg) -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![vineeth\_mohan\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vineeth_mohan_2/32/747_2.png) [@vineeth\_mohan\_2](https://discuss.elastic.co/u/vineeth_mohan_2)\ **Post date:** [January 16, 2015, 12:28pm UTC](https://discuss.elastic.co/t/shards-not-replicating-to-two-nodes/21685/2 "2015-01-16T12:28:46Z")
Hi , Can you check the following - 1. Disk space on the machine where shards are not getting used. 2. See the configuration of the node in those machines. See if the client node only config is enabled in the config. Thanks Vineeth On Fri, Jan 16, 2015 at 5:20 PM, Stewart Gray [stewart.gray@gmail.com](mailto:stewart.gray@gmail.com) wrote: > I have a new elasticsearch cluster with 4 nodes and for some reason I > can't get the shards distributed across all of these. Shards are only being > copied to 2/4 rather than all of them which is what I'm after. > > The config is the same on each: > > cluster.name: elasticsearch > node.name: "xxxxx" > gateway.expected\_nodes: 4 > discovery.zen.minimum\_master\_nodes: 3 > discovery.zen.ping.multicast.enabled: false > discovery.zen.ping.unicast.hosts: ["1.1.1.1", "1.1.1.2", "1.1.1.3"] > > The rest is default. Any thoughts? > > [https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter\_353%2BJan.%2B16%2B11.44.jpg](https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter_353%2BJan.%2B16%2B11.44.jpg) > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGdPd5%3D-ba5OTVj5DNmx5vg7ubv%3Dsw3r96%3DZZR7fQG58fbbizg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGdPd5%3D-ba5OTVj5DNmx5vg7ubv%3Dsw3r96%3DZZR7fQG58fbbizg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Stewart\_Gray](https://avatars.discourse-cdn.com/v4/letter/s/5f9b8f/32.png) [@Stewart\_Gray](https://discuss.elastic.co/u/Stewart_Gray)\ **Post date:** [January 16, 2015, 12:40pm UTC](https://discuss.elastic.co/t/shards-not-replicating-to-two-nodes/21685/3 "2015-01-16T12:40:54Z")
Hi, Plenty of disk space on the two machines not receiving shards - there is a symbolic link from /var/lib/elasticsearch to a 400gb drive on each. If I get logstash to log to elasticsearch on one of these, and remove it from the cluster I see the indicies being created in the right place. The configuration is exactly the same on all machines (apart from the obvious stuff, node name, and other node IP addresses). Cheers On Friday, 16 January 2015 12:28:52 UTC, vineeth mohan wrote: > Hi , > > Can you check the following - > > 1. Disk space on the machine where shards are not getting used. > 2. See the configuration of the node in those machines. See if the > client node only config is enabled in the config. > > Thanks > Vineeth > > On Fri, Jan 16, 2015 at 5:20 PM, Stewart Gray \<[stewar...@gmail.com](mailto:stewar...@gmail.com) > \\> wrote: > > > I have a new elasticsearch cluster with 4 nodes and for some reason I > > can't get the shards distributed across all of these. Shards are only being > > copied to 2/4 rather than all of them which is what I'm after. > > > > The config is the same on each: > > > > cluster.name: elasticsearch > > node.name: "xxxxx" > > gateway.expected\_nodes: 4 > > discovery.zen.minimum\_master\_nodes: 3 > > discovery.zen.ping.multicast.enabled: false > > discovery.zen.ping.unicast.hosts: ["1.1.1.1", "1.1.1.2", "1.1.1.3"] > > > > The rest is default. Any thoughts? > > > > [https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter\_353%2BJan.%2B16%2B11.44.jpg](https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter_353%2BJan.%2B16%2B11.44.jpg) > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6fd7093c-b48f-4a90-918b-5d06b5b2ffb7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6fd7093c-b48f-4a90-918b-5d06b5b2ffb7%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Stewart\_Gray](https://avatars.discourse-cdn.com/v4/letter/s/5f9b8f/32.png) [@Stewart\_Gray](https://discuss.elastic.co/u/Stewart_Gray)\ **Post date:** [January 16, 2015, 1:21pm UTC](https://discuss.elastic.co/t/shards-not-replicating-to-two-nodes/21685/4 "2015-01-16T13:21:49Z")
Turns out it was a versioning issue - we were running slightly different versions of elasticsearch on the two not replicating. I upgraded these and now it's working wonderfully. Thanks for your help. Cheers On Friday, 16 January 2015 12:40:54 UTC, Stewart Gray wrote: > Hi, > > Plenty of disk space on the two machines not receiving shards - there is a > symbolic link from /var/lib/elasticsearch to a 400gb drive on each. If I > get logstash to log to elasticsearch on one of these, and remove it from > the cluster I see the indicies being created in the right place. > > The configuration is exactly the same on all machines (apart from the > obvious stuff, node name, and other node IP addresses). > > Cheers > > On Friday, 16 January 2015 12:28:52 UTC, vineeth mohan wrote: > > > Hi , > > > > Can you check the following - > > > > 1. Disk space on the machine where shards are not getting used. > > 2. See the configuration of the node in those machines. See if the > > client node only config is enabled in the config. > > > > Thanks > > Vineeth > > > > On Fri, Jan 16, 2015 at 5:20 PM, Stewart Gray [stewar...@gmail.com](mailto:stewar...@gmail.com) > > wrote: > > > > > I have a new elasticsearch cluster with 4 nodes and for some reason I > > > can't get the shards distributed across all of these. Shards are only being > > > copied to 2/4 rather than all of them which is what I'm after. > > > > > > The config is the same on each: > > > > > > cluster.name: elasticsearch > > > node.name: "xxxxx" > > > gateway.expected\_nodes: 4 > > > discovery.zen.minimum\_master\_nodes: 3 > > > discovery.zen.ping.multicast.enabled: false > > > discovery.zen.ping.unicast.hosts: ["1.1.1.1", "1.1.1.2", "1.1.1.3"] > > > > > > The rest is default. Any thoughts? > > > > > > [https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter\_353%2BJan.%2B16%2B11.44.jpg](https://lh3.googleusercontent.com/-Cl8e-SyNVao/VLj6G0wHHrI/AAAAAAAAASU/-QxhgWUoC3Q/s1600/ScreenHunter_353%2BJan.%2B16%2B11.44.jpg) > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/9ce6e841-2a03-46be-8e63-3590f752d6bf%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fc277656-5f8d-46c4-9cd0-057a9d2da630%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fc277656-5f8d-46c4-9cd0-057a9d2da630%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:38am UTC](https://discuss.elastic.co/t/shards-not-replicating-to-two-nodes/21685/5 "2017-07-06T00:38:26Z")