# Elastic Search configuration **URL:** \ **Category:** Elasticsearch\ **Created:** [May 12, 2015, 9:01am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611 "2015-05-12T09:01:01Z")\ **Posts on this page:** 13\ **Page:** 1
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 12, 2015, 9:01am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/1 "2015-05-12T09:01:01Z")
Please let me know if below elastic server configuration is feasible or not. ## Total 1 cluster with 3 nodes having 5 shards and 1 replica with multiple indices having total around 100 million data ,sizing 1tb and still increasing 1. Node 1:Master=true,data=true (30gb ram,8 cores) 2. Node 2:Master=true,data=true (30gb ram,8 cores) 3. Node 3:Master=false,data=false (30gb ram,8 cores) * * * All nodes are pointing to same UNC path(\pc1\data) data location.Data is not stored locally on nodes,all data is stored on one location as mentioned above.we are using Nas to store data and seems Nas is very fast so we are storing data on UNC path and not locally. While googling found if shards are decreased ,it will increase search performance.According to the specified configuration should i drop no of shards to 1?.Will it increase the performance or does the configuration need any changes?. Please suggest me the configuration. Thanks ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 12, 2015, 10:08am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/2 "2015-05-12T10:08:12Z")
Are you having performance issues now? If so I'd start with replacing your disk setup, chances are it's not as fast as you think, especially if you are storing the data from both nodes on the same path. Also what ES version are you on, what Java release and version? On 12 May 2015 at 19:01, Hardik Dobariya [hardikdobariya1132@gmail.com](mailto:hardikdobariya1132@gmail.com) wrote: > Please let me know if below elastic server configuration is feasible or > not. > > ## Total 1 cluster with 3 nodes having 5 shards and 1 replica with multiple indices having total around 100 million data ,sizing 1tb and still increasing > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > 3. Node 3:Master=false,data=false (30gb ram,8 cores) > > * * * > > All nodes are pointing to same UNC path(\pc1\data) data location.Data is > not stored locally on nodes,all data is stored on one location as mentioned > above.we are using Nas to store data and seems Nas is very fast so we are > storing data on UNC path and not locally. > > While googling found if shards are decreased ,it will increase search > performance.According to the specified configuration should i drop no of > shards to 1?.Will it increase the performance or does the configuration > need any changes?. > Please suggest me the configuration. > Thanks > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_7DjNa%2B82\_B-v95%2BW1HbSs-VsUC%3DHxa8OuRLOhJCUV-Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_7DjNa%2B82_B-v95%2BW1HbSs-VsUC%3DHxa8OuRLOhJCUV-Q%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 12, 2015, 10:22am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/3 "2015-05-12T10:22:58Z")
No am not facing any performance issue.Just want to confirm if my configuration is feasible or not and what will happen if i bring down shard to 1. My ES version is 1.5.2 and java release is 8.45 On Tuesday, May 12, 2015 at 3:38:40 PM UTC+5:30, Mark Walkom wrote: > Are you having performance issues now? > > If so I'd start with replacing your disk setup, chances are it's not as > fast as you think, especially if you are storing the data from both nodes > on the same path. > Also what ES version are you on, what Java release and version? > > On 12 May 2015 at 19:01, Hardik Dobariya \<[hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) > \\> wrote: > > > Please let me know if below elastic server configuration is feasible or > > not. > > > > ## Total 1 cluster with 3 nodes having 5 shards and 1 replica with multiple indices having total around 100 million data ,sizing 1tb and still increasing > > > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > > 3. Node 3:Master=false,data=false (30gb ram,8 cores) > > > > * * * > > > > All nodes are pointing to same UNC path(\pc1\data) data location.Data > > is not stored locally on nodes,all data is stored on one location as > > mentioned above.we are using Nas to store data and seems Nas is very fast > > so we are storing data on UNC path and not locally. > > > > While googling found if shards are decreased ,it will increase search > > performance.According to the specified configuration should i drop no of > > shards to 1?.Will it increase the performance or does the configuration > > need any changes?. > > Please suggest me the configuration. > > Thanks > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 12, 2015, 11:08am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/4 "2015-05-12T11:08:47Z")
We do not recommend the use of networked file systems. We definitely don't recommend using those and putting both sets of data in the one location. Reducing shard count may help, it'd certainly reduce the overhead in maintaining all those shards. Just keep shard sizes under 50GB if you can. Also having two masters can lead to potential split brain, you'd be better off making node 3 a master: true, data: false and setting minimum\_masters. On 12 May 2015 at 20:22, Hardik Dobariya [hardikdobariya1132@gmail.com](mailto:hardikdobariya1132@gmail.com) wrote: > No am not facing any performance issue.Just want to confirm if my > configuration is feasible or not and what will happen if i bring down shard > to 1. > My ES version is 1.5.2 and java release is 8.45 > > On Tuesday, May 12, 2015 at 3:38:40 PM UTC+5:30, Mark Walkom wrote: > > > Are you having performance issues now? > > > > If so I'd start with replacing your disk setup, chances are it's not as > > fast as you think, especially if you are storing the data from both nodes > > on the same path. > > Also what ES version are you on, what Java release and version? > > > > On 12 May 2015 at 19:01, Hardik Dobariya [hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) wrote: > > > > > Please let me know if below elastic server configuration is feasible or > > > not. > > > > > > ## Total 1 cluster with 3 nodes having 5 shards and 1 replica with multiple indices having total around 100 million data ,sizing 1tb and still increasing > > > > > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > > > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > > > 3. Node 3:Master=false,data=false (30gb ram,8 cores) > > > > > > * * * > > > > > > All nodes are pointing to same UNC path(\pc1\data) data location.Data > > > is not stored locally on nodes,all data is stored on one location as > > > mentioned above.we are using Nas to store data and seems Nas is very fast > > > so we are storing data on UNC path and not locally. > > > > > > While googling found if shards are decreased ,it will increase search > > > performance.According to the specified configuration should i drop no of > > > shards to 1?.Will it increase the performance or does the configuration > > > need any changes?. > > > Please suggest me the configuration. > > > Thanks > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > * * * > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9qjR17AOO4hinjxbvAKYO5L5tttPncz\_fPL-ZQ5mGCKQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9qjR17AOO4hinjxbvAKYO5L5tttPncz_fPL-ZQ5mGCKQ%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 12, 2015, 11:22am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/5 "2015-05-12T11:22:25Z")
yes i can understand the use of network file system is not good. Actually we do not have any physical machines.we are using virtual environment.This is the reason we are using NAS to store data on network. Any suggestion on using virtual environment for Elasticsearch? On Tuesday, May 12, 2015 at 4:39:15 PM UTC+5:30, Mark Walkom wrote: > We do not recommend the use of networked file systems. > We definitely don't recommend using those and putting both sets of data in > the one location. > > Reducing shard count may help, it'd certainly reduce the overhead in > maintaining all those shards. Just keep shard sizes under 50GB if you can. > Also having two masters can lead to potential split brain, you'd be better > off making node 3 a master: true, data: false and setting minimum\_masters. > > On 12 May 2015 at 20:22, Hardik Dobariya \<[hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) > \\> wrote: > > > No am not facing any performance issue.Just want to confirm if my > > configuration is feasible or not and what will happen if i bring down shard > > to 1. > > My ES version is 1.5.2 and java release is 8.45 > > > > On Tuesday, May 12, 2015 at 3:38:40 PM UTC+5:30, Mark Walkom wrote: > > > > > Are you having performance issues now? > > > > > > If so I'd start with replacing your disk setup, chances are it's not as > > > fast as you think, especially if you are storing the data from both nodes > > > on the same path. > > > Also what ES version are you on, what Java release and version? > > > > > > On 12 May 2015 at 19:01, Hardik Dobariya [hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) wrote: > > > > > > > Please let me know if below elastic server configuration is feasible or > > > > not. > > > > > > > > ## Total 1 cluster with 3 nodes having 5 shards and 1 replica with multiple indices having total around 100 million data ,sizing 1tb and still increasing > > > > > > > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > > > > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > > > > 3. Node 3:Master=false,data=false (30gb ram,8 cores) > > > > > > > > * * * > > > > > > > > All nodes are pointing to same UNC path(\pc1\data) data location.Data > > > > is not stored locally on nodes,all data is stored on one location as > > > > mentioned above.we are using Nas to store data and seems Nas is very fast > > > > so we are storing data on UNC path and not locally. > > > > > > > > While googling found if shards are decreased ,it will increase search > > > > performance.According to the specified configuration should i drop no of > > > > shards to 1?.Will it increase the performance or does the configuration > > > > need any changes?. > > > > Please suggest me the configuration. > > > > Thanks > > > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit > > > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com) > > > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > Please update your bookmarks! We have moved to > > > [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > * * * > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/66346979-7579-41a0-9e9c-d3650bf81227%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/66346979-7579-41a0-9e9c-d3650bf81227%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 12, 2015, 11:24am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/6 "2015-05-12T11:24:30Z")
yes i can understand the use of network file system is not good. Actually we do not have any physical machines.we are using virtual environment.This is the reason we are using NAS to store data on network. Any suggestion on using virtual environment for Elasticsearch? and yes am already using 3 nodes.2 masters with data and one child On Tuesday, May 12, 2015 at 4:52:25 PM UTC+5:30, Hardik Dobariya wrote: > yes i can understand the use of network file system is not good. > Actually we do not have any physical machines.we are using virtual > environment.This is the reason we are using NAS to store data on network. > Any suggestion on using virtual environment for Elasticsearch? > > On Tuesday, May 12, 2015 at 4:39:15 PM UTC+5:30, Mark Walkom wrote: > > > We do not recommend the use of networked file systems. > > We definitely don't recommend using those and putting both sets of data > > in the one location. > > > > Reducing shard count may help, it'd certainly reduce the overhead in > > maintaining all those shards. Just keep shard sizes under 50GB if you can. > > Also having two masters can lead to potential split brain, you'd be > > better off making node 3 a master: true, data: false and setting > > minimum\_masters. > > > > On 12 May 2015 at 20:22, Hardik Dobariya [hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) wrote: > > > > > No am not facing any performance issue.Just want to confirm if my > > > configuration is feasible or not and what will happen if i bring down shard > > > to 1. > > > My ES version is 1.5.2 and java release is 8.45 > > > > > > On Tuesday, May 12, 2015 at 3:38:40 PM UTC+5:30, Mark Walkom wrote: > > > > > > > Are you having performance issues now? > > > > > > > > If so I'd start with replacing your disk setup, chances are it's not as > > > > fast as you think, especially if you are storing the data from both nodes > > > > on the same path. > > > > Also what ES version are you on, what Java release and version? > > > > > > > > On 12 May 2015 at 19:01, Hardik Dobariya [hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) > > > > wrote: > > > > > > > > > Please let me know if below elastic server configuration is feasible > > > > > or not. > > > > > > > > > > ## Total 1 cluster with 3 nodes having 5 shards and 1 replica with multiple indices having total around 100 million data ,sizing 1tb and still increasing > > > > > > > > > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > > > > > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > > > > > 3. Node 3:Master=false,data=false (30gb ram,8 cores) > > > > > > > > > > * * * > > > > > > > > > > All nodes are pointing to same UNC path(\pc1\data) data > > > > > location.Data is not stored locally on nodes,all data is stored on one > > > > > location as mentioned above.we are using Nas to store data and seems Nas is > > > > > very fast so we are storing data on UNC path and not locally. > > > > > > > > > > While googling found if shards are decreased ,it will increase search > > > > > performance.According to the specified configuration should i drop no of > > > > > shards to 1?.Will it increase the performance or does the configuration > > > > > need any changes?. > > > > > Please suggest me the configuration. > > > > > Thanks > > > > > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > > > > > You received this message because you are subscribed to the Google > > > > > Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit > > > > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com) > > > > > [https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/5d223976-a535-4ccf-a9e1-f1d0855015ed%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > > . > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > -- > > > > Please update your bookmarks! We have moved to > > > > [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > * * * > > > > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/ecbaf990-27d2-46f0-8ae5-2aba7a012b85%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/a820c9da-0cb1-485c-a0b2-fc1001cab710%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/a820c9da-0cb1-485c-a0b2-fc1001cab710%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [May 12, 2015, 12:16pm UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/7 "2015-05-12T12:16:45Z")
On Tuesday, May 12, 2015 at 13:24 CEST, Hardik Dobariya [hardikdobariya1132@gmail.com](mailto:hardikdobariya1132@gmail.com) wrote: > yes i can understand the use of network file system is not good. > Actually we do not have any physical machines.we are using virtual > environment.This is the reason we are using NAS to store data on > network. Sure, but you don't have to use NAS just because you use VMs. Local disks or volumes mounted from a SAN are still preferred to accessing the file system over SMB or NFS. > Any suggestion on using virtual environment for Elasticsearch? > and yes am already using 3 nodes.2 masters with data and one child Yes, and as Mark says that's a bad idea. You're better off allowing all three nodes to be masters. Unless you have a serious query load you should keep data on all three nodes. Having a third of the cluster's capacity dedicated to processing queries is most likely very wasteful. -- Magnus Bäck | Software Engineer, Development Tools [magnus.back@sonymobile.com](mailto:magnus.back@sonymobile.com) | Sony Mobile Communications ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/20150512121645.GA806%40seldlx20533.corpusers.net](https://groups.google.com/d/msgid/elasticsearch/20150512121645.GA806%40seldlx20533.corpusers.net). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 12, 2015, 12:24pm UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/8 "2015-05-12T12:24:51Z")
oh yes i forgot to mentioned that we are using SAN mounted volumes. And according to your reply i can say my configuration will work if am using SAN mounted volumes? one last question if my configuration is correct then do i have to drop down my shard size from 5 to 1 or to something less to 3 which might increase performance? These are the three nodes configured 1. Node 1:Master=true,data=true (30gb ram,8 cores) 2. Node 2:Master=true,data=true (30gb ram,8 cores) 3. Node 3:Master=false,data=false (30gb ram,8 cores) On Tuesday, May 12, 2015 at 5:46:54 PM UTC+5:30, Magnus Bäck wrote: > On Tuesday, May 12, 2015 at 13:24 CEST, > Hardik Dobariya \<[hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) \\> wrote: > > > yes i can understand the use of network file system is not good. > > Actually we do not have any physical machines.we are using virtual > > environment.This is the reason we are using NAS to store data on > > network. > > Sure, but you don't have to use NAS just because you use VMs. > Local disks or volumes mounted from a SAN are still preferred > to accessing the file system over SMB or NFS. > > > Any suggestion on using virtual environment for Elasticsearch? > > and yes am already using 3 nodes.2 masters with data and one child > > Yes, and as Mark says that's a bad idea. You're better off allowing > all three nodes to be masters. Unless you have a serious query load > you should keep data on all three nodes. Having a third of the > cluster's capacity dedicated to processing queries is most likely > very wasteful. > > -- > Magnus Bäck | Software Engineer, Development Tools > [magnu...@sonymobile.com](mailto:magnu...@sonymobile.com) \ | Sony Mobile Communications ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8bb923dd-67e2-457d-982b-f38c8d372c0e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8bb923dd-67e2-457d-982b-f38c8d372c0e%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [May 12, 2015, 8:19pm UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/9 "2015-05-12T20:19:10Z")
On Tuesday, May 12, 2015 at 14:24 CEST, Hardik Dobariya [hardikdobariya1132@gmail.com](mailto:hardikdobariya1132@gmail.com) wrote: > oh yes i forgot to mentioned that we are using SAN mounted volumes. Um, okay. But you said you accessed them via a UNC path (\pc1\data). Then it's not a locally mounted volume. > And according to your reply i can say my configuration will work if am > using SAN mounted volumes? Yes. SAN and NAS both work but SAN is preferred. > one last question if my configuration is correct then do i have to > drop down my shard size from 5 to 1 or to something less to 3 which > might increase performance? There are rarely any "correct" configurations, and what's optimal depends on many factors. While there are rules of thumb you'd have to measure for yourself what's best for you. The optimal number of shards depends on how many indexes you have, how many nodes you have (that we know; three) how big the indexes are etc. Shards have a certain overhead so you don't want to have too many (you'll waste resources to shard book keeping) but you don't want them to be too big either and you'll want to spread them out between your nodes. > These are the three nodes configured > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > 3. Node 3:Master=false,data=false (30gb ram,8 cores) Yes, and again, you should turn node 3 into master=true, data=true as well. -- Magnus Bäck | Software Engineer, Development Tools [magnus.back@sonymobile.com](mailto:magnus.back@sonymobile.com) | Sony Mobile Communications ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/20150512201910.GB2679%40seldlx20533.corpusers.net](https://groups.google.com/d/msgid/elasticsearch/20150512201910.GB2679%40seldlx20533.corpusers.net). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 13, 2015, 6:43am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/10 "2015-05-13T06:43:45Z")
we have around 500 indices all sizing to approx 50gb respectively and total size goes around 1tb for all indices and will keep on increasing . The reason behind setting node3 as Master=false,data=false because in configuration file i read this type of node will only work for searching ,aggregation etc. Do i still need to set node3 three as mater and data On Wednesday, May 13, 2015 at 1:49:18 AM UTC+5:30, Magnus Bäck wrote: > On Tuesday, May 12, 2015 at 14:24 CEST, > Hardik Dobariya \<[hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) \\> wrote: > > > oh yes i forgot to mentioned that we are using SAN mounted volumes. > > Um, okay. But you said you accessed them via a UNC path (\pc1\data). > Then it's not a locally mounted volume. > > > And according to your reply i can say my configuration will work if am > > using SAN mounted volumes? > > Yes. SAN and NAS both work but SAN is preferred. > > > one last question if my configuration is correct then do i have to > > drop down my shard size from 5 to 1 or to something less to 3 which > > might increase performance? > > There are rarely any "correct" configurations, and what's optimal > depends on many factors. While there are rules of thumb you'd have > to measure for yourself what's best for you. > > The optimal number of shards depends on how many indexes you have, > how many nodes you have (that we know; three) how big the indexes > are etc. > > Shards have a certain overhead so you don't want to have too many > (you'll waste resources to shard book keeping) but you don't want > them to be too big either and you'll want to spread them out between > your nodes. > > > These are the three nodes configured > > > > 1. Node 1:Master=true,data=true (30gb ram,8 cores) > > 2. Node 2:Master=true,data=true (30gb ram,8 cores) > > 3. Node 3:Master=false,data=false (30gb ram,8 cores) > > Yes, and again, you should turn node 3 into master=true, data=true > as well. > > -- > Magnus Bäck | Software Engineer, Development Tools > [magnu...@sonymobile.com](mailto:magnu...@sonymobile.com) \ | Sony Mobile Communications ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/bcc44119-1521-4ef5-8024-73eee4947537%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bcc44119-1521-4ef5-8024-73eee4947537%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [May 13, 2015, 7:16am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/11 "2015-05-13T07:16:29Z")
On Wednesday, May 13, 2015 at 08:43 CEST, Hardik Dobariya [hardikdobariya1132@gmail.com](mailto:hardikdobariya1132@gmail.com) wrote: > we have around 500 indices all sizing to approx 50gb respectively and > total size goes around 1tb for all indices and will keep on increasing. > The reason behind setting node3 as Master=false,data=false because in > configuration file i read this type of node will only work for > searching ,aggregation etc. Do i still need to set node3 three as mater > and data You'll definitely want all three nodes to be master-eligible (as Mark explained this prevents a split brain situation). Whether it makes sense to dedicate one of the nodes to queries depends a bit on the types of queries you make but I'd say it's unlikely that dedicating a third of your cluster's capacity for queries is the best use of your money. -- Magnus Bäck | Software Engineer, Development Tools [magnus.back@sonymobile.com](mailto:magnus.back@sonymobile.com) | Sony Mobile Communications ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/20150513071628.GA13466%40seldlx20533.corpusers.net](https://groups.google.com/d/msgid/elasticsearch/20150513071628.GA13466%40seldlx20533.corpusers.net). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Hardik\_Dobariya](https://avatars.discourse-cdn.com/v4/letter/h/dbc845/32.png) [@Hardik\_Dobariya](https://discuss.elastic.co/u/Hardik_Dobariya)\ **Post date:** [May 13, 2015, 8:21am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/12 "2015-05-13T08:21:51Z")
Thank you Mark and Magnus for the help provided 🙂 On Wednesday, May 13, 2015 at 12:46:46 PM UTC+5:30, Magnus Bäck wrote: > On Wednesday, May 13, 2015 at 08:43 CEST, > Hardik Dobariya \<[hardikdob...@gmail.com](mailto:hardikdob...@gmail.com) \\> wrote: > > > we have around 500 indices all sizing to approx 50gb respectively and > > total size goes around 1tb for all indices and will keep on increasing. > > The reason behind setting node3 as Master=false,data=false because in > > configuration file i read this type of node will only work for > > searching ,aggregation etc. Do i still need to set node3 three as mater > > and data > > You'll definitely want all three nodes to be master-eligible (as Mark > explained this prevents a split brain situation). Whether it makes sense > to dedicate one of the nodes to queries depends a bit on the types of > queries you make but I'd say it's unlikely that dedicating a third of > your cluster's capacity for queries is the best use of your money. > > -- > Magnus Bäck | Software Engineer, Development Tools > [magnu...@sonymobile.com](mailto:magnu...@sonymobile.com) \ | Sony Mobile Communications ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/17866b5d-f6df-4333-8fc8-c450f8b48954%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/17866b5d-f6df-4333-8fc8-c450f8b48954%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:14am UTC](https://discuss.elastic.co/t/elastic-search-configuration/23611/13 "2017-07-06T00:14:20Z")