# Networking **URL:** \ **Category:** Elasticsearch\ **Created:** [May 24, 2017, 10:58am UTC](https://discuss.elastic.co/t/networking/86950 "2017-05-24T10:58:55Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![thosfelt](https://avatars.discourse-cdn.com/v4/letter/t/e480ec/32.png) [@thosfelt](https://discuss.elastic.co/u/thosfelt)\ **Post date:** [May 24, 2017, 10:58am UTC](https://discuss.elastic.co/t/networking/86950/1 "2017-05-24T10:58:55Z")
I have a 26 node cluster where 3 nodes have a public facing interface. My thought was to set up those 3 nodes as master/ingest nodes and the remaining nodes as data nodes. I have a 100Gb InfiniBand network that I would like to use for the node-to-node communications. From what I'm reading I should set the following: network.publish\_host: _ib0:ipv4_ -\> IB network interface on the data nodes and master/ingest nodes transport.tcp.port: 9300-9400 -\> IB network port range for cluster communications network.bind\_host: _eth0:ipv4_ -\> public interface on master/ingest nodes http.port: 9200 -\> port for public interfaces My next question is if the parameters on the command line i.e. -Ehttp.port:9201 would override the value in the elasticsearch.yml file. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [May 24, 2017, 11:05am UTC](https://discuss.elastic.co/t/networking/86950/2 "2017-05-24T11:05:21Z")
For a cluster that size I would recommend using dedicated master nodes that do not hold data nor serve traffic. This will increase stability and resilience as the dedicated master nodes are unlikely to suffer from long GC. Having master nodes double as coordinating and/or ingest nodes is in my opinion a bad idea at that scale. ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 24, 2017, 11:12am UTC](https://discuss.elastic.co/t/networking/86950/3 "2017-05-24T11:12:45Z")
> [@thosfelt](#): > > My next question is if the parameters on the command line i.e. -Ehttp.port:9201 would override the value in the elasticsearch.yml file. Yes. It will. ---
**Author:** ![thosfelt](https://avatars.discourse-cdn.com/v4/letter/t/e480ec/32.png) [@thosfelt](https://discuss.elastic.co/u/thosfelt)\ **Post date:** [May 24, 2017, 11:17am UTC](https://discuss.elastic.co/t/networking/86950/4 "2017-05-24T11:17:06Z")
For the master nodes I have dual 20-core CPUs and a 512Gb of memory so just having them as master nodes only would be a waste of resources, I've currently done some stress testing and have been able to maintain around 500,000 docs/sec at a rate of about 11Tb/hour with very little load on the master/ingest nodes. Just trying to use what was given to me. The data nodes have dual 14-care CPUs with the same 512Gb of memory and 6 1.6Tb SSDs - to make use of memory I've set up 4 ES data instances on each node giving them 6 cores each and 32Gb of memory (I'm still tuning this part). ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [May 24, 2017, 11:34am UTC](https://discuss.elastic.co/t/networking/86950/5 "2017-05-24T11:34:11Z")
You can always set up a dedicated master node as well as a separate coordinating/ingest node on those machines. Just having the dedicated master node in a separate JVM process without serving traffic will be beneficial. ---
**Author:** ![thosfelt](https://avatars.discourse-cdn.com/v4/letter/t/e480ec/32.png) [@thosfelt](https://discuss.elastic.co/u/thosfelt)\ **Post date:** [May 24, 2017, 11:42am UTC](https://discuss.elastic.co/t/networking/86950/6 "2017-05-24T11:42:21Z")
that is the configuration I have ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [June 21, 2017, 11:43am UTC](https://discuss.elastic.co/t/networking/86950/7 "2017-06-21T11:43:14Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.