# Heavy IO on Master-data node **URL:** \ **Category:** Elasticsearch\ **Created:** [August 1, 2019, 9:01am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282 "2019-08-01T09:01:08Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Su\_Ki](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/su_ki/32/51406_2.png) [@Su\_Ki](https://discuss.elastic.co/u/Su_Ki)\ **Post date:** [August 1, 2019, 9:01am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282/1 "2019-08-01T09:01:08Z")
Hello, We have set an elasticsearch cluster that is consisted total of 8 nodes, where 6 of them are eligible master node and data node. The rest 2 are data only node. And they are all same spec servers. As we do performance test, we make pretty high tps (searching requests).. say, 800 tps in average for hours. Then a master node's write IOPS spikes, which results in high load average.. I would like to know why heavy writing happens on master node much more than on data nodes. For example, master node's IOPS hits about 50 while other nodes IOPS rarely increases to 5. ---
**Author:** ![Bernt\_Rostad](https://avatars.discourse-cdn.com/v4/letter/b/3ab097/32.png) [@Bernt\_Rostad](https://discuss.elastic.co/u/Bernt_Rostad)\ **Post date:** [August 1, 2019, 10:28am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282/2 "2019-08-01T10:28:01Z")
> [@Su\_Ki](#): > > As we do performance test, we make pretty high tps (searching requests).. say, 800 tps in average for hours If this is the volume you expect in your cluster you shouldn't let a data node double as master, as that will affect its ability to maintain cluster state during heavy work loads. Instead, you should consider setting up 3 dedicated master eligible nodes (with **node.master: true** and **node.data: false** ) that holds no index data and let the remaining 5 nodes be data only ( **node.master: false** ). An advantage with this setup is that master eligible nodes can be on lightweight servers with less disc space and fewer CPU cores than the heavy duty data nodes that must handle both indexing and searches. I use this separation of data and master eligible nodes in my clusters and that has served me well so far 🙂 ---
**Author:** ![Su\_Ki](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/su_ki/32/51406_2.png) [@Su\_Ki](https://discuss.elastic.co/u/Su_Ki)\ **Post date:** [August 2, 2019, 12:23am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282/3 "2019-08-02T00:23:34Z")
Thanks for the reply. I understand the cluster setup need to be adjusted Still, how should I understand the heavy writing on master node? ---
**Author:** ![Su\_Ki](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/su_ki/32/51406_2.png) [@Su\_Ki](https://discuss.elastic.co/u/Su_Ki)\ **Post date:** [August 2, 2019, 12:30am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282/4 "2019-08-02T00:30:35Z")
> [@Bernt\_Rostad](#): > > If this is the volume you expect in your cluster you shouldn't let a data node double as master, We have 6 master eligible-data nodes, and 2 dedicated data nodes. ---
**Author:** ![Bernt\_Rostad](https://avatars.discourse-cdn.com/v4/letter/b/3ab097/32.png) [@Bernt\_Rostad](https://discuss.elastic.co/u/Bernt_Rostad)\ **Post date:** [August 2, 2019, 4:17am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282/5 "2019-08-02T04:17:04Z")
> [@Su\_Ki](#): > > Still, how should I understand the heavy writing on master node? A master node normally don't have heavy writing as it stores very little data so my best guess is that the heavy writing you saw came from the data node part (indexing, shard updating, segment merging etc), which is why I suggested using dedicated masters and dedicated data nodes in your cluster. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 30, 2019, 4:19am UTC](https://discuss.elastic.co/t/heavy-io-on-master-data-node/193282/6 "2019-08-30T04:19:33Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.