# Increase query performance by adding more machines, shouldn't it be linear to # of machines? **URL:** \ **Category:** Elasticsearch\ **Created:** [July 2, 2014, 5:09am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429 "2014-07-02T05:09:44Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Seungjin\_Lee](https://avatars.discourse-cdn.com/v4/letter/s/2acd7d/32.png) [@Seungjin\_Lee](https://discuss.elastic.co/u/Seungjin_Lee)\ **Post date:** [July 2, 2014, 5:09am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429/1 "2014-07-02T05:09:44Z")
Hi all, I'm testing percolator performance, 50k/s is required condition with 3~4k rules. now I only have 1 simple rule, and 5 es vms with 1 shard and 4 replicas. and using Java transport client like below new TransportClient(settings) .addTransportAddresses(transportAddressList.toArray(new InetSocketTransportAddress[transportAddressList.size()])); when I added just 1 address to transport client, percolator perf is about 10k/s and when I added all 5 of vms to it, perf is about 15k/s so it increases by about 1.5times only even though I added 4 more vm addresses. Is it supposed to be like this? What I was thinking is, if it runs in for example round-robin fashion, there should be about 5 times performance gain. Could you comment anything on this? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [July 2, 2014, 5:55am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429/2 "2014-07-02T05:55:40Z")
Are you using same physical machine for all your VMs? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 2 juil. 2014 à 07:09, Seungjin Lee [sweetest0409@gmail.com](mailto:sweetest0409@gmail.com) a écrit : Hi all, I'm testing percolator performance, 50k/s is required condition with 3~4k rules. now I only have 1 simple rule, and 5 es vms with 1 shard and 4 replicas. and using Java transport client like below new TransportClient(settings) .addTransportAddresses(transportAddressList.toArray(new InetSocketTransportAddress[transportAddressList.size()])); when I added just 1 address to transport client, percolator perf is about 10k/s and when I added all 5 of vms to it, perf is about 15k/s so it increases by about 1.5times only even though I added 4 more vm addresses. Is it supposed to be like this? What I was thinking is, if it runs in for example round-robin fashion, there should be about 5 times performance gain. Could you comment anything on this? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Patrick](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/patrick/32/1437_2.png) [@Patrick](https://discuss.elastic.co/u/Patrick)\ **Post date:** [July 2, 2014, 5:58am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429/3 "2014-07-02T05:58:54Z")
Also, what's the hardware configuration of the devices? RAM? CPU? Disk? OS? How much data is in your ES instance(s) already? and are you sure you're not hitting a limit on something like client side networking? Thanks, Patrick ## Patrick > **[Patrick Ancillotti on about.me](https://about.me/patrick.ancillotti)** > > I live in New York. patrick eefy net On Tue, Jul 1, 2014 at 11:55 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Are you using same physical machine for all your VMs? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 2 juil. 2014 à 07:09, Seungjin Lee [sweetest0409@gmail.com](mailto:sweetest0409@gmail.com) a écrit : > > Hi all, > > I'm testing percolator performance, 50k/s is required condition with 3~4k > rules. > > now I only have 1 simple rule, and 5 es vms with 1 shard and 4 replicas. > > and using Java transport client like below > > new TransportClient(settings) > .addTransportAddresses(transportAddressList.toArray(new > InetSocketTransportAddress[transportAddressList.size()])); > > when I added just 1 address to transport client, percolator perf is about > 10k/s > > and when I added all 5 of vms to it, perf is about 15k/s > > so it increases by about 1.5times only even though I added 4 more vm > addresses. > > Is it supposed to be like this? > > What I was thinking is, if it runs in for example round-robin fashion, > there should be about 5 times performance gain. > > Could you comment anything on this? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr) > [https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL%2BHSrOczux-gdHPNDRJcPU%3D4CNEh2uKb13NE-%2BGPP3Kw\_NjEg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL%2BHSrOczux-gdHPNDRJcPU%3D4CNEh2uKb13NE-%2BGPP3Kw_NjEg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Seungjin\_Lee](https://avatars.discourse-cdn.com/v4/letter/s/2acd7d/32.png) [@Seungjin\_Lee](https://discuss.elastic.co/u/Seungjin_Lee)\ **Post date:** [July 2, 2014, 5:59am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429/4 "2014-07-02T05:59:49Z")
yes, all same machines on which only ES with same configuration is running 2014-07-02 14:55 GMT+09:00 David Pilato [david@pilato.fr](mailto:david@pilato.fr): > Are you using same physical machine for all your VMs? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 2 juil. 2014 à 07:09, Seungjin Lee [sweetest0409@gmail.com](mailto:sweetest0409@gmail.com) a écrit : > > Hi all, > > I'm testing percolator performance, 50k/s is required condition with 3~4k > rules. > > now I only have 1 simple rule, and 5 es vms with 1 shard and 4 replicas. > > and using Java transport client like below > > new TransportClient(settings) > .addTransportAddresses(transportAddressList.toArray(new > InetSocketTransportAddress[transportAddressList.size()])); > > when I added just 1 address to transport client, percolator perf is about > 10k/s > > and when I added all 5 of vms to it, perf is about 15k/s > > so it increases by about 1.5times only even though I added 4 more vm > addresses. > > Is it supposed to be like this? > > What I was thinking is, if it runs in for example round-robin fashion, > there should be about 5 times performance gain. > > Could you comment anything on this? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr) > [https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U42vJaO0oqfw4DjWP6KK%3DpqtnGEBFGKHOr7Ky7nmbXV5HA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U42vJaO0oqfw4DjWP6KK%3DpqtnGEBFGKHOr7Ky7nmbXV5HA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [July 2, 2014, 6:13am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429/5 "2014-07-02T06:13:34Z")
Sorry. I meant on how many physical bare metal machines your 5 VMs are running? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 2 juil. 2014 à 07:59, Seungjin Lee [sweetest0409@gmail.com](mailto:sweetest0409@gmail.com) a écrit : yes, all same machines on which only ES with same configuration is running 2014-07-02 14:55 GMT+09:00 David Pilato [david@pilato.fr](mailto:david@pilato.fr): > Are you using same physical machine for all your VMs? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 2 juil. 2014 à 07:09, Seungjin Lee [sweetest0409@gmail.com](mailto:sweetest0409@gmail.com) a écrit : > > Hi all, > > I'm testing percolator performance, 50k/s is required condition with 3~4k rules. > > now I only have 1 simple rule, and 5 es vms with 1 shard and 4 replicas. > > and using Java transport client like below > > new TransportClient(settings) > .addTransportAddresses(transportAddressList.toArray(new InetSocketTransportAddress[transportAddressList.size()])); > > when I added just 1 address to transport client, percolator perf is about 10k/s > > and when I added all 5 of vms to it, perf is about 15k/s > > so it increases by about 1.5times only even though I added 4 more vm addresses. > > Is it supposed to be like this? > > What I was thinking is, if it runs in for example round-robin fashion, there should be about 5 times performance gain. > > Could you comment anything on this? > > ## -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U412ecCDh0GONWJZy6S9zjY%2By8xvoVsPrt1849csfs-zUA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/BAEDE7D4-320E-4123-A783-823FF1EC26ED%40pilato.fr). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAL3\_U42vJaO0oqfw4DjWP6KK%3DpqtnGEBFGKHOr7Ky7nmbXV5HA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAL3_U42vJaO0oqfw4DjWP6KK%3DpqtnGEBFGKHOr7Ky7nmbXV5HA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5BFE5974-6B7B-465A-A587-AEBDF6C27D23%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/5BFE5974-6B7B-465A-A587-AEBDF6C27D23%40pilato.fr). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:18am UTC](https://discuss.elastic.co/t/increase-query-performance-by-adding-more-machines-shouldnt-it-be-linear-to-of-machines/18429/6 "2017-07-06T01:18:33Z")