# Architecture for scaling ES **URL:** \ **Category:** Elasticsearch\ **Created:** [September 18, 2013, 10:05am UTC](https://discuss.elastic.co/t/architecture-for-scaling-es/13666 "2013-09-18T10:05:18Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Fabien\_Guiraud](https://avatars.discourse-cdn.com/v4/letter/f/57b2e6/32.png) [@Fabien\_Guiraud](https://discuss.elastic.co/u/Fabien_Guiraud)\ **Post date:** [September 18, 2013, 10:05am UTC](https://discuss.elastic.co/t/architecture-for-scaling-es/13666/1 "2013-09-18T10:05:18Z")
Hi all, I need to know how scale ES. I have 15millions docs for one index, 5millions for another one, and I do a lot of big faceting (terms stats, etc...). How many servers I need? I know it's difficult to say something like that, but right now, I have 2 servers, 4 core and 7.5 go RAM each one. It's really slow. Any idea? Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Fabien\_Guiraud](https://avatars.discourse-cdn.com/v4/letter/f/57b2e6/32.png) [@Fabien\_Guiraud](https://discuss.elastic.co/u/Fabien_Guiraud)\ **Post date:** [September 18, 2013, 10:09am UTC](https://discuss.elastic.co/t/architecture-for-scaling-es/13666/2 "2013-09-18T10:09:45Z")
In fact, for users who knows AWS, I'm on EC2, with m1.large instances On Wednesday, September 18, 2013 12:05:18 PM UTC+2, Fabien Guiraud wrote: > Hi all, > > I need to know how scale ES. > I have 15millions docs for one index, 5millions for another one, and I do > a lot of big faceting (terms stats, etc...). > > How many servers I need? I know it's difficult to say something like that, > but right now, I have 2 servers, 4 core and 7.5 go RAM each one. > It's really slow. > > Any idea? > > Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Post date:** [September 18, 2013, 9:47pm UTC](https://discuss.elastic.co/t/architecture-for-scaling-es/13666/3 "2013-09-18T21:47:02Z")
Hey, you havent said anything about your configuration or you definition of slow and even your expectations. Maybe you can elaborate about all this bit more... Generally the best thing is to start with one server and see when it degrades in performance (this might be indxing speed, query latency or whatever metric you have defined for yourself) and then start slowly with scaling out. --Alex On Wed, Sep 18, 2013 at 12:09 PM, Fabien Guiraud [fabien1909@gmail.com](mailto:fabien1909@gmail.com)wrote: > In fact, for users who knows AWS, I'm on EC2, with m1.large instances > > On Wednesday, September 18, 2013 12:05:18 PM UTC+2, Fabien Guiraud wrote: > > > Hi all, > > > > I need to know how scale ES. > > I have 15millions docs for one index, 5millions for another one, and I do > > a lot of big faceting (terms stats, etc...). > > > > How many servers I need? I know it's difficult to say something like > > that, but right now, I have 2 servers, 4 core and 7.5 go RAM each one. > > It's really slow. > > > > Any idea? > > > > Thanks > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Fabien\_Guiraud](https://avatars.discourse-cdn.com/v4/letter/f/57b2e6/32.png) [@Fabien\_Guiraud](https://discuss.elastic.co/u/Fabien_Guiraud)\ **Post date:** [September 18, 2013, 9:51pm UTC](https://discuss.elastic.co/t/architecture-for-scaling-es/13666/4 "2013-09-18T21:51:05Z")
Hi, Yes that's why I open a new topic here : [Redirecting to Google Groups](https://groups.google.com/forum/#!topic/elasticsearch/_OaE2FzN4Ss) There is much more informations. I succeeded to have queries about 2-3 seconds, nothing better ☹ My index of 15 millions docs must have a problem somewhere I think. I use facets but with search\_type 'count' and only facet\_filter, not query…. Still slow… Any idea to optimise ? Thanks, Regards, Fabien On Sep 18, 2013, at 11:47 PM, Alexander Reelsen [alr@spinscale.de](mailto:alr@spinscale.de) wrote: > Hey, > > you havent said anything about your configuration or you definition of slow and even your expectations. Maybe you can elaborate about all this bit more... > > Generally the best thing is to start with one server and see when it degrades in performance (this might be indxing speed, query latency or whatever metric you have defined for yourself) and then start slowly with scaling out. > > --Alex > > On Wed, Sep 18, 2013 at 12:09 PM, Fabien Guiraud [fabien1909@gmail.com](mailto:fabien1909@gmail.com) wrote: > In fact, for users who knows AWS, I'm on EC2, with m1.large instances > > On Wednesday, September 18, 2013 12:05:18 PM UTC+2, Fabien Guiraud wrote: > Hi all, > > I need to know how scale ES. > I have 15millions docs for one index, 5millions for another one, and I do a lot of big faceting (terms stats, etc...). > > How many servers I need? I know it's difficult to say something like that, but right now, I have 2 servers, 4 core and 7.5 go RAM each one. > It's really slow. > > Any idea? > > Thanks > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit [https://groups.google.com/d/topic/elasticsearch/\_mlplReadmw/unsubscribe](https://groups.google.com/d/topic/elasticsearch/_mlplReadmw/unsubscribe). > To unsubscribe from this group and all its topics, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:15am UTC](https://discuss.elastic.co/t/architecture-for-scaling-es/13666/5 "2017-07-06T02:15:39Z")