# When to use multiple clusters

**URL:** <https://discuss.elastic.co/t/when-to-use-multiple-clusters/18827>\
**Category:** Elasticsearch\
**Created:** [July 23, 2014, 2:34pm UTC](https://discuss.elastic.co/t/when-to-use-multiple-clusters/18827 "2014-07-23T14:34:09Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Alex\_Kehayias](https://avatars.discourse-cdn.com/v4/letter/a/85e7bf/32.png) [@Alex\_Kehayias](https://discuss.elastic.co/u/Alex_Kehayias)\
**Post date:** [July 23, 2014, 2:34pm UTC](https://discuss.elastic.co/t/when-to-use-multiple-clusters/18827/1 "2014-07-23T14:34:09Z")

</div>

I have several large indices (100M docs) on the same cluster. Is there any  
advice of when it is appropriate to separate into multiple clusters vs one  
large one? Each index has a slightly different usage profile (read vs write  
heavy, update vs insert). How many indices would you recommend for a single  
cluster? Is it ok to have many large indices on the same cluster?

Thanks!

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [July 23, 2014, 11:04pm UTC](https://discuss.elastic.co/t/when-to-use-multiple-clusters/18827/2 "2014-07-23T23:04:00Z")

</div>

Depends what your hardware profiles are like, and a bunch of other things  
related to you and your environment.  
eg If you have high end servers then it makes sense to put your heavy  
read/write indexes into a cluster on those, then leave the rest for more  
average machines.

We have multiple clusters based on use. One for an application text based  
search, one for application logging, one for system logging and we're going  
to spin up another one for a new project we're starting. This might sound  
like a waste of resources, and it probably is to a degree, but we have the  
infrastructure for it and it makes things easier to manage.

Regards,  
Mark Walkom

Infrastructure Engineer  
Campaign Monitor  
email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
web: [www.campaignmonitor.com](http://www.campaignmonitor.com)

On 24 July 2014 00:34, Alex Kehayias [alex@shareablee.com](mailto:alex@shareablee.com) wrote:

> I have several large indices (100M docs) on the same cluster. Is there any  
> advice of when it is appropriate to separate into multiple clusters vs one  
> large one? Each index has a slightly different usage profile (read vs write  
> heavy, update vs insert). How many indices would you recommend for a single  
> cluster? Is it ok to have many large indices on the same cluster?
> 
> Thanks!
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624YqsEB2BC1zexHZOPp56%3DGJCaWcp72OjtNMYqZxqXXVxg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624YqsEB2BC1zexHZOPp56%3DGJCaWcp72OjtNMYqZxqXXVxg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Alex\_Kehayias](https://avatars.discourse-cdn.com/v4/letter/a/85e7bf/32.png) [@Alex\_Kehayias](https://discuss.elastic.co/u/Alex_Kehayias)\
**Post date:** [July 23, 2014, 11:17pm UTC](https://discuss.elastic.co/t/when-to-use-multiple-clusters/18827/3 "2014-07-23T23:17:12Z")

</div>

Thanks Mark! We're deploying on EC2 (always a good time). Seems like the  
mixture of different indices that have different usage profiles is leading  
to some performance issues that a dedicated cluster would be more  
appropriate for.

On Wednesday, July 23, 2014 7:04:34 PM UTC-4, Mark Walkom wrote:

> Depends what your hardware profiles are like, and a bunch of other things  
> related to you and your environment.  
> eg If you have high end servers then it makes sense to put your heavy  
> read/write indexes into a cluster on those, then leave the rest for more  
> average machines.
> 
> We have multiple clusters based on use. One for an application text based  
> search, one for application logging, one for system logging and we're going  
> to spin up another one for a new project we're starting. This might sound  
> like a waste of resources, and it probably is to a degree, but we have the  
> infrastructure for it and it makes things easier to manage.
> 
> Regards,  
> Mark Walkom
> 
> Infrastructure Engineer  
> Campaign Monitor  
> email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) \<javascript:\>  
> web: [www.campaignmonitor.com](http://www.campaignmonitor.com)
> 
> On 24 July 2014 00:34, Alex Kehayias \<[al...@shareablee.com](mailto:al...@shareablee.com) \<javascript:\>\>  
> wrote:
> 
> > I have several large indices (100M docs) on the same cluster. Is there  
> > any advice of when it is appropriate to separate into multiple clusters vs  
> > one large one? Each index has a slightly different usage profile (read vs  
> > write heavy, update vs insert). How many indices would you recommend for a  
> > single cluster? Is it ok to have many large indices on the same cluster?
> > 
> > Thanks!
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com)  
> > [https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/24ebf4dc-f281-4574-8cbb-cb049c4fac71%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > .  
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6571673c-472f-4013-9608-d511a9f66d86%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6571673c-472f-4013-9608-d511a9f66d86%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:13am UTC](https://discuss.elastic.co/t/when-to-use-multiple-clusters/18827/4 "2017-07-06T01:13:39Z")

</div>


