# Setup of a cluster

**URL:** <https://discuss.elastic.co/t/setup-of-a-cluster/16633>\
**Category:** Elasticsearch\
**Created:** [March 27, 2014, 7:10am UTC](https://discuss.elastic.co/t/setup-of-a-cluster/16633 "2014-03-27T07:10:19Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Luca\_Belluccini](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/luca_belluccini/32/33239_2.png) [@Luca\_Belluccini](https://discuss.elastic.co/u/Luca_Belluccini)\
**Post date:** [March 27, 2014, 7:10am UTC](https://discuss.elastic.co/t/setup-of-a-cluster/16633/1 "2014-03-27T07:10:19Z")

</div>

ello,  
I am setting up a L-E-K solution to be able to compute statistics about our transactions.  
I prepared a VM running logstash instances pulling from redis queues and rerouting structured logs to a elasticsearch 0.90.9 cluster.  
We have more or less 15k Tps and we expect to grow (double up).  
The indexes follow a template deployed on all nodes.

> <https://gist.github.com/lucabelluccini/7563998>

All nodes can be master.  
All nodes contain data.

The problem is... The system becomes slow...

Daily indexes with this setup grow up to 20/30gb each, reaching easily 1billion of documents in 7/10days.

The cluster is composed by 4 \* 24 core 96gb RAM systems.

I could add some "powerful" VM (8 core 32gb ram each) without data (we are limited to 40gb disk space).

Should I increase the number of shards and keep replicas to 1?

Since I am continuously feeding the es cluster, maybe would be useful to exploit some no-data nodes to load balance search queries.

Any advice?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/11591431-490c-4656-b82d-ed038c2aa26f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/11591431-490c-4656-b82d-ed038c2aa26f%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Binh\_Ly\_2](https://avatars.discourse-cdn.com/v4/letter/b/d07c76/32.png) [@Binh\_Ly\_2](https://discuss.elastic.co/u/Binh_Ly_2)\
**Post date:** [March 27, 2014, 12:38pm UTC](https://discuss.elastic.co/t/setup-of-a-cluster/16633/2 "2014-03-27T12:38:34Z")

</div>

When you say slow, do you mean queries are slow? If so, can you give some  
example queries and also response times that you are seeing?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8f142603-0ac5-4210-b3ec-53399d0bb4c8%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8f142603-0ac5-4210-b3ec-53399d0bb4c8%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Luca\_Belluccini](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/luca_belluccini/32/33239_2.png) [@Luca\_Belluccini](https://discuss.elastic.co/u/Luca_Belluccini)\
**Post date:** [March 27, 2014, 2:26pm UTC](https://discuss.elastic.co/t/setup-of-a-cluster/16633/3 "2014-03-27T14:26:48Z")

</div>

I am using Kibana, so typical dashboards with 6-7 facets on potentially non  
low cardinality fields.

Slow, I mean non reactive dashboard, taking several seconds (20 or more) to  
make the full dashboard appear.

Il giorno giovedì 27 marzo 2014 13:38:34 UTC+1, Binh Ly ha scritto:

> When you say slow, do you mean queries are slow? If so, can you give some  
> example queries and also response times that you are seeing?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/1a8ee179-8069-4df6-bfe6-71734643fb45%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1a8ee179-8069-4df6-bfe6-71734643fb45%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:40am UTC](https://discuss.elastic.co/t/setup-of-a-cluster/16633/4 "2017-07-06T01:40:10Z")

</div>


