Hello. My cluster is reaching 2000 opened shards. I have two data nodes now. I don't want to add another data node and scale up the cluster. I'm thinking more like changing indexing strategy. Currently logstash is creating 10 indexes per day. Some are 10 GB some 200MB. The question is what is re…

Max suggested index sizes / document amount etc

sholzhauer (sholzhauer) November 24, 2023, 2:49pm 2

Hi, i recently answered this discussion on the forum around sizing as well.
Hope this helps you too, if any other questions arise let us know.

1 Like

Topic		Replies	Views
Too many smaller indices. shards is creating issue Elasticsearch	20	54	October 23, 2024
Index Max Size Elasticsearch	6	30922	July 5, 2017
Performance implications of multiple primary shards for one index on the same data node Elasticsearch	4	1434	June 24, 2021
Calculate number of replicas Elasticsearch	3	7429	March 19, 2019
What are the requirements? Elasticsearch	52	79	October 10, 2024

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Max suggested index sizes / document amount etc

Related Topics