# Elasticsearch cluster configuration for intensive write **URL:** \ **Category:** Elasticsearch\ **Created:** [October 31, 2023, 9:43am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107 "2023-10-31T09:43:11Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![avnere](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@avnere](https://discuss.elastic.co/u/avnere)\ **Post date:** [October 31, 2023, 9:43am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/1 "2023-10-31T09:43:11Z")
Hi, I need to index ~1TB data per day. I have the required HW and want to know which cluster should I raise, means How many nodes, How many shards, etc. Is there any formula for that? Thanks. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 31, 2023, 9:46am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/2 "2023-10-31T09:46:23Z")
Have you looked at [the docs around optimizing for indexing speed](https://www.elastic.co/guide/en/elasticsearch/reference/8.10/tune-for-indexing-speed.html)? Have you ensured that you have very fast storage, ideally fast local SSDs, as this often ends up being the bottleneck? What type of data are you ingesting? Do you have many different types of data or is it uniform? What is the retention period for your data? ---
**Author:** ![avnere](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@avnere](https://discuss.elastic.co/u/avnere)\ **Post date:** [October 31, 2023, 10:27am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/3 "2023-10-31T10:27:58Z")
I have all the required HW: NVMe drives, CPU, RAM. At this moment I have 1 kind of data. I want to understand which cluster (How many nodes, How many shards, etc.) should I raise in order to ingest ~1TB per day. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 31, 2023, 10:30am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/4 "2023-10-31T10:30:51Z")
> [@Christian\_Dahlqvist](#): > > What is the retention period for your data? How long are you keeping the data in the cluster? ---
**Author:** ![avnere](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@avnere](https://discuss.elastic.co/u/avnere)\ **Post date:** [October 31, 2023, 10:32am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/5 "2023-10-31T10:32:46Z")
I have created delete policy of 30 days and rollover every 40GB shard ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 31, 2023, 11:31am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/6 "2023-10-31T11:31:25Z")
I would recommend you have a look at some of the blog posts and webinars around capacity planning that should be available on the Elastic website. I found [this one](https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud) which is about Elastic Cloud and quite old. Most of the concepts applied should still be applicable though. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [November 28, 2023, 11:31am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-configuration-for-intensive-write/346107/7 "2023-11-28T11:31:53Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.