# Hardware requirement for elasticsearch **URL:** \ **Category:** Elasticsearch\ **Created:** [December 18, 2018, 8:21am UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280 "2018-12-18T08:21:07Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Nusrath](https://avatars.discourse-cdn.com/v4/letter/n/f475e1/32.png) [@Nusrath](https://discuss.elastic.co/u/Nusrath)\ **Post date:** [December 18, 2018, 8:21am UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/1 "2018-12-18T08:21:07Z")
I'm trying to setup elasticsearch cluster. I will get maximum of 20TB of data. So what will be hardware required to set up ElasticSearch 6.x and kibana 6.x - Which is better Elastic search category –Open source/ Gold/Platinum - What is ideal configuration for server- side RAM/Hard disks etc. - Tool used to monitor ES performance Appreciate your help!! ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 18, 2018, 8:30am UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/2 "2018-12-18T08:30:15Z")
You have not given any details about your data or use-case or expected indexing/query load, so I suspect it will be very difficult for anyone to give a good answer. ---
**Author:** ![Nusrath](https://avatars.discourse-cdn.com/v4/letter/n/f475e1/32.png) [@Nusrath](https://discuss.elastic.co/u/Nusrath)\ **Post date:** [December 18, 2018, 10:12am UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/3 "2018-12-18T10:12:22Z")
Thanks for reply Christian\_Dahlqvist, Sorry but i don't know what is indexing/query load is. Basically what we are trying is simply getting data and inserting into elastic search and showing dashboards in kibana. We have already developed POC on small chunk of data but now we are expecting nearly 20TB of data. So to work on 20TB of data , what are the machine or hardware requirements ? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 18, 2018, 10:19am UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/4 "2018-12-18T10:19:39Z")
In order to get some kind of answer you need to describe your use-case and provide an indication of how much data you intend to index every day. If you have a logging and/or metrics use case with time-based data, this will typically depend on the expected retention period. I would recommend you have a look at the following resources: > **[How many shards should I have in my Elasticsearch cluster? | Elastic](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster)** > > Elasticsearch is a very versatile platform, that supports a variety of use cases, and provides great flexibility around data organisation and replication strategies. This flexibility can however somet... > **[Sizing Hot-Warm Architectures for Logging and Metrics in the Elasticsearch...](https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud)** > > Want to learn more about the differences between the Amazon Elasticsearch Service and our official Elasticsearch Service? Visit our AWS Elasticsearch comparison page.These are exciting times! Elastics... [https://www.elastic.co/webinars/optimizing-storage-efficiency-in-elasticsearch](https://www.elastic.co/webinars/optimizing-storage-efficiency-in-elasticsearch) [https://www.elastic.co/webinars/using-rally-to-get-your-elasticsearch-cluster-size-right](https://www.elastic.co/webinars/using-rally-to-get-your-elasticsearch-cluster-size-right) [https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing](https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing) It would also be useful to know where you intend to deploy this and whether there are any constraints around hardware that should be considered when making recommendations. ---
**Author:** ![Nusrath](https://avatars.discourse-cdn.com/v4/letter/n/f475e1/32.png) [@Nusrath](https://discuss.elastic.co/u/Nusrath)\ **Post date:** [December 19, 2018, 12:16pm UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/5 "2018-12-19T12:16:07Z")
Thanks Christian, I have gone though above links and elastic use cases and we observe our use case will be Log monitoring and analysis using dashboards with full text search. In our case it would be Log analysis, where we will input data on a daily basis (~appx 1 TB per day ) and run searches on them this process will be continuing for next 2 years and I think we should go with Hot-warm architecture. Can you suggest me what are the hardware requirements to set up ES cluster along with kibana? Thanks 🙂 ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 19, 2018, 12:42pm UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/6 "2018-12-19T12:42:31Z")
If you want to ingest 1TB per day and keep it searchable for 2 years, that will be a large cluster (or even multiple clusters). Given the scale I would recommend you run some tests to determine how much space your type of data will take up on disk and how much data your nodes will be able to hold while still meeting search latency requirements. This will allow you to more accurately estimate the size of the cluster(s) required than anyone here can provide. The links I provided earlier should guide you on how to do this. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 16, 2019, 12:42pm UTC](https://discuss.elastic.co/t/hardware-requirement-for-elasticsearch/161280/7 "2019-01-16T12:42:38Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.