# Need help in setting production enviorment

**URL:** <https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098>\
**Category:** Elasticsearch\
**Created:** [October 27, 2016, 6:01am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098 "2016-10-27T06:01:39Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![banu](https://avatars.discourse-cdn.com/v4/letter/b/2acd7d/32.png) [@banu](https://discuss.elastic.co/u/banu)\
**Post date:** [October 27, 2016, 6:01am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/1 "2016-10-27T06:01:39Z")

</div>

I am new to elastic search. I am doing POC on set-up production environment. I need help to do this.

1. What are the production parameters we need to consider when setting the environment ?

2. what are all the watermark need to set-up production ready environment ?

There are two process running live server(improve performance Ex: performance 20 to 40 milliseconds), Batch process server (improve throughput. Ex: In 1 hour 1 server will serve 200 transaction).

live server will have 8 dedicated server nodes. Batch Process will have 12 servers.

How to distribute request between live server and Batch node to not compromise live server performance while Batch in progress. How to scale up application without performance compromise.

Live server transaction 250K/hour in single server (We have 8 Online servers)  
Batch process 1MN/hour in single server ( we have 8 Batch servers)

What are all the requirements needed for the above scenario for setting production environment ?

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [October 27, 2016, 6:13am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/2 "2016-10-27T06:13:14Z")

</div>

> What are the production parameters we need to consider when setting the environment ?

Have you consulted the available documentation?

> **[Production Deployment | Elasticsearch: The Definitive Guide \[2.x\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/guide/current/deploy.html)**

> **[Elasticsearch: The Official Distributed Search & Analytics Engine | Elastic](https://www.elastic.co/elasticsearch)**
>
> Elasticsearch is the leading distributed, RESTful, free and open search and analytics engine designed for speed, horizontal scalability, reliability, and easy management. Get started for free.

> what are all the watermark need to set-up production ready environment ?

Are you talking about the disk watermark settings?

> What are all the requirements needed for the above scenario for setting production environment ?

It's not that simple. What might require tuning depends on hardware configuration, the kind of documents, the type of queries, ...

---

<div class="post-metadata">

**Author:** ![banu](https://avatars.discourse-cdn.com/v4/letter/b/2acd7d/32.png) [@banu](https://discuss.elastic.co/u/banu)\
**Post date:** [October 27, 2016, 6:54am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/3 "2016-10-27T06:54:31Z")

</div>

what are all the watermark need to set-up production ready environment ?  
Are you talking about the disk watermark settings?-yes

we have totally 300millions of records just give an approximate cluster and node setup how many its required?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 27, 2016, 7:08am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/4 "2016-10-27T07:08:24Z")

</div>

Elasticsearch comes very good default values, so stick with these until you have gained more familiarity with Elasticsearch. The required size and configuration of a cluster does like Magnus said depend on the hardware it is deployed on, the type of data as well as the indexing and query patterns. This talk about [Quantitative Cluster Sizing](https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing) will give you an idea about how to determine this through benchmarks.

---

<div class="post-metadata">

**Author:** ![banu](https://avatars.discourse-cdn.com/v4/letter/b/2acd7d/32.png) [@banu](https://discuss.elastic.co/u/banu)\
**Post date:** [October 27, 2016, 7:25am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/5 "2016-10-27T07:25:26Z")

</div>

Live server is consider here as an online application search request and batch process is consider as an bulk request and request would be in file format below is the sample setup we have for testing for this we need a suggestion in production File System Store Size: 85.0GB 85.4GB Documents: 336,954,885 336,954,885 Index Activity Search - Query: 14.83ms 14msSearch - Fetch: 1.48ms 1.51ms Refresh: 2.14ms 41.04ms Memory Heap Size: 2.6 gb 2.8 gb % Heap Used: 44.2% 61.2%

we are using a linux machine setup

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [October 27, 2016, 7:38am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/6 "2016-10-27T07:38:33Z")

</div>

Why do you think you need to modify the disk watermark settings?

> we have totally 300millions of records just give an approximate cluster and node setup how many its required?

I'd expect a single machine to be able to cope with 300M documents, but as I said it depends on hardware configuration, the kind of documents, the type of queries, ...

---

<div class="post-metadata">

**Author:** ![banu](https://avatars.discourse-cdn.com/v4/letter/b/2acd7d/32.png) [@banu](https://discuss.elastic.co/u/banu)\
**Post date:** [October 27, 2016, 9:57am UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/7 "2016-10-27T09:57:19Z")

</div>

how to handle the data traffic and evenly distribute the request without performance impact ?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:09pm UTC](https://discuss.elastic.co/t/need-help-in-setting-production-enviorment/64098/8 "2017-07-05T22:09:07Z")

</div>


