# Elastic search configuration for extensive search and read/write and indexing operations with heavy number of users **URL:** \ **Category:** Elasticsearch\ **Created:** [July 9, 2019, 6:36am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462 "2019-07-09T06:36:54Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![saurabh.singh2](https://avatars.discourse-cdn.com/v4/letter/s/3d9bf3/32.png) [@saurabh.singh2](https://discuss.elastic.co/u/saurabh.singh2)\ **Post date:** [July 9, 2019, 6:36am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/1 "2019-07-09T06:36:54Z")
Hello, We need information regarding elastic search configuration for our application environment. We use elastic search very extensively for our application for search and indexing. Our application is using Liferay (portal development) with Java as development platform. We are facing slowness in application related to elastic search when more users are using the application. In application we do a lot of index read and write with several operations. As per our application monitoring we see many thread are in waiting status for read/write indexing. Please suggest the best elastic search configuration as per below mentioned application details. Application: Portal developed on Liferay with Java Database :- Oracle Java Version :- Open JDK 8 Search Engine :- Elastic Search Elastic Search Version :- 6.1.3 Operation System: - Linux Number of nodes :- 2/4 CPU Cores :- 4 cores Number of concurrent users at a time :- 100 - 200 (2 nodes) / 250 - 400 (4 nodes) Elastic Search yml configuration :- * * * bootstrap.memory\_lock: true discovery.zen.minimum\_master\_nodes: 1 indices.query.bool.max\_clause\_count: 10240 thread\_pool: search: size: 40 queue\_size: 500 min\_queue\_size: 10 max\_queue\_size: 1000 auto\_queue\_frame\_size: 2000 target\_response\_time: 2s index: queue\_size: 10000 bulk: queue\_size: 500 * * * Thanks, Saurabh ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [July 9, 2019, 7:14am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/2 "2019-07-09T07:14:25Z")
How much data do you have in the cluster? How many indices and shards? Are you using attached SSD storage? What does the workload look like? What type of queries are you using? How many queries per second to you need to support? ---
**Author:** ![saurabh.singh2](https://avatars.discourse-cdn.com/v4/letter/s/3d9bf3/32.png) [@saurabh.singh2](https://discuss.elastic.co/u/saurabh.singh2)\ **Post date:** [July 9, 2019, 7:42am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/3 "2019-07-09T07:42:12Z")
@Christian_Dahlqvist Hello , We have near to 6 GB data in cluster. Indices settings are default. We have 2 shards. We use LINUX servers (not laptops) with no additional SSD storage. Workload mostly includes Searching articles/ documents and media, searching users , updating users (write actions) . Also it includes getting list of articles by type . etc As per our monitoring I see queries are mostly search , org.elasticsearch.action.bulk.BulkRequest (count of 1400 for a 10 minute test), org.elasticsearch.action.admin.indices.refresh.RefreshRequest (count of 900 for a 10 minute test) etc. Also we see LIMIT EXCEEDED BUCKET in monitoring log queries for elastic search (count of 1841 for a 10 minute test). Thanks, Saurabh ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [July 9, 2019, 8:25am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/4 "2019-07-09T08:25:36Z")
How much RAM does each server have? What is your heap size? Is there anything else running on these hosts? ---
**Author:** ![saurabh.singh2](https://avatars.discourse-cdn.com/v4/letter/s/3d9bf3/32.png) [@saurabh.singh2](https://discuss.elastic.co/u/saurabh.singh2)\ **Post date:** [July 9, 2019, 9:44am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/5 "2019-07-09T09:44:27Z")
@Christian_Dahlqvist Hello, The total RAM size is 32012 MB. MaxHeap Size for Liferay Tomcat Servers is 8192 MB. We have another tomcat and Elastic search running on same host. Thanks, Saurabh ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [July 9, 2019, 5:57pm UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/6 "2019-07-09T17:57:50Z")
What type of storage does the node have? What does disk I/O and iowait look like? ---
**Author:** ![saurabh.singh2](https://avatars.discourse-cdn.com/v4/letter/s/3d9bf3/32.png) [@saurabh.singh2](https://discuss.elastic.co/u/saurabh.singh2)\ **Post date:** [July 10, 2019, 1:58pm UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/7 "2019-07-10T13:58:31Z")
@Christian_Dahlqvist The Disk Storage type is Local Storage. Not sure what iowait is. Also one additional info is the refresh interval of elastic is 60 seconds. Thanks, Saurabh ---
**Author:** ![saurabh.singh2](https://avatars.discourse-cdn.com/v4/letter/s/3d9bf3/32.png) [@saurabh.singh2](https://discuss.elastic.co/u/saurabh.singh2)\ **Post date:** [July 12, 2019, 10:20am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/8 "2019-07-12T10:20:01Z")
@Christian_Dahlqvist , Hello did you get chance to check my updates comment ? Please let me know if you need additional information . Thanks, Saurabh ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 9, 2019, 10:20am UTC](https://discuss.elastic.co/t/elastic-search-configuration-for-extensive-search-and-read-write-and-indexing-operations-with-heavy-number-of-users/189462/9 "2019-08-09T10:20:02Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.