# Questions --- Regarding to Size of Bulk Load., Capasity of a Shards and Performance **URL:** \ **Category:** Elasticsearch\ **Created:** [May 9, 2013, 8:09am UTC](https://discuss.elastic.co/t/questions-regarding-to-size-of-bulk-load-capasity-of-a-shards-and-performance/11895 "2013-05-09T08:09:53Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![mohammad\_rafi\_g](https://avatars.discourse-cdn.com/v4/letter/m/58956e/32.png) [@mohammad\_rafi\_g](https://discuss.elastic.co/u/mohammad_rafi_g)\ **Post date:** [May 9, 2013, 8:09am UTC](https://discuss.elastic.co/t/questions-regarding-to-size-of-bulk-load-capasity-of-a-shards-and-performance/11895/1 "2013-05-09T08:09:53Z")
Hi., to All ``` After Working with the ElasticSearch for 3 monts., Now I ``` have got Some Knowledge in ElasticSearch. But I have Some Questions in my Mind. First I will Share What is my system Enveronment and then I List out my Questions. _First:_ My Working Environment We have _Two Elasticsearch Servers_[one is master and another is client] running in Our Server Machines. Elasticsearch _version is., 0.20.5 jvm parametres are for all servers is., -Xms:5gb -Xmx:5gb._ and java version is 1.6.0 Actually \*we have some Millions of data[each record has More than 50 Fields] - in _Fixed Length Files[Delimitor Files]_, and we have implemented some Spring3 based apllications, which will Load data into ElasyicSearch. And also we are Now Implementing Applications for Searchings. And We have Tested Applications in our servers for Testing Performance of The Index Operations. _[here we tested with \<6 to 8\> shards with 0 replicas]_ And we Have Some statistical data about Index Operations. Say., e.g., \*for Loading 1Million of data with 8 fields our Application has taken the Time is: [in the Range 9 to 13 Minutes] \* we have used the logic for Index asynchronously as., _\ bulkRequest.execute( new ActionListener() { @Override public void onResponse(BulkResponse bulkResponse) { //displaying the time taken for index } @Override public void onFailure(Throwable e) { //here we display msg if index operation is failure } }); _Two:_ Now My Questions are: 1. What is the Avg Time that ElasticSearch will Support to index 1Million Records.? 2. From Performance point of view., What is the bulk size we have to use for Indexing such Huge Volume of Data? 3. What is The Maximum Capacity of 1 Shard for Load Data with Same Speed? 4. For Good Practice., How Many, Shards we have to take in one Single Index? and Number of Nodes for Server? 5. Any Suggestion For Boost the Performance of Bulk Loads? Regards and Thanks to All, Mohammad Rafi. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [May 9, 2013, 8:28am UTC](https://discuss.elastic.co/t/questions-regarding-to-size-of-bulk-load-capasity-of-a-shards-and-performance/11895/2 "2013-05-09T08:28:58Z")
1. This depends on your records and your ES config. You can connect your client to a lot of powerful ES nodes and put up some network bandwith, CPU, and fast disks, and ES will be faster than you can send docs 🙂 2. You have to find the "sweet spot" of your current system. Start with 1000 docs per bulk, start with number of concurrent bulks = number of CPU cores in your system, start bulk index for at least 35 or 40 minutes (when large segment merging starts). Repeat this from scratch, but with higher number of docs per bulk request. Increase it to the point where the docs per second rate does not get higher. Typical range of docs per second on a single ES node cluster with current PC server hardware I have observed is everything between 1000 and 10000 docs per second, OOTB. 3. Always set up one ES node per server. Number of shards per node should roughly not exceed the number of CPU cores. 4. Use fast disk susbystem (e.g. SSD RAID0). Use latest Java 7. Disable refresh, disable replica. Jörg Am 09.05.13 10:09, schrieb rafi: > 1. What is the Avg Time that Elasticsearch will Support to index > 1Million Records.? > 2. From Performance point of view., What is the bulk size we have to > use for Indexing such Huge Volume of Data? > 3. What is The Maximum Capacity of 1 Shard for Load Data with Same Speed? > 4. For Good Practice., How Many, Shards we have to take in one Single > Index? and Number of Nodes for Server? > 5. Any Suggestion For Boost the Performance of Bulk Loads? > > ## Regards and Thanks to All, Mohammad Rafi. > > You received this message because you are subscribed to the Google > Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![mohammad\_rafi\_g](https://avatars.discourse-cdn.com/v4/letter/m/58956e/32.png) [@mohammad\_rafi\_g](https://discuss.elastic.co/u/mohammad_rafi_g)\ **Post date:** [May 9, 2013, 9:19am UTC](https://discuss.elastic.co/t/questions-regarding-to-size-of-bulk-load-capasity-of-a-shards-and-performance/11895/3 "2013-05-09T09:19:34Z")
Hi., Jörg Prante Thanks for Reply and for Your Suggestions. Regards Mohammad Rafi. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:37am UTC](https://discuss.elastic.co/t/questions-regarding-to-size-of-bulk-load-capasity-of-a-shards-and-performance/11895/4 "2017-07-06T02:37:22Z")