# Insertion Spikes

**URL:** <https://discuss.elastic.co/t/insertion-spikes/16272>\
**Category:** Elasticsearch\
**Created:** [March 10, 2014, 6:38pm UTC](https://discuss.elastic.co/t/insertion-spikes/16272 "2014-03-10T18:38:45Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Parag\_Shah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/parag_shah/32/44836_2.png) [@Parag\_Shah](https://discuss.elastic.co/u/Parag_Shah)\
**Post date:** [March 10, 2014, 6:38pm UTC](https://discuss.elastic.co/t/insertion-spikes/16272/1 "2014-03-10T18:38:45Z")

</div>

Hi all,

As part of our performance exercize, we have been trying characterize  
the Insertion performance of ElasticSearch (0.90.7). Here is our setup:

_Nodes:_ 3 AWS m1.xlarge (16G)  
_Memory:_ 8G Heap on each node.

_Indices:_ 5 aliases, 3 indexes per alias, 2 shards per index. (30 shards),  
1 replica.  
\*Total: \*60 shards across 3 machines in the cluster.

_Client Nodes:_ 3 AWS m1.large (8G)  
_No. of threads per client:_ 50  
_Memory:_ 1 G (heap)  
_Overall:_ 1.4 M documents  
_Avg Doc size:_ 4K (Most messages were 500 - 1500 bytes, there were a  
bunch of message \>8K)

The graph below shows insertion spikes at various points. We tried to  
correlate them with the merge times, but that did not seem to hold true.  
There also seems to be no direct correlation between message size and  
insertion times.

[https://lh3.googleusercontent.com/-CDJ90Ty1w1A/Ux4F5gfWT2I/AAAAAAAACOE/9U866TNtP4I/s1600/insertion\_95th\_percentile.png](https://lh3.googleusercontent.com/-CDJ90Ty1w1A/Ux4F5gfWT2I/AAAAAAAACOE/9U866TNtP4I/s1600/insertion_95th_percentile.png)

Insertion times have been plotted at 95th percentile.  
Below is a plot for the size of messages:

[https://lh5.googleusercontent.com/-YGntu5KejBg/Ux4GJg1UohI/AAAAAAAACOM/T4ciaVajD04/s1600/insertion\_data\_size.png](https://lh5.googleusercontent.com/-YGntu5KejBg/Ux4GJg1UohI/AAAAAAAACOM/T4ciaVajD04/s1600/insertion_data_size.png)  
My question is: Is there something we are doing wrong in here or is there a  
way to explain why the spikes occur for insertion times?

Any help will be appreciated.

Regards  
Parag

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/665fe952-964b-4cf4-8ef8-fab95a529cc1%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/665fe952-964b-4cf4-8ef8-fab95a529cc1%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:44am UTC](https://discuss.elastic.co/t/insertion-spikes/16272/2 "2017-07-06T01:44:27Z")

</div>

Closed on July 6, 2017, 1:44am UTC


