# Cyclical ES CPU usage

**URL:** <https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829>\
**Category:** Elasticsearch\
**Created:** [October 2, 2013, 7:16pm UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829 "2013-10-02T19:16:36Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![Erik\_Anderson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/erik_anderson/32/2045_2.png) [@Erik\_Anderson](https://discuss.elastic.co/u/Erik_Anderson)\
**Post date:** [October 2, 2013, 7:16pm UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/1 "2013-10-02T19:16:36Z")

</div>

Hello all -

I have a single-node ES server at the moment, accepting messages from a  
single logstash instance, which in turn fetches messages from a redis  
broker.

We recently had a networking glitch that caused messages to queue up for a  
few days. I have logs flowing again now and LS/ES are slowly catching up.  
However, during this time, I've observed a peculiar CPU usage pattern  
caused by elasticsearch. LS/ES have been ingesting messages as fast as  
possible during this "catch up" period. During this time, this is what the  
CPU usage of our LS/ES node looked like:

[![](https://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png) ](https://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png)

That increased CPU usage is due to ES.

Upon initially seeing this increased CPU load, I expected to see  
corresponding iowait, but that is not the case.

What I've noticed is that near the peak of these spikes, message processing  
rates actually slow down to the point where it's actually slower than our  
systems are generating logs (which is quite slow at this point, something  
in the neighorhood of 5 messages/second.).

During times of very high message rates (such as when our system was  
catching up with a few day's queued logs), is there some sort of internal  
queueing mechanism that happens within Elasticsearch that may cause this?

Has anyone else seen CPU usage patterns like this?

Thank you!  
-Erik

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Erik\_Anderson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/erik_anderson/32/2045_2.png) [@Erik\_Anderson](https://discuss.elastic.co/u/Erik_Anderson)\
**Post date:** [October 4, 2013, 8:21pm UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/2 "2013-10-04T20:21:34Z")

</div>

Does anyone have a clue about this?

Since posting this message, I've upgraded from ES 0.90.1 to 0.90.5, and  
continue to see the same behavior.

Thank you!  
-Erik

On Wed, Oct 2, 2013 at 2:16 PM, Erik Anderson [erikerik@gmail.com](mailto:erikerik@gmail.com) wrote:

> Hello all -
> 
> I have a single-node ES server at the moment, accepting messages from a  
> single logstash instance, which in turn fetches messages from a redis  
> broker.
> 
> We recently had a networking glitch that caused messages to queue up for a  
> few days. I have logs flowing again now and LS/ES are slowly catching up.  
> However, during this time, I've observed a peculiar CPU usage pattern  
> caused by elasticsearch. LS/ES have been ingesting messages as fast as  
> possible during this "catch up" period. During this time, this is what the  
> CPU usage of our LS/ES node looked like:
> 
> [http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png](http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png)
> 
> That increased CPU usage is due to ES.
> 
> Upon initially seeing this increased CPU load, I expected to see  
> corresponding iowait, but that is not the case.
> 
> What I've noticed is that near the peak of these spikes, message  
> processing rates actually slow down to the point where it's actually slower  
> than our systems are generating logs (which is quite slow at this point,  
> something in the neighorhood of 5 messages/second.).
> 
> During times of very high message rates (such as when our system was  
> catching up with a few day's queued logs), is there some sort of internal  
> queueing mechanism that happens within Elasticsearch that may cause this?
> 
> Has anyone else seen CPU usage patterns like this?
> 
> Thank you!  
> -Erik
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [October 6, 2013, 5:09pm UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/3 "2013-10-06T17:09:34Z")

</div>

Hey,

I would be interested to see the nodes stats during such a high CPU time in  
order to find out, where the CPU spends its time at. Also you can maybe  
catch the hot\_threads output as well. Using the nodes stats you can  
actually get an indication, if the CPU time is spent for indexing, merging  
or other activities.

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

Hope this helps. Have you changed anything from the default configuration  
(throttling for example)?

--Alex

On Fri, Oct 4, 2013 at 10:21 PM, Erik Anderson [erikerik@gmail.com](mailto:erikerik@gmail.com) wrote:

> Does anyone have a clue about this?
> 
> Since posting this message, I've upgraded from ES 0.90.1 to 0.90.5, and  
> continue to see the same behavior.
> 
> Thank you!  
> -Erik
> 
> On Wed, Oct 2, 2013 at 2:16 PM, Erik Anderson [erikerik@gmail.com](mailto:erikerik@gmail.com) wrote:
> 
> > Hello all -
> > 
> > I have a single-node ES server at the moment, accepting messages from a  
> > single logstash instance, which in turn fetches messages from a redis  
> > broker.
> > 
> > We recently had a networking glitch that caused messages to queue up for  
> > a few days. I have logs flowing again now and LS/ES are slowly catching up.  
> > However, during this time, I've observed a peculiar CPU usage pattern  
> > caused by elasticsearch. LS/ES have been ingesting messages as fast as  
> > possible during this "catch up" period. During this time, this is what the  
> > CPU usage of our LS/ES node looked like:
> > 
> > [http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png](http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png)
> > 
> > That increased CPU usage is due to ES.
> > 
> > Upon initially seeing this increased CPU load, I expected to see  
> > corresponding iowait, but that is not the case.
> > 
> > What I've noticed is that near the peak of these spikes, message  
> > processing rates actually slow down to the point where it's actually slower  
> > than our systems are generating logs (which is quite slow at this point,  
> > something in the neighorhood of 5 messages/second.).
> > 
> > During times of very high message rates (such as when our system was  
> > catching up with a few day's queued logs), is there some sort of internal  
> > queueing mechanism that happens within Elasticsearch that may cause this?
> > 
> > Has anyone else seen CPU usage patterns like this?
> > 
> > Thank you!  
> > -Erik
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\
**Post date:** [October 15, 2013, 4:50am UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/4 "2013-10-15T04:50:44Z")

</div>

Hi Erik,

My first guess would be that this is caused by Lucene segment merging.

## Otis

ELASTICSEARCH Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html)  
Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html)

On Friday, October 4, 2013 4:21:34 PM UTC-4, Erik Anderson wrote:

> Does anyone have a clue about this?
> 
> Since posting this message, I've upgraded from ES 0.90.1 to 0.90.5, and  
> continue to see the same behavior.
> 
> Thank you!  
> -Erik
> 
> On Wed, Oct 2, 2013 at 2:16 PM, Erik Anderson \<[erik...@gmail.com](mailto:erik...@gmail.com)\<javascript:\>
> 
> > wrote:
> 
> > Hello all -
> > 
> > I have a single-node ES server at the moment, accepting messages from a  
> > single logstash instance, which in turn fetches messages from a redis  
> > broker.
> > 
> > We recently had a networking glitch that caused messages to queue up for  
> > a few days. I have logs flowing again now and LS/ES are slowly catching up.  
> > However, during this time, I've observed a peculiar CPU usage pattern  
> > caused by elasticsearch. LS/ES have been ingesting messages as fast as  
> > possible during this "catch up" period. During this time, this is what the  
> > CPU usage of our LS/ES node looked like:
> > 
> > [http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png](http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png)
> > 
> > That increased CPU usage is due to ES.
> > 
> > Upon initially seeing this increased CPU load, I expected to see  
> > corresponding iowait, but that is not the case.
> > 
> > What I've noticed is that near the peak of these spikes, message  
> > processing rates actually slow down to the point where it's actually slower  
> > than our systems are generating logs (which is quite slow at this point,  
> > something in the neighorhood of 5 messages/second.).
> > 
> > During times of very high message rates (such as when our system was  
> > catching up with a few day's queued logs), is there some sort of internal  
> > queueing mechanism that happens within Elasticsearch that may cause this?
> > 
> > Has anyone else seen CPU usage patterns like this?
> > 
> > Thank you!  
> > -Erik
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Erik\_Anderson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/erik_anderson/32/2045_2.png) [@Erik\_Anderson](https://discuss.elastic.co/u/Erik_Anderson)\
**Post date:** [October 17, 2013, 10:46pm UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/5 "2013-10-17T22:46:11Z")

</div>

Hi Alexander -

During times of high load, it looks like the largest slice of CPU is being  
dedicated to the Lucene Merge Thread.

Cluster node stats:

> <https://gist.github.com/anderiv/03d0688232fdac2f0433>

Hot Threads:

> <https://gist.github.com/anderiv/615b5f90a05efc15f298>

-Erik

On Sun, Oct 6, 2013 at 12:09 PM, Alexander Reelsen [alr@spinscale.de](mailto:alr@spinscale.de) wrote:

> Hey,
> 
> I would be interested to see the nodes stats during such a high CPU time  
> in order to find out, where the CPU spends its time at. Also you can maybe  
> catch the hot\_threads output as well. Using the nodes stats you can  
> actually get an indication, if the CPU time is spent for indexing, merging  
> or other activities.
> 
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-nodes-stats.html)
> 
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-nodes-hot-threads.html)
> 
> Hope this helps. Have you changed anything from the default configuration  
> (throttling for example)?
> 
> --Alex
> 
> On Fri, Oct 4, 2013 at 10:21 PM, Erik Anderson [erikerik@gmail.com](mailto:erikerik@gmail.com) wrote:
> 
> > Does anyone have a clue about this?
> > 
> > Since posting this message, I've upgraded from ES 0.90.1 to 0.90.5, and  
> > continue to see the same behavior.
> > 
> > Thank you!  
> > -Erik
> > 
> > On Wed, Oct 2, 2013 at 2:16 PM, Erik Anderson [erikerik@gmail.com](mailto:erikerik@gmail.com) wrote:
> > 
> > > Hello all -
> > > 
> > > I have a single-node ES server at the moment, accepting messages from a  
> > > single logstash instance, which in turn fetches messages from a redis  
> > > broker.
> > > 
> > > We recently had a networking glitch that caused messages to queue up for  
> > > a few days. I have logs flowing again now and LS/ES are slowly catching up.  
> > > However, during this time, I've observed a peculiar CPU usage pattern  
> > > caused by elasticsearch. LS/ES have been ingesting messages as fast as  
> > > possible during this "catch up" period. During this time, this is what the  
> > > CPU usage of our LS/ES node looked like:
> > > 
> > > [http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png](http://photos.smugmug.com/photos/i-PjvfrT5/0/O/i-PjvfrT5.png)
> > > 
> > > That increased CPU usage is due to ES.
> > > 
> > > Upon initially seeing this increased CPU load, I expected to see  
> > > corresponding iowait, but that is not the case.
> > > 
> > > What I've noticed is that near the peak of these spikes, message  
> > > processing rates actually slow down to the point where it's actually slower  
> > > than our systems are generating logs (which is quite slow at this point,  
> > > something in the neighorhood of 5 messages/second.).
> > > 
> > > During times of very high message rates (such as when our system was  
> > > catching up with a few day's queued logs), is there some sort of internal  
> > > queueing mechanism that happens within Elasticsearch that may cause this?
> > > 
> > > Has anyone else seen CPU usage patterns like this?
> > > 
> > > Thank you!  
> > > -Erik
> > > 
> > > --  
> > > You received this message because you are subscribed to the Google  
> > > Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it, send  
> > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Erik\_Anderson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/erik_anderson/32/2045_2.png) [@Erik\_Anderson](https://discuss.elastic.co/u/Erik_Anderson)\
**Post date:** [October 17, 2013, 10:47pm UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/6 "2013-10-17T22:47:27Z")

</div>

On Mon, Oct 14, 2013 at 11:50 PM, Otis Gospodnetic \<  
[otis.gospodnetic@gmail.com](mailto:otis.gospodnetic@gmail.com)\> wrote:

> My first guess would be that this is caused by Lucene segment merging.

Thanks, Otis - you were spot on with this. See my previous email to  
Alexsander from just a minute ago.

Now...to research what to do about it. 🙂

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![shadyabhi](https://avatars.discourse-cdn.com/v4/letter/s/edb3f5/32.png) [@shadyabhi](https://discuss.elastic.co/u/shadyabhi)\
**Post date:** [October 18, 2013, 3:18am UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/7 "2013-10-18T03:18:44Z")

</div>

Hi Erik,

If you update your documents or add new documents in a index, merging  
is bound to happen. There is nothing you can do about it, that's how  
lucene does it. You could try changing the merge policy

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

if you want to play around.

On Fri, Oct 18, 2013 at 4:17 AM, Erik Anderson [erikerik@gmail.com](mailto:erikerik@gmail.com) wrote:

> On Mon, Oct 14, 2013 at 11:50 PM, Otis Gospodnetic  
> [otis.gospodnetic@gmail.com](mailto:otis.gospodnetic@gmail.com) wrote:
> 
> > My first guess would be that this is caused by Lucene segment merging.
> 
> Thanks, Otis - you were spot on with this. See my previous email to  
> Alexsander from just a minute ago.
> 
> Now...to research what to do about it. 🙂
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
Regards,  
Abhijeet Rastogi (shadyabhi)

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\
**Post date:** [October 18, 2013, 4:44am UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/8 "2013-10-18T04:44:35Z")

</div>

Hi Erik,

You can throttle merges.  
[http://search-lucene.com/?q=throttle+merge&fc\_project=ElasticSearch](http://search-lucene.com/?q=throttle+merge&fc_project=ElasticSearch)

## Otis

ELASTICSEARCH Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/index.html)  
Search Analytics - [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html)

On Thursday, October 17, 2013 6:47:27 PM UTC-4, Erik Anderson wrote:

> On Mon, Oct 14, 2013 at 11:50 PM, Otis Gospodnetic \<[otis.gos...@gmail.com](mailto:otis.gos...@gmail.com)\<javascript:\>
> 
> > wrote:
> 
> > My first guess would be that this is caused by Lucene segment merging.
> 
> Thanks, Otis - you were spot on with this. See my previous email to  
> Alexsander from just a minute ago.
> 
> Now...to research what to do about it. 🙂

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Erik\_Anderson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/erik_anderson/32/2045_2.png) [@Erik\_Anderson](https://discuss.elastic.co/u/Erik_Anderson)\
**Post date:** [October 19, 2013, 5:18am UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/9 "2013-10-19T05:18:55Z")

</div>

Just to follow up on this - it turns out that the poor performance I was  
seeing actually had nothing to do with ES merging. Rather, it was due to  
the fact that I set flush\_size equal to 1 in the elasticsearch\_http  
logstash output plugin. I changed that to 200, and my indexing rates went  
from 15-20/second to nearly 500/second.

-Erik

On Thu, Oct 17, 2013 at 11:44 PM, Otis Gospodnetic \<  
[otis.gospodnetic@gmail.com](mailto:otis.gospodnetic@gmail.com)\> wrote:

> Hi Erik,
> 
> You can throttle merges.  
> [http://search-lucene.com/?q=throttle+merge&fc\_project=ElasticSearch](http://search-lucene.com/?q=throttle+merge&fc_project=ElasticSearch)
> 
> ## Otis
> 
> ELASTICSEARCH Performance Monitoring - [Sematext Monitoring | Infrastructure Monitoring Service](http://sematext.com/spm/)\*\*  
> index.html [http://sematext.com/spm/index.html](http://sematext.com/spm/index.html)  
> Search Analytics - [http://sematext.com/search-\*\*analytics/index.html](http://sematext.com/search-**analytics/index.html)[http://sematext.com/search-analytics/index.html](http://sematext.com/search-analytics/index.html)
> 
> On Thursday, October 17, 2013 6:47:27 PM UTC-4, Erik Anderson wrote:
> 
> > On Mon, Oct 14, 2013 at 11:50 PM, Otis Gospodnetic \<[otis.gos...@gmail.com](mailto:otis.gos...@gmail.com)
> > 
> > > wrote:
> > 
> > > My first guess would be that this is caused by Lucene segment merging.
> > 
> > Thanks, Otis - you were spot on with this. See my previous email to  
> > Alexsander from just a minute ago.
> > 
> > Now...to research what to do about it. 🙂
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:11am UTC](https://discuss.elastic.co/t/cyclical-es-cpu-usage/13829/10 "2017-07-06T02:11:40Z")

</div>


