# Everything just slows down simetimes **URL:** \ **Category:** Elasticsearch\ **Created:** [February 5, 2014, 6:28pm UTC](https://discuss.elastic.co/t/everything-just-slows-down-simetimes/15626 "2014-02-05T18:28:28Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\ **Post date:** [February 5, 2014, 6:28pm UTC](https://discuss.elastic.co/t/everything-just-slows-down-simetimes/15626/1 "2014-02-05T18:28:28Z")
I've seen a few cases of "everything" slow down. Like this: [image: Elasticsearch cluster eqiad es\_query\_time] I mean, we don't have the most even service times at the moment, but woah! I don't see anything in Elasticsearch's primary logs. The slow logs abound. They show that things that should have taken a handful of milliseconds spike to ~8 seconds. Whatever causes it just stops after a minute or so and we get back to normal service times. It looks like most of the disruption was mostly to one index but the extra load slowed down other unrelated requests. I think. I've tried to tie this to other things. It doesn't look like it corresponds to a merge or a recovering shard or anything. Any ideas what this is? Any ideas of what to turn up in the log file to find out more? Nik -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3\_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Randall\_McRee](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/randall_mcree/32/47177_2.png) [@Randall\_McRee](https://discuss.elastic.co/u/Randall_McRee)\ **Post date:** [February 5, 2014, 6:45pm UTC](https://discuss.elastic.co/t/everything-just-slows-down-simetimes/15626/2 "2014-02-05T18:45:49Z")
The two candidates are merges and full GCs. Make sure you are monitoring both of those. On Wed, Feb 5, 2014 at 10:28 AM, Nikolas Everett [nik9000@gmail.com](mailto:nik9000@gmail.com) wrote: > I've seen a few cases of "everything" slow down. Like this: > [image: Elasticsearch cluster eqiad es\_query\_time] > I mean, we don't have the most even service times at the moment, but > woah! I don't see anything in Elasticsearch's primary logs. The slow logs > abound. They show that things that should have taken a handful of > milliseconds spike to ~8 seconds. Whatever causes it just stops after a > minute or so and we get back to normal service times. > > It looks like most of the disruption was mostly to one index but the extra > load slowed down other unrelated requests. I think. I've tried to tie > this to other things. It doesn't look like it corresponds to a merge or a > recovering shard or anything. > > Any ideas what this is? Any ideas of what to turn up in the log file to > find out more? > > Nik > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3\_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com) > . > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAFjHw34U4T9bGQ1eRMzB1-oxj7AhhrR9dRbp1-yNZofFTy3Zgw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAFjHw34U4T9bGQ1eRMzB1-oxj7AhhrR9dRbp1-yNZofFTy3Zgw%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\ **Post date:** [February 5, 2014, 7:18pm UTC](https://discuss.elastic.co/t/everything-just-slows-down-simetimes/15626/3 "2014-02-05T19:18:47Z")
Those were the first two I looked for and neither lined up. Also, my image seems to have scrolled. I didn't really think about that part when I pasted it into the email ;( Nik On Wed, Feb 5, 2014 at 1:45 PM, Randall McRee [randall.mcree@gmail.com](mailto:randall.mcree@gmail.com)wrote: > The two candidates are merges and full GCs. Make sure you are monitoring > both of those. > > On Wed, Feb 5, 2014 at 10:28 AM, Nikolas Everett [nik9000@gmail.com](mailto:nik9000@gmail.com)wrote: > > > I've seen a few cases of "everything" slow down. Like this: > > [image: Elasticsearch cluster eqiad es\_query\_time] > > I mean, we don't have the most even service times at the moment, but > > woah! I don't see anything in Elasticsearch's primary logs. The slow logs > > abound. They show that things that should have taken a handful of > > milliseconds spike to ~8 seconds. Whatever causes it just stops after a > > minute or so and we get back to normal service times. > > > > It looks like most of the disruption was mostly to one index but the > > extra load slowed down other unrelated requests. I think. I've tried to > > tie this to other things. It doesn't look like it corresponds to a merge > > or a recovering shard or anything. > > > > Any ideas what this is? Any ideas of what to turn up in the log file to > > find out more? > > > > Nik > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3\_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com) > > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAFjHw34U4T9bGQ1eRMzB1-oxj7AhhrR9dRbp1-yNZofFTy3Zgw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAFjHw34U4T9bGQ1eRMzB1-oxj7AhhrR9dRbp1-yNZofFTy3Zgw%40mail.gmail.com) > . > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd16pXWuLoEOPqce5j8gX7dSctrxXW1n0rKKPM%3DfHPb3mA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd16pXWuLoEOPqce5j8gX7dSctrxXW1n0rKKPM%3DfHPb3mA%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [February 5, 2014, 10:35pm UTC](https://discuss.elastic.co/t/everything-just-slows-down-simetimes/15626/4 "2014-02-05T22:35:57Z")
Take a look at the ElasticHQ, kopf and bigdesk plugins, they will provide some more stats but also frame them relative to other operations that are happening on the cluster/node. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com) web: [www.campaignmonitor.com](http://www.campaignmonitor.com) On 6 February 2014 06:18, Nikolas Everett [nik9000@gmail.com](mailto:nik9000@gmail.com) wrote: > Those were the first two I looked for and neither lined up. Also, my > image seems to have scrolled. I didn't really think about that part when I > pasted it into the email ;( > > Nik > > On Wed, Feb 5, 2014 at 1:45 PM, Randall McRee [randall.mcree@gmail.com](mailto:randall.mcree@gmail.com)wrote: > > > The two candidates are merges and full GCs. Make sure you are monitoring > > both of those. > > > > On Wed, Feb 5, 2014 at 10:28 AM, Nikolas Everett [nik9000@gmail.com](mailto:nik9000@gmail.com)wrote: > > > > > I've seen a few cases of "everything" slow down. Like this: > > > [image: Elasticsearch cluster eqiad es\_query\_time] > > > I mean, we don't have the most even service times at the moment, but > > > woah! I don't see anything in Elasticsearch's primary logs. The slow logs > > > abound. They show that things that should have taken a handful of > > > milliseconds spike to ~8 seconds. Whatever causes it just stops after a > > > minute or so and we get back to normal service times. > > > > > > It looks like most of the disruption was mostly to one index but the > > > extra load slowed down other unrelated requests. I think. I've tried to > > > tie this to other things. It doesn't look like it corresponds to a merge > > > or a recovering shard or anything. > > > > > > Any ideas what this is? Any ideas of what to turn up in the log file to > > > find out more? > > > > > > Nik > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3\_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3iwAEOQnXOxDk3_SB7xPQOig0rDRVHSwoJ47syDvAOfQ%40mail.gmail.com) > > > . > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CAFjHw34U4T9bGQ1eRMzB1-oxj7AhhrR9dRbp1-yNZofFTy3Zgw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAFjHw34U4T9bGQ1eRMzB1-oxj7AhhrR9dRbp1-yNZofFTy3Zgw%40mail.gmail.com) > > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd16pXWuLoEOPqce5j8gX7dSctrxXW1n0rKKPM%3DfHPb3mA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd16pXWuLoEOPqce5j8gX7dSctrxXW1n0rKKPM%3DfHPb3mA%40mail.gmail.com) > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624ZArhW4VVQMM0areaUT-8-ZxUBr2CEv%3DHhqs-px%3D-36kw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624ZArhW4VVQMM0areaUT-8-ZxUBr2CEv%3DHhqs-px%3D-36kw%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:52am UTC](https://discuss.elastic.co/t/everything-just-slows-down-simetimes/15626/5 "2017-07-06T01:52:15Z")