# How to increase indexing speed after configuring routing on an index? **URL:** \ **Category:** Elasticsearch\ **Created:** [February 14, 2013, 7:53pm UTC](https://discuss.elastic.co/t/how-to-increase-indexing-speed-after-configuring-routing-on-an-index/10749 "2013-02-14T19:53:09Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![eldilibra](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eldilibra/32/2491_2.png) [@eldilibra](https://discuss.elastic.co/u/eldilibra)\ **Post date:** [February 14, 2013, 7:53pm UTC](https://discuss.elastic.co/t/how-to-increase-indexing-speed-after-configuring-routing-on-an-index/10749/1 "2013-02-14T19:53:09Z")
I have a cluster with 8 nodes, and an index with 8 shards and 2 replica. After using this setup in production for a few days, we had a huge traffic spike, and CPU increased dangerously for all nodes. We were not using custom routing yet, however, so once I used a field that most of the queries were targeting as the routing field, CPU went way down, since the nodes weren't chattering as much, I think. Shortly after making this change, we realized that indexing a single document was taking a full 60 seconds. I understand that the node which holds the shard that stores a bunch of documents with the same value in their routing field will get "hot", but is this really going to make indexing that slow? If so, is their any setting or configuration within the cluster I can change in order to speed things up? Any help is appreciated, and I'm happy to answer any questions about our configuration. ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [February 14, 2013, 9:26pm UTC](https://discuss.elastic.co/t/how-to-increase-indexing-speed-after-configuring-routing-on-an-index/10749/2 "2013-02-14T21:26:58Z")
Did you notice anything in the logs? Exceptions? From what it seems, your cluster ran into a critical low memory condition, and could not continue. So, operations tend to receive timeouts. In such cases, I restart nodes. Be sure to take precautions that you won't get hit again by huge traffic (this is usually a traffic shaping thing outside the scope of Elasticsearch) Best regards, Jörg Am 14.02.13 20:53, schrieb eldilibra: > I have a cluster with 8 nodes, and an index with 8 shards and 2 replica. > After using this setup in production for a few days, we had a huge traffic > spike, and CPU increased dangerously for all nodes. We were not using custom > routing yet, however, so once I used a field that most of the queries were > targeting as the routing field, CPU went way down, since the nodes weren't > chattering as much, I think. Shortly after making this change, we realized > that indexing a single document was taking a full 60 seconds. I understand > that the node which holds the shard that stores a bunch of documents with > the same value in their routing field will get "hot", but is this really > going to make indexing that slow? If so, is their any setting or > configuration within the cluster I can change in order to speed things up? > Any help is appreciated, and I'm happy to answer any questions about our > configuration. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![eldilibra](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eldilibra/32/2491_2.png) [@eldilibra](https://discuss.elastic.co/u/eldilibra)\ **Post date:** [February 14, 2013, 9:55pm UTC](https://discuss.elastic.co/t/how-to-increase-indexing-speed-after-configuring-routing-on-an-index/10749/3 "2013-02-14T21:55:16Z")
Thanks for your response Jörg! We actually had to create an entirely new cluster, since the traffic spike ultimately led to us losing data (our fault), so the logs aren't very helpful in this case. Right now, I'm seeing no errors related to indexing in any of the nodes' logs. However, I've restarted a few suspicious nodes, and things are humming along nicely :~). ## Cheers, L.D Libra Sent with Sparrow ([http://www.sparrowmailapp.com/?sig](http://www.sparrowmailapp.com/?sig)) On Thursday, February 14, 2013 at 4:27 PM, Jörg Prante [via Elasticsearch Users] wrote: > Did you notice anything in the logs? Exceptions? > > From what it seems, your cluster ran into a critical low memory > condition, and could not continue. So, operations tend to receive > timeouts. > > In such cases, I restart nodes. Be sure to take precautions that you > won't get hit again by huge traffic (this is usually a traffic shaping > thing outside the scope of Elasticsearch) > > Best regards, > > Jörg > > Am 14.02.13 20:53, schrieb eldilibra: > > > I have a cluster with 8 nodes, and an index with 8 shards and 2 replica. > > After using this setup in production for a few days, we had a huge traffic > > spike, and CPU increased dangerously for all nodes. We were not using custom > > routing yet, however, so once I used a field that most of the queries were > > targeting as the routing field, CPU went way down, since the nodes weren't > > chattering as much, I think. Shortly after making this change, we realized > > that indexing a single document was taking a full 60 seconds. I understand > > that the node which holds the shard that stores a bunch of documents with > > the same value in their routing field will get "hot", but is this really > > going to make indexing that slow? If so, is their any setting or > > configuration within the cluster I can change in order to speed things up? > > Any help is appreciated, and I'm happy to answer any questions about our > > configuration. > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email] (/user/SendEmail.jtp?type=node&node=4029848&i=0). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > If you reply to this email, your message will be added to the discussion below: [http://elasticsearch-users.115913.n3.nabble.com/How-to-increase-indexing-speed-after-configuring-routing-on-an-index-tp4029846p4029848.html](http://elasticsearch-users.115913.n3.nabble.com/How-to-increase-indexing-speed-after-configuring-routing-on-an-index-tp4029846p4029848.html) > To unsubscribe from How to increase indexing speed after configuring routing on an index?, click here ([http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe\_by\_code&node=4029846&code=ZWxkaWxpYnJhQGdtYWlsLmNvbXw0MDI5ODQ2fC0xNzM3MjUxMjI5](http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4029846&code=ZWxkaWxpYnJhQGdtYWlsLmNvbXw0MDI5ODQ2fC0xNzM3MjUxMjI5)). > NAML ([http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=macro\_viewer&id=instant\_html!nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify\_subscribers!nabble%3Aemail.naml-instant\_emails!nabble%3Aemail.naml-send\_instant\_email!nabble%3Aemail.naml](http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml)) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:51am UTC](https://discuss.elastic.co/t/how-to-increase-indexing-speed-after-configuring-routing-on-an-index/10749/4 "2017-07-06T02:51:23Z")