# Rails - tire - elasticsearch : need to restart elasticsearch server **URL:** \ **Category:** Elasticsearch\ **Created:** [June 27, 2013, 1:37pm UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561 "2013-06-27T13:37:18Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![oto\_iashvili](https://avatars.discourse-cdn.com/v4/letter/o/7ba0ec/32.png) [@oto\_iashvili](https://discuss.elastic.co/u/oto_iashvili)\ **Post date:** [June 27, 2013, 1:37pm UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/1 "2013-06-27T13:37:18Z")
HI I use rails - tire - elasticsearch, everythink is mainly working very well, but just from time to time, my server start to be very slow. So I have to restart elasticsearch service and then everything go fine again. [image: graph from newrelic] I have impression that it happens after bulk inserts (around 6000 products). Can it be linked ? Inserts last like 2min max, but still after server has problem. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![oto\_iashvili](https://avatars.discourse-cdn.com/v4/letter/o/7ba0ec/32.png) [@oto\_iashvili](https://discuss.elastic.co/u/oto_iashvili)\ **Post date:** [June 29, 2013, 12:30am UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/2 "2013-06-29T00:30:42Z")
finally it is not linked to bulk inserts i have only this line in log [2013-06-29 01:15:32,767][WARN][monitor.jvm] [Jon Spectre] [gc][ParNew][26438][9941] duration [3.4s], collections [1]/[5.2s], total [3.4s]/[57.7s], memory [951.6mb]-\>[713.7mb]/[989.8mb], all\_pools {[Code Cache] [10.6mb]-\>[10.6mb]/[48mb]}{[Par Eden Space] [241.1mb]-\>[31mb]/[273mb]}{[Par Survivor Space] [32.2mb]-\>[0b]/[34.1mb]}{[CMS Old Gen] [678.3mb]-\>[682.6mb]/[682.6mb]}{[CMS Perm Gen] [35mb]-\>[35mb]/[166mb]} Does someone understand this ? thanks On Thursday, June 27, 2013 3:37:18 PM UTC+2, oto iashvili wrote: > HI > > I use rails - tire - elasticsearch, everythink is mainly working very > well, but just from time to time, my server start to be very slow. So I > have to restart elasticsearch service and then everything go fine again. > > [image: graph from newrelic] > > I have impression that it happens after bulk inserts (around 6000 > products). Can it be linked ? Inserts last like 2min max, but still after > server has problem. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [June 29, 2013, 7:13am UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/3 "2013-06-29T07:13:40Z")
Are you using default memory settings? Is it a production server? Do you have many users searching on it? Do you use facets or sort? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 29 juin 2013 à 02:30, oto iashvili [optimum.dulopin@laposte.net](mailto:optimum.dulopin@laposte.net) a écrit : finally it is not linked to bulk inserts i have only this line in log [2013-06-29 01:15:32,767][WARN][monitor.jvm] [Jon Spectre] [gc][ParNew][26438][9941] duration [3.4s], collections [1]/[5.2s], total [3.4s]/[57.7s], memory [951.6mb]-\>[713.7mb]/[989.8mb], all\_pools {[Code Cache] [10.6mb]-\>[10.6mb]/[48mb]}{[Par Eden Space] [241.1mb]-\>[31mb]/[273mb]}{[Par Survivor Space] [32.2mb]-\>[0b]/[34.1mb]}{[CMS Old Gen] [678.3mb]-\>[682.6mb]/[682.6mb]}{[CMS Perm Gen] [35mb]-\>[35mb]/[166mb]} Does someone understand this ? thanks On Thursday, June 27, 2013 3:37:18 PM UTC+2, oto iashvili wrote: > HI > > I use rails - tire - elasticsearch, everythink is mainly working very well, but just from time to time, my server start to be very slow. So I have to restart elasticsearch service and then everything go fine again. > > I have impression that it happens after bulk inserts (around 6000 products). Can it be linked ? Inserts last like 2min max, but still after server has problem. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![oto\_iashvili](https://avatars.discourse-cdn.com/v4/letter/o/7ba0ec/32.png) [@oto\_iashvili](https://discuss.elastic.co/u/oto_iashvili)\ **Post date:** [June 29, 2013, 11:33am UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/4 "2013-06-29T11:33:48Z")
Hi, thanks for answer Im really new to elasticsearch, so Im not really sure what u mean by "default memory settings" here my \_cluster/nodes/?jvm {"ok":true,"cluster\_name":"elasticsearch","nodes":{"c9VvXkUfQ7qze\_jWp-dPwg":{"name":"Airborne","transport\_address":"inet[/xx.xx.xx.xx:9300]","hostname":"xxxxxxx","version":"0.90.0","http\_address":"inet[/xx.xx.xx.xx:9200]","jvm":{"pid":12331,"version":"1.7.0\_21","vm\_name":"OpenJDK 64-Bit Server VM","vm\_version":"23.7-b01","vm\_vendor":"Oracle Corporation","start\_time":1372496399939,"mem":{"heap\_init":"1gb","heap\_init\_in\_bytes":1073741824,"heap\_max":"989.8mb","heap\_max\_in\_bytes":1037959168,"non\_heap\_init":"23.1mb","non\_heap\_init\_in\_bytes":24313856,"non\_heap\_max":"214mb","non\_heap\_max\_in\_bytes":224395264,"direct\_max":"989.8mb","direct\_max\_in\_bytes":1037959168}}}}} and my \_cluster/nodes/?process {"ok":true,"cluster\_name":"elasticsearch","nodes":{"c9VvXkUfQ7qze\_jWp-dPwg":{"name":"Airborne","transport\_address":"inet[/xx.xx.xx.xx:9300]","hostname":"xxxxxx","version":"0.90.0","http\_address":"inet[/xx.xx.xx.xx:9200]","process":{"refresh\_interval":1000,"id":12331,"max\_file\_descriptors":65535}}}} yes it is in production server. Depends what u call "many users". According to newrelic, I have around 1000 requests per minutes, 2/3 are for search. I dont use facet yet. I plan it for later. I use sort by "date, id" or "price, date". thanks again for your help On Saturday, June 29, 2013 9:13:40 AM UTC+2, David Pilato wrote: > Are you using default memory settings? > Is it a production server? > Do you have many users searching on it? Do you use facets or sort? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 29 juin 2013 à 02:30, oto iashvili \<[optimum...@laposte.net](mailto:optimum...@laposte.net)\\> > a écrit : > > finally it is not linked to bulk inserts > > i have only this line in log > [2013-06-29 01:15:32,767][WARN][monitor.jvm] [Jon Spectre] > [gc][ParNew][26438][9941] duration [3.4s], collections [1]/[5.2s], total > [3.4s]/[57.7s], memory [951.6mb]-\>[713.7mb]/[989.8mb], all\_pools {[Code > Cache] [10.6mb]-\>[10.6mb]/[48mb]}{[Par Eden Space] > [241.1mb]-\>[31mb]/[273mb]}{[Par Survivor Space] > [32.2mb]-\>[0b]/[34.1mb]}{[CMS Old Gen] [678.3mb]-\>[682.6mb]/[682.6mb]}{[CMS > Perm Gen] [35mb]-\>[35mb]/[166mb]} > > Does someone understand this ? > > thanks > > On Thursday, June 27, 2013 3:37:18 PM UTC+2, oto iashvili wrote: > > > HI > > > > I use rails - tire - elasticsearch, everythink is mainly working very > > well, but just from time to time, my server start to be very slow. So I > > have to restart elasticsearch service and then everything go fine again. > > > > [image: graph from newrelic] > > > > I have impression that it happens after bulk inserts (around 6000 > > products). Can it be linked ? Inserts last like 2min max, but still after > > server has problem. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![oto\_iashvili](https://avatars.discourse-cdn.com/v4/letter/o/7ba0ec/32.png) [@oto\_iashvili](https://discuss.elastic.co/u/oto_iashvili)\ **Post date:** [June 30, 2013, 11:27am UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/5 "2013-06-30T11:27:56Z")
Hi, I answered u, but someone delete my post "This message has been deleted.". I dont understant why ? so i will answer again : I not expert in in rails so Im not sure what u are calling "default memory settings" here my index?jvm "mem":{"heap\_init":"1gb","heap\_init\_in\_bytes":1073741824,"heap\_max":"989.8mb","heap\_max\_in\_bytes":1037959168,"non\_heap\_init":"23.1mb","non\_heap\_init\_in\_bytes":24313856,"non\_heap\_max":"214mb","non\_heap\_max\_in\_bytes":224395264,"direct\_max":"989.8mb","direct\_max\_in\_bytes":1037959168 and here my index?process "process":{"refresh\_interval":1000,"id":12331,"max\_file\_descriptors":65535 Yes it is a production server According to newrelic I have around 1000 requests per minute, 2/3 are for searching. I dont use facet, but I use sort by [date, id] or [price, id] thanks for your help On Saturday, June 29, 2013 9:13:40 AM UTC+2, David Pilato wrote: > Are you using default memory settings? > Is it a production server? > Do you have many users searching on it? Do you use facets or sort? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 29 juin 2013 à 02:30, oto iashvili \<[optimum...@laposte.net](mailto:optimum...@laposte.net)\\> > a écrit : > > finally it is not linked to bulk inserts > > i have only this line in log > [2013-06-29 01:15:32,767][WARN][monitor.jvm] [Jon Spectre] > [gc][ParNew][26438][9941] duration [3.4s], collections [1]/[5.2s], total > [3.4s]/[57.7s], memory [951.6mb]-\>[713.7mb]/[989.8mb], all\_pools {[Code > Cache] [10.6mb]-\>[10.6mb]/[48mb]}{[Par Eden Space] > [241.1mb]-\>[31mb]/[273mb]}{[Par Survivor Space] > [32.2mb]-\>[0b]/[34.1mb]}{[CMS Old Gen] [678.3mb]-\>[682.6mb]/[682.6mb]}{[CMS > Perm Gen] [35mb]-\>[35mb]/[166mb]} > > Does someone understand this ? > > thanks > > On Thursday, June 27, 2013 3:37:18 PM UTC+2, oto iashvili wrote: > > > HI > > > > I use rails - tire - elasticsearch, everythink is mainly working very > > well, but just from time to time, my server start to be very slow. So I > > have to restart elasticsearch service and then everything go fine again. > > > > [image: graph from newrelic] > > > > I have impression that it happens after bulk inserts (around 6000 > > products). Can it be linked ? Inserts last like 2min max, but still after > > server has problem. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [July 1, 2013, 7:18am UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/6 "2013-07-01T07:18:27Z")
So you need probably to give more memory to your elasticsearch instance. How many docs do you have in total? Sorting and facetting use memory. If you have many concurrent users, that means that elasticsearch has to load many data in memory to serve the search. How much physical memory do you have on your instance? Consider giving half of it to Elasticsearch and the rest for the OS. ## HTH David Pilato | Technical Advocate | [Elasticsearch.com](http://Elasticsearch.com) @dadoonet | @elasticsearchfr | @scrutmydocs Le 30 juin 2013 à 13:27, oto iashvili [optimum.dulopin@laposte.net](mailto:optimum.dulopin@laposte.net) a écrit : > Hi, > > I answered u, but someone delete my post "This message has been deleted.". I dont understant why ? > > so i will answer again : > I not expert in in rails so Im not sure what u are calling "default memory settings" > here my index?jvm > "mem":{"heap\_init":"1gb","heap\_init\_in\_bytes":1073741824,"heap\_max":"989.8mb","heap\_max\_in\_bytes":1037959168,"non\_heap\_init":"23.1mb","non\_heap\_init\_in\_bytes":24313856,"non\_heap\_max":"214mb","non\_heap\_max\_in\_bytes":224395264,"direct\_max":"989.8mb","direct\_max\_in\_bytes":1037959168 > > and here my index?process > "process":{"refresh\_interval":1000,"id":12331,"max\_file\_descriptors":65535 > > Yes it is a production server > > According to newrelic I have around 1000 requests per minute, 2/3 are for searching. I dont use facet, but I use sort by [date, id] or [price, id] > > thanks for your help > > On Saturday, June 29, 2013 9:13:40 AM UTC+2, David Pilato wrote: > Are you using default memory settings? > Is it a production server? > Do you have many users searching on it? Do you use facets or sort? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 29 juin 2013 à 02:30, oto iashvili [optimum...@laposte.net](mailto:optimum...@laposte.net) a écrit : > > finally it is not linked to bulk inserts > > i have only this line in log > [2013-06-29 01:15:32,767][WARN][monitor.jvm] [Jon Spectre] [gc][ParNew][26438][9941] duration [3.4s], collections [1]/[5.2s], total [3.4s]/[57.7s], memory [951.6mb]-\>[713.7mb]/[989.8mb], all\_pools {[Code Cache] [10.6mb]-\>[10.6mb]/[48mb]}{[Par Eden Space] [241.1mb]-\>[31mb]/[273mb]}{[Par Survivor Space] [32.2mb]-\>[0b]/[34.1mb]}{[CMS Old Gen] [678.3mb]-\>[682.6mb]/[682.6mb]}{[CMS Perm Gen] [35mb]-\>[35mb]/[166mb]} > > Does someone understand this ? > > thanks > > On Thursday, June 27, 2013 3:37:18 PM UTC+2, oto iashvili wrote: > HI > > I use rails - tire - elasticsearch, everythink is mainly working very well, but just from time to time, my server start to be very slow. So I have to restart elasticsearch service and then everything go fine again. > > I have impression that it happens after bulk inserts (around 6000 products). Can it be linked ? Inserts last like 2min max, but still after server has problem. > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![oto\_iashvili](https://avatars.discourse-cdn.com/v4/letter/o/7ba0ec/32.png) [@oto\_iashvili](https://discuss.elastic.co/u/oto_iashvili)\ **Post date:** [July 5, 2013, 11:56pm UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/7 "2013-07-05T23:56:50Z")
hi, thanks for advices. I have 64go of ram. I give 1Go to elasticsearch heap size as it is saying this is maximum. anyway, i found out that problem was raise when users where putting to big number, as rails converts this to "Infinity", elasticsearch was raising error. But I dont understand why when such error occurs, why elasticsearch is using all ressources instead of just letting go. On Monday, July 1, 2013 9:18:27 AM UTC+2, David Pilato wrote: > So you need probably to give more memory to your elasticsearch instance. > How many docs do you have in total? > > Sorting and facetting use memory. If you have many concurrent users, that > means that elasticsearch has to load many data in memory to serve the > search. > > How much physical memory do you have on your instance? Consider giving > half of it to Elasticsearch and the rest for the OS. > > ## HTH > > _David Pilato_ | _Technical Advocate_ | _[Elasticsearch.com](http://Elasticsearch.com)_ > @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr[https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) > | @scrutmydocs [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > > Le 30 juin 2013 à 13:27, oto iashvili \<[optimum...@laposte.net](mailto:optimum...@laposte.net)\\> > a écrit : > > Hi, > > I answered u, but someone delete my post "This message has been deleted.". > I dont understant why ? > > so i will answer again : > I not expert in in rails so Im not sure what u are calling "default memory > settings" > here my index?jvm > > "mem":{"heap\_init":"1gb","heap\_init\_in\_bytes":1073741824,"heap\_max":"989.8mb","heap\_max\_in\_bytes":1037959168,"non\_heap\_init":"23.1mb","non\_heap\_init\_in\_bytes":24313856,"non\_heap\_max":"214mb","non\_heap\_max\_in\_bytes":224395264,"direct\_max":"989.8mb","direct\_max\_in\_bytes":1037959168 > > and here my index?process > "process":{"refresh\_interval":1000,"id":12331,"max\_file\_descriptors":65535 > > Yes it is a production server > > According to newrelic I have around 1000 requests per minute, 2/3 are for > searching. I dont use facet, but I use sort by [date, id] or [price, id] > > thanks for your help > > On Saturday, June 29, 2013 9:13:40 AM UTC+2, David Pilato wrote: > > > Are you using default memory settings? > > Is it a production server? > > Do you have many users searching on it? Do you use facets or sort? > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 29 juin 2013 à 02:30, oto iashvili [optimum...@laposte.net](mailto:optimum...@laposte.net) a écrit : > > > > finally it is not linked to bulk inserts > > > > i have only this line in log > > [2013-06-29 01:15:32,767][WARN][monitor.jvm] [Jon Spectre] > > [gc][ParNew][26438][9941] duration [3.4s], collections [1]/[5.2s], total > > [3.4s]/[57.7s], memory [951.6mb]-\>[713.7mb]/[989.8mb], all\_pools {[Code > > Cache] [10.6mb]-\>[10.6mb]/[48mb]}{[Par Eden Space] > > [241.1mb]-\>[31mb]/[273mb]}{[Par Survivor Space] > > [32.2mb]-\>[0b]/[34.1mb]}{[CMS Old Gen] [678.3mb]-\>[682.6mb]/[682.6mb]}{[CMS > > Perm Gen] [35mb]-\>[35mb]/[166mb]} > > > > Does someone understand this ? > > > > thanks > > > > On Thursday, June 27, 2013 3:37:18 PM UTC+2, oto iashvili wrote: > > > > > HI > > > > > > I use rails - tire - elasticsearch, everythink is mainly working very > > > well, but just from time to time, my server start to be very slow. So I > > > have to restart elasticsearch service and then everything go fine again. > > > > > > [image: graph from newrelic] > > > > > > I have impression that it happens after bulk inserts (around 6000 > > > products). Can it be linked ? Inserts last like 2min max, but still after > > > server has problem. > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:27am UTC](https://discuss.elastic.co/t/rails-tire-elasticsearch-need-to-restart-elasticsearch-server/12561/8 "2017-07-06T02:27:54Z")