We actually did not see any memory issues till now on our installations.
So could you please set the log level to debug and send the logs after forcing the memory error.
Hi,
I tried to use the elasticsearch-inout plug in for export. It worked fine. Now when i try to import it - it fails with
local@pldsvv-07:/var/elasticsearch/elasticsearch-0.90.3/bin$ curl -X POST 'http://localhost:9200/abc_newindex/abc/_import' -d '{
"directory": "/tmp/es-data",
"compression": "gzip"
}
'
[2013-08-30 18:02:08,818][INFO ][cluster.metadata ] [Eric] [abc_newindex] creating index, cause [auto(bulk api)], shards [5]/[1], mappings
[2013-08-30 18:02:20,943][WARN ][index.engine.robin ] [Eric] [abc_newindex][0] failed engine
[2013-08-30 18:02:21,227][DEBUG][action.bulk ] [Eric] [abc_newindex][0], node[wHAaefkjSre_x6Lj8XS_6A], [P], s[STARTED]: Failed to execute [org.elasticsearch.action.bulk.BulkShardRequest@591bc6d9]
java.lang.OutOfMemoryError: Java heap space
{"imports":,"failures":[{"node_id":"Iow0kmoGRwOLSqZ5jEivAQ","reason":"org.elasticsearch.action.FailedNodeException: Failed node [Iow0kmoGRwOLSqZ5jEivAQ]; org.elasticsearch.transport.RemoteTransportException: [Druig][inet[/10.3.176.23:9300]][el-crate-import/n]; org.elasticsearch.transport.ActionNotFoundTransportException: No handler for action [el-crate-import/n]"},{"node_id":"wHAaefkjSre_x6Lj8XS_6A","reason":"org.elasticsearch.action.FailedNodeException: Failed node [wHAaefkjSre_x6Lj8XS_6A]; java.lang.OutOfMemoryError: Java heap space"}]}local@pldsvv-07:/var/elasticsearch/elasticsearch-0.90.3/bin$ Exception in thread "elasticsearch[Eric][bulk][T#2]" java.lang.OutOfMemoryError: Java heap space
[2013-08-30 18:02:24,845][WARN ][index.engine.robin ] [Eric] [abc_newindex][0] failed engine
Any idea what is wrong? I can increase the heap size but not sure of when i will see the error again since i have limited RAM on the box.
On Fri, Aug 30, 2013 at 12:13 PM, parul patel parulpatel25@gmail.com wrote:
hey guys,
sorry false alarm. i needed to restart Elasticsearch after the plug in was installed.
now it is working.
thanks a lot for the help. and sorry about my mistake.
On Fri, Aug 30, 2013 at 12:06 PM, parul patel parulpatel25@gmail.com wrote:
Thanks.
I installed it like this, it looked successful. but i don't know how to make it detect by ES.
ocal@pldsvv-07:/var/elasticsearch/elasticsearch-0.90.3/bin/elasticsearch-inout-plugin-master$ sudo ../plugin -i elasticsearch-inout-plugin -url file:///$PWD/target/elasticsearch-inout-plugin-0.5.0.jar
-> Installing elasticsearch-inout-plugin...
Trying file:////var/elasticsearch/elasticsearch-0.90.3/bin/elasticsearch-inout-plugin-master/target/elasticsearch-inout-plugin-0.5.0.jar...
Downloading ..DONE
Installed elasticsearch-inout-plugin into /var/elasticsearch/elasticsearch-0.90.3/plugins/elasticsearch-inout-plugin
local@pldsvv-07:/var/elasticsearch/elasticsearch-0.90.3/bin/elasticsearch-inout-plugin-master$
On Fri, Aug 30, 2013 at 11:58 AM, David Pilato david@pilato.fr wrote:
Your plugin is not installed nor detected by elasticsearch.
HTH
--
David 
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 30 août 2013 à 17:51, parul patel parulpatel25@gmail.com a écrit :
Hi bernd,
when i try to use the plug in for export it gives me the following issue, any idea what am i missing?
local@:/var/elasticsearch/elasticsearch-0.90.3/bin$
curl -X POST 'http://localhost:9200/_reindex'
{"error":"InvalidIndexNameException[[_reindex] Invalid index name [reindex], must not start with '']","status":400}
local@:/var/elasticsearch/elasticsearch-0.90.3/bin$
curl -X POST 'http://localhost:9200/abc/_export' -d '{
"fields": ["_id", "_source", "_version", "_index", "_type"],
"output_file": "/tmp/es-data/dump-abc-${shard}.gz",
"compression": "gzip"
}
'
{"error":"InvalidTypeNameException[mapping type name [export] can't start with '']","status":400}
advance thanks for the help
On Thu, Aug 1, 2013 at 10:10 AM, pranav amin parulpatel25@gmail.com wrote:
Thank br Bernd.
Much appreciated. I will play around with this tool and let you know if i come across any questions.
Thanks again.
If you have time and have used any Monitoring tools for ES which you would recommend, please let me know. I had played around with some and mentioned below.
Thanks again
Pranav.
On Thursday, August 1, 2013 12:57:23 AM UTC-4, dobe wrote:
Hi Pranav
You might want to take a look at GitHub - crate/elasticsearch-inout-plugin: An Elasticsearch plugin which provides the ability to export data by query on server side. we use it for backup restore. The plugin allows you to export/import json data distributed - without having to download the data to the client. However there is no UI for this plugin.
br Bernd
On Wednesday, July 31, 2013 4:50:56 PM UTC+2, pranav amin wrote:
Hi There,
I'm a new user for Elastic search and plan to use it in Production environment.
Can you please help me with some information -
Monitoring tools -
I looked at the following.
a) Elasticsearch head
b) Bigdesk
c) Paramedic
d) ElasticHQ
Not sure which of the above are free and recommend by others?
Backup & Restore -
a) Can i do backup and restore of a Node in a Cluster? Are there any free/cost based tools (UI or Script based) that can do this and are frequently recommended by others?
b) Are there any free/cost based tools (UI or Script based) that can do backup & restore of ACTIVE AND NON-ACTIVE cluster?
Thanks for the help and advice.
Much appreciated.
Thanks
Pranav.
--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/Pf1tLdAtIp8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/Pf1tLdAtIp8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/Pf1tLdAtIp8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.