On May 1, 2013, at 12:36 , Puneet Garg puneet.garg0109@gmail.com wrote:
Hi,
I installed below mentioned plugin. When I try to run below command:
curl -X POST 'http://localhost:9200/_export' -d '{
"fields": ["_id", "_source"],
"output_file": "/home/pgarg/puneet/study_projects/logstash/archive/dump-${index}-${shard}"
}
'
I am getting "curl: (52) Empty reply from server". Do you have any idea?
hi
could you please tell me which version of elasticsearch you use. Or you could also investigate the elasticsearch log files, maybe there is more information about this failure.
My understanding is it will create new index called _export and put all data which needs to be exported under that and in mentioned file as json. Am I correct?
No this is not the case. It directly exports the data in json format to the local filesystem of each node to the given path. There should be one file for each shard. It does not create any index.
In readme.txt it's mentioned we can look for all or selected indexes. Can you please give me an example? Basically I am looking for indexes those starts with graylog2_ i.e. prefix. Is there a way where in we can mention indexes prefix to run query in elasticsearch?
This works the same way the _search endpoint works in elasticsearch. see Elasticsearch Platform — Find real-time answers at scale | Elastic
So your request should look like this (with gzip compression on):
curl -vvX POST 'http://localhost:9200/graylog2_*/_export' -d '{
"fields": ["_id", "_source"],
"output_file": "/home/pgarg/puneet/study_projects/logstash/archive/dump-${index}-${shard}.gz",
"compression": "gzip"
}
Note that this export all matching indexes, which might not be what you want. If you do this on a daily basis you might want to export only the newest index because any other would have been already exported. You might also want to take a look at the force_overwrite option described on GitHub - crate/elasticsearch-inout-plugin: An Elasticsearch plugin which provides the ability to export data by query on server side. which forces to overwrite files that have been generated in a previous run.
Hope this helps, Bernd
-Puneet
On Mon, Apr 29, 2013 at 3:26 PM, Puneet Garg puneet.garg0109@gmail.com wrote:
Thanks will check the same.
-Puneet
On Mon, Apr 29, 2013 at 3:19 PM, dobe bernddorn@gmail.com wrote:
hi
we just wrote a plugin for exporting data based on a query directly on the data nodes, and we are currently working on the re-import . i think this is exactly what you need. take look at the examples in the readme GitHub - crate/elasticsearch-inout-plugin: An Elasticsearch plugin which provides the ability to export data by query on server side.
br, bernd
On Monday, April 29, 2013 9:38:21 AM UTC+2, Puneet Garg wrote:
Hi,
I am new to elasticsearch. I am not able to find good read on elasticsearch data backup/archive.
I am setting up graylog2 with elasticsearch. I want to check can we archive data in elasticsearch which is non active. It may be monthly basis. So my elasticsearch don't have stale data which will help elasticsearch to be fast. In future If I need that archive data can I import that as well?
Thanks for your help in advance.
--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/GVozCDew3Q0/unsubscribe?hl=en-US.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
Cheers!!,
Puneet Garg
--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/GVozCDew3Q0/unsubscribe?hl=en-US.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
