I am unable to find examples on the web. Is there any way to delete fields names that contains dots using logstash?
My indices are failing the migration tool test, I am unable to upgrade to 2.2 yet. My plan is to re-index
I need to delete fields as follow:
"http://xxxx.xxxxx.com/collect/" : {
"type" : "string"
},
"facet.filter" : {
"type" : "string"
},
"par_id" : {
"type" : "string",
"index" : "not_analyzed"
},
Please help
You might be able to use the de_dot filter plugin, which was designed as a migration aid. It will however not delete the field, but rename it.
Thank you, I will give it a try
Hi Christian
The de_dot plugin seems to be doing the job when I tested it with one index. I have 386 indices to re-index
How can I do bulk re-indexing using with de_dot? indices names follows the following patterns:
index-2016.month.day eg. index-2016.03.01, index-2016.03.02, index-2016.03.03...etc...
input {
elasticsearch {
hosts => [ "cluster_name.com:9200" ]
index => "index-2016.03.01"
size => 500
scroll => "5m"
docinfo => true
}
}
output {
elasticsearch {
hosts => "remote_cluster:9200"
index => "index-2016.03.01"
}