Parent/child with logstash 2.1.1

Elastic Stack Logstash
1

Hi,
i've tried to index child documents with logstash but it doesn't work since I use the 2.1.1 version.
Here is my config :

'''
...
filter {
mutate {
add_field => { "_parent" => "%{_id}" }
remove_field => ["@timestamp","message","@version","host","path"]
convert => [ "goals", "integer" ]
}
}

output {
elasticsearch {
hosts => ["localhost:9202"]
index => "myindex"
document_type => "mychildtype"
document_id => "%{_id}"
}
stdout { codec => rubydebug }
}
'''

I've got 4 shards and it works for about 25% of my docs.
Somebody told me that "When you use routing the type and id no longer control which shard gets
the document. Instead Elasticsearch just hashes the routing. Parent/child just uses the parent as the routing."
So what is the solution to index child documents with logstash ?

2

You can't do P/C with Logstash.
Changes in ES 2.X mean that you need to provide the parent ID in the URL, you cannot just extract the parent value from a field in the document.

3

Are you sure ?
I understood that it was possible since version 2.1.1 with the release notes who pointed to this : https://github.com/logstash-plugins/logstash-output-elasticsearch/issues/297

Thanks.

4

Any luck with this?

5

No, finally i decided to replace child documents with nested.