Elasticsearch hadoop, dynamically decide index name too (not just type name), is it possible?

Elastic Stack Elasticsearch
1

I saw hadoop documentation regarding setting up index for a mapreduce job
to EsOutuputFormat. Below is a part regarding dynamically decide the
document type.
(http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/mapreduce.html).
My question is is it possible to parameterize the "my-collection"?
Thanks,
Jack
writing to dynamic/multi-resourcesedit
https://github.com/elasticsearch/elasticsearch-hadoop/edit/2.0/docs/src/reference/asciidoc/core/mr.adoc

As expected, the difference between the old and new API are minimal (to be
read non-existing) in this case as well:

Configuration conf = new Configuration();
conf.set("es.resource.write","my-collection/{media-type}");
...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3270d2e8-8bbb-4bd0-b10a-f889e4cbc61a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Yes, simply use a different pattern - {my-index-pattern}/{my-type}-foobar

On 9/11/14 9:56 PM, Jinyuan Zhou wrote:

I saw hadoop documentation regarding setting up index for a mapreduce job to EsOutuputFormat. Below is a part regarding
dynamically decide the document type.
(Elasticsearch Platform — Find real-time answers at scale | Elastic). My question is is it possible to
parameterize the "my-collection"?
Thanks,
Jack

    writing to dynamic/multi-resourcesedit
    <https://github.com/elasticsearch/elasticsearch-hadoop/edit/2.0/docs/src/reference/asciidoc/core/mr.adoc>

As expected, the difference between the |old| and |new| API are minimal (to be read non-existing) in this case as well:

Configuration conf= new Configuration();
conf.set("es.resource.write","my-collection/{media-type}");
...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3270d2e8-8bbb-4bd0-b10a-f889e4cbc61a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/3270d2e8-8bbb-4bd0-b10a-f889e4cbc61a%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/54120C75.8060509%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

This is great. Thanks,

Jinyuan (Jack) Zhou

On Thu, Sep 11, 2014 at 1:56 PM, Costin Leau costin.leau@gmail.com wrote:

Yes, simply use a different pattern - {my-index-pattern}/{my-type}-foobar

On 9/11/14 9:56 PM, Jinyuan Zhou wrote:

I saw hadoop documentation regarding setting up index for a mapreduce job
to EsOutuputFormat. Below is a part regarding
dynamically decide the document type.
(Elasticsearch Platform — Find real-time answers at scale | Elastic
current/mapreduce.html). My question is is it possible to
parameterize the "my-collection"?
Thanks,
Jack

    writing to dynamic/multi-resourcesedit
    <https://github.com/elasticsearch/elasticsearch-

hadoop/edit/2.0/docs/src/reference/asciidoc/core/mr.adoc>

As expected, the difference between the |old| and |new| API are minimal
(to be read non-existing) in this case as well:

Configuration conf= new Configuration();
conf.set("es.resource.write","my-collection/{media-type}");
...

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3270d2e8-
8bbb-4bd0-b10a-f889e4cbc61a%40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/3270d2e8-
8bbb-4bd0-b10a-f889e4cbc61a%40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players
email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/WkXHVSPZMsI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/54120C75.8060509%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CANBTPCG_70h-CZ1R2k9z4BjPkPWbnkiuSch6Z63L-3AJUUxKFA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.