Merge 2 types based on common field

Elastic Stack Elasticsearch
1

Hi,

I have an index named 'product' it has two types named 'type1' and 'type2'

For example:

{ product_id: "1111", price: "23.56", stock: "100" }

{ product_id: "1111", category: "iPhone case", manufacturer: "Belkin" }

I want them to join based on 'product_id' and index them in either new
index or new type in same 'product' index, so eventually it should look
like this.

{ product_id: "1111", price: "23.56", stock: "100" category: "iPhone
case", manufacturer: "Belkin" }

FYI,

  • I have millions of records similar to above, so finally I will be doing
    the similar thing for all.
  • I am using ELK stack.
  • My end goal is to display the combined result of above 2 types in Kibana.

My question is similar to thishttp://elasticsearch-users.115913.n3.nabble.com/Combining-fields-from-various-indexes-td4031116.html but
the person reported this question have 2 separate indexes while I have one
index but 2 separate types.

Thanks!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d1a30f9a-ee37-49b4-85ac-1be5d5fe6ca8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

You can not JOIN.

You should design your model to fit to your needs. I mean that you should index documents like:

{
product_id: "1111",
price: "23.56",
stock: "100"
category: "iPhone case",
manufacturer: "Belkin"
}

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr

Le 28 mars 2014 à 08:42:04, Fawad Shah (fawadshah123@gmail.com) a écrit:

Hi,

I have an index named 'product' it has two types named 'type1' and 'type2'

For example:
{
product_id: "1111",
price: "23.56",
stock: "100"
}

{
product_id: "1111",
category: "iPhone case",
manufacturer: "Belkin"
}

I want them to join based on 'product_id' and index them in either new index or new type in same 'product' index, so eventually it should look like this.

{
product_id: "1111",
price: "23.56",
stock: "100"
category: "iPhone case",
manufacturer: "Belkin"
}

FYI,

  • I have millions of records similar to above, so finally I will be doing the similar thing for all.
  • I am using ELK stack.
  • My end goal is to display the combined result of above 2 types in Kibana.

My question is similar to this but the person reported this question have 2 separate indexes while I have one index but 2 separate types.

Thanks!

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d1a30f9a-ee37-49b4-85ac-1be5d5fe6ca8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/etPan.533535a6.216231b.161d2%40MacBook-Air-de-David.local.
For more options, visit https://groups.google.com/d/optout.

3

Thanks David for your reply,
This means I don't have any other option than redesign my index model ?
Would you suggest me any alternate option, FYI I am using ELK stack.

Thanks!

On Fri, Mar 28, 2014 at 1:41 PM, David Pilato david@pilato.fr wrote:

You can not JOIN.

You should design your model to fit to your needs. I mean that you should
index documents like:

{
product_id: "1111",
price: "23.56",
stock: "100"
category: "iPhone case",
manufacturer: "Belkin"
}

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfrhttps://twitter.com/elasticsearchfr

Le 28 mars 2014 à 08:42:04, Fawad Shah (fawadshah123@gmail.com) a écrit:

Hi,

I have an index named 'product' it has two types named 'type1' and
'type2'

For example:

  • { product_id: "1111", price: "23.56", stock: "100" }*

  • { product_id: "1111", category: "iPhone case", manufacturer:
    "Belkin" }*

I want them to join based on 'product_id' and index them in either new
index or new type in same 'product' index, so eventually it should look
like this.

  • { product_id: "1111", price: "23.56", stock: "100" category: "iPhone
    case", manufacturer: "Belkin" }*

FYI,

  • I have millions of records similar to above, so finally I will be doing
    the similar thing for all.
  • I am using ELK stack.
  • My end goal is to display the combined result of above 2 types in
    Kibana.

My question is similar to thishttp://elasticsearch-users.115913.n3.nabble.com/Combining-fields-from-various-indexes-td4031116.html but
the person reported this question have 2 separate indexes while I have one
index but 2 separate types.

Thanks!

You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/d1a30f9a-ee37-49b4-85ac-1be5d5fe6ca8%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/d1a30f9a-ee37-49b4-85ac-1be5d5fe6ca8%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/VRUCQArcQas/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/etPan.533535a6.216231b.161d2%40MacBook-Air-de-David.localhttps://groups.google.com/d/msgid/elasticsearch/etPan.533535a6.216231b.161d2%40MacBook-Air-de-David.local?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAD32Vm3PyfQJkH7LKk8Co6nEr%2BHkTxH3_2PNcDG9%2Bz--i%2B2mLA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.