Duplicate data on hadoop

Elastic Stack Elasticsearch
1

Dear All,

i have problem with import data from es to hadoop ( querying using hive),
the problem is i have 3 recod in my es, but when i select in hive table it
return result 21, when i check each record in es duplicate 6 times,

here the query table creation in hadoop :
CREATE EXTERNAL TABLE conversion (
ip string,
user_id string,
tracker_id string,
time_log bigint,
session_id string,
spot_id string,
traker_type_id bigint,

)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'event-conversion*/conversion',
'es.mapping.names' = 'ip:ip, user_id:user_id,
tracker_id:tracker_id, time_log:datetime_log,
session_id:session_id,spot_id:spot_id, tracker_type_id:tracker_type_id');

so is there something that wrong in my create table query?

thank you

jimmy

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b446dd4f-4619-40f7-a083-72ae0fbbf163%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Try to use one index instead of multiple indexes.
For instance, change 'es.resource' = 'event-conversion*/conversion' to
'es.resource' = 'event-conversion-01/conversion'.
I think es-hadoop does not support multiple indexes setting for now.

On Wed, Nov 19, 2014 at 11:57 AM, Jimmy Carter jimsproject@gmail.com wrote:

Dear All,

i have problem with import data from es to hadoop ( querying using hive),
the problem is i have 3 recod in my es, but when i select in hive table it
return result 21, when i check each record in es duplicate 6 times,

here the query table creation in hadoop :
CREATE EXTERNAL TABLE conversion (
ip string,
user_id string,
tracker_id string,
time_log bigint,
session_id string,
spot_id string,
traker_type_id bigint,

)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'event-conversion*/conversion',
'es.mapping.names' = 'ip:ip, user_id:user_id,
tracker_id:tracker_id, time_log:datetime_log,
session_id:session_id,spot_id:spot_id, tracker_type_id:tracker_type_id');

so is there something that wrong in my create table query?

thank you

jimmy

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/b446dd4f-4619-40f7-a083-72ae0fbbf163%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CADQPeWz7J6-M%3DDVp8Nj0MYkikjRyUzOg6t72dU7oawqyrRn81Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.