Kibana4 doesn't recognize my timestamp; ES is mapping it as a string

Elastic Stack Elasticsearch
1

I want to push data I have in my hadoop cluster to ES and then visualize
the hole thing in kibana4.

this is what I’ve done :

CREATE TABLE xx(traffic_type_id INT, caller INT, time STRING,
tranche_horaire INT, called INT, call_duration INT, code_type_trafic
STRING, code_destination_trafic STRING, location_number STRING, id_offre
INT, id_service INT)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘\t';

LOAD DATA INPATH ‘/user/hive/outt.csv’ OVERWRITE INTO TABLE xx;

CREATE EXTERNAL TABLE esxx (caller INT, time STRING, tranche INT,
called_number INT, duration INT, code_type STRING, code_destination STRING,
location STRING, offre INT, service INT)
STORED BY ‘org.elasticsearch.hadoop.hive.EsStorageHandler’
TBLPROPERTIES(‘es.resource’ = ‘xx/xx’,
‘es.nodes’=’192.168.238.130:9200′,
‘es.mapping.names’ = ‘time:@timestamp’);

INSERT OVERWRITE TABLE escdr SELECT s.caller, s.time, s.tranche_horaire,
s.called, s.call_duration, s.code_type_trafic, s.code_destination_trafic,
s.location_number, s.id_offre, s.id_service FROM xx s;

CREATE EXTERNAL TABLE xx (
caller INT,
time TIMESTAMP,
tranche INT,
called_number INT,
duration INT,
code_type STRING,
code_destination STRING,
location STRING,
offre INT,
service INT)
STORED BY ‘org.elasticsearch.hadoop.hive.EsStorageHandler’
TBLPROPERTIES(‘es.resource’ = ‘xx/xx/’,
‘es.nodes’=’192.168.238.130:9200′,
‘es.mapping.names’ = ‘time:@timestamp’);

But Kibana doesn’t seem to recognize my timestamp “time”, ES keeps on
mapping it as a string (the time field in my csv file is as so : exp :
01AUG2014:19:02:11 ! What should I do and change to let ES do the
appropriate mapping and thus recognize my timestamp?
Best regards,
Omar,

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/30597efd-b762-473d-94aa-9c1671fb0ff4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

By using this statement

'es.mapping.names’ = ‘time:@timestamp’

You've changed the name of the 'time' field in your hive table to
'@timestamp' in your elasticsearch index.
See if you have a can find a field called @timestamp in kibana and use that
as your time field in ES.

Alternatively try removing that line from your hive creation table see if
that changes anything.

On Sat, Mar 21, 2015 at 2:39 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

I want to push data I have in my hadoop cluster to ES and then visualize
the hole thing in kibana4.

this is what I’ve done :

CREATE TABLE xx(traffic_type_id INT, caller INT, time STRING,
tranche_horaire INT, called INT, call_duration INT, code_type_trafic
STRING, code_destination_trafic STRING, location_number STRING, id_offre
INT, id_service INT)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘\t';

LOAD DATA INPATH ‘/user/hive/outt.csv’ OVERWRITE INTO TABLE xx;

CREATE EXTERNAL TABLE esxx (caller INT, time STRING, tranche INT,
called_number INT, duration INT, code_type STRING, code_destination STRING,
location STRING, offre INT, service INT)
STORED BY ‘org.elasticsearch.hadoop.hive.EsStorageHandler’
TBLPROPERTIES(‘es.resource’ = ‘xx/xx’,
‘es.nodes’=’192.168.238.130:9200′,
‘es.mapping.names’ = ‘time:@timestamp’);

INSERT OVERWRITE TABLE escdr SELECT s.caller, s.time, s.tranche_horaire,
s.called, s.call_duration, s.code_type_trafic, s.code_destination_trafic,
s.location_number, s.id_offre, s.id_service FROM xx s;

CREATE EXTERNAL TABLE xx (
caller INT,
time TIMESTAMP,
tranche INT,
called_number INT,
duration INT,
code_type STRING,
code_destination STRING,
location STRING,
offre INT,
service INT)
STORED BY ‘org.elasticsearch.hadoop.hive.EsStorageHandler’
TBLPROPERTIES(‘es.resource’ = ‘xx/xx/’,
‘es.nodes’=’192.168.238.130:9200′,
‘es.mapping.names’ = ‘time:@timestamp’);

But Kibana doesn’t seem to recognize my timestamp “time”, ES keeps on
mapping it as a string (the time field in my csv file is as so : exp :
01AUG2014:19:02:11 ! What should I do and change to let ES do the
appropriate mapping and thus recognize my timestamp?
Best regards,
Omar,

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/30597efd-b762-473d-94aa-9c1671fb0ff4%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/30597efd-b762-473d-94aa-9c1671fb0ff4%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAO9TxdPRV%2BaGkScp58hRfhSzAK4ojDO2NV0MTWt7LGGU9cb-Ow%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.