Unable to import csv with floats in 7.x rc2

Elastic Stack Elasticsearch
1

Hello,

Trying Kibana / ELastic 7.0 rc2 csv importer functionalities. So I have a small test csv which contains some data with a location and 4 floats with the number of dog poo (yes, you read that correctly) collected.

When I try to import the csv and want to change the keyword fields to float or scaled float:

{
  "december_2010": {
    "type": "float"
  },
  "juni_2010": {
    "type": "float"
  },
  "locatie": {
    "type": "keyword"
  },
  "maart_2010": {
    "type": "float"
  },
  "september_2010": {
    "type": "float"
  }
}

I get the message :slight_smile:

Some documents could not be imported

166 out of 166 documents could not be imported. This could be due to lines not matching the Grok pattern.

Failed documents

0: failed to parse field [maart_2010] of type [float] in document with id 'qaCw_mkBjQe66vCDu5Z8'

{"locatie":"St-Elisabethplein","maart_2010":"4,80","juni_2010":"6,40","september_2010":"6,50","december_2010":"8,00"}

1: failed to parse field [maart_2010] of type [float] in document with id 'qqCw_mkBjQe66vCDu5Z8'

{"locatie":"de Smetstraat","maart_2010":"1,60","juni_2010":"2,80","september_2010":"4,16","december_2010":"3,40"}

I thought the problem was related to the default number format we are using here in Belgium, where the komma stands for a floating like in usa they use a point.

Tried editing the number format

0.0,[000]

to

0,0.[000]

But that didn't really help. How would I go on using the csv import functionality when using floats with ','.

The data looks like this:

locatie,maart_2010,juni_2010,september_2010,december_2010
St-Elisabethplein,"4,80","6,40","6,50","8,00"
de Smetstraat,"1,60","2,80","4,16","3,40"
Kolveniersgang,"12,00","12,83","12,66","11,83"
F.V. Cleeflaan,"13,00","6,33","8,33","11,66"
F v Cleeflaan,"11,66","19,83","11,66","11,33"
Elsstraat,"2,00","4,40","3,83","5,40"
St Jozefkerk,"1,00","0,40","2,50","2,40"
Alois Joossttraat,"5,00","3,33","5,33","5,00"
Gasmeterlaan(brug),"3,66","4,20","3,66","7,33"
Gasmeterlaan(midden),"15,00","24,66","31,00","21,00"
totaal RABOT,"69,72","85,18","89,63","87,35"
Nieuwevaart(Won.brug),"2,66","0,40","2,33","2,20"
Nieuwevaart (poezenboot),"7,83","7,00","5,00","9,16"
Nieuwevaart(Smetbrug),"2,66","4,00","8,00","7,16"
Westerbegraafplaats,"12,00","18,00","18,50","12,50"
Staakskenstraat,"8,20","5,40","6,33","7,80"
Fr Ferrerlaan,"3,60","4,60","3,50","4,60"

Grtz

Willem

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.