Not able to import GeoJson file using Kibana Maps

[RamyaGowda (Ramya)]

Hi Team,

I have created the custom geojson file for India region, when i try to import the file in kibana maps, it doesn't show any errors in elasticsearch log nor in the kibana UI.

But i can see below error in kibana log

{"type":"response","@timestamp":"2020-12-10T08:10:06Z","tags":,"pid":23019,"method":"post","statusCode":408,"req":{"url":"/api/fileupload/import?id=fab78320-3abe-11eb-bffe-2965c006cf99","method":"post","headers":{"host":"xxxxx:5601","connection":"keep-alive","content-length":"11450954","kbn-version":"7.9.3","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36","content-type":"application/json","accept":"/","origin":"http://xxxxx:5601","referer":"xxxxx:5601/app/maps/map","accept-encoding":"gzip, deflate","accept-language":"en-US,en;q=0.9"},"remoteAddress":"10.47.6.133","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36","referer":"xxxxxx:5601/app/maps/map"},"res":{"statusCode":408,"responseTime":17005,"contentLength":9},"message":"POST /api/fileupload/import?id=fab78320-3abe-11eb-bffe-2965c006cf99 408 17005ms - 9.0B"}
{"type":"response","@timestamp":"2020-12-10T08:10:23Z","tags":,"pid":23019,"method":"post","statusCode":400,"req":{"url":"/api/fileupload/import","method":"post","headers":{"host":"xxxx:5601","connection":"keep-alive","content-length":"169","kbn-version":"7.9.3","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36","content-type":"application/json","accept":"/","origin":"http://xxxxx:5601","referer":"xxxxxx:5601/app/maps/map","accept-encoding":"gzip, deflate","accept-language":"en-US,en;q=0.9"},"remoteAddress":"10.47.6.133","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36","referer":"xxxxxx:5601/app/maps/map"},"res":{"statusCode":400,"responseTime":63,"contentLength":9},"message":"POST /api/fileupload/import 400 63ms - 9.0B"}

Import File keeps on loading and vanishes after sometime.

Please help me here.

Thanks in Advance,
Ramya

[Aaron_Caldwell]

Hello Ramya,

Any chance you can provide the geojson file you tried to upload?

Thanks,
Aaron

[RamyaGowda (Ramya)]

@Aaron_Caldwell,

where i can upload the file, it's 46MB size file

Thanks,
Ramya

[Aaron_Caldwell]

Hello Ramya,

Please use this link to upload the file: https://upload.elastic.co/u/5f501789-e185-4fd5-a39a-acc746d426d3 . I suspect some interplay of size and complexity is the issue but would like to verify. Generally speaking, the GeoJSON uploader can handle the majority of files up to 50MB, but there are occasional exceptions and also local client factors that can affect this limit.

You might want to check out this other issue as well. It's a slightly different situation, but the advice would apply here. Regardless, I would appreciate the chance to look at the file. Then I can tell you if I'm seeing something similar and we'll have an additional data point to identify unhandled complexeties for this utility!

Regards,
Aaron

[RamyaGowda (Ramya)]

Hi @Aaron_Caldwell,

Please find the geojson file here :

curl -L -H 'Authorization: xxxxxxxxxx' -o 'india_geojson.json' https://upload.elastic.co/d/4b1914c8932db8aaa5f414bfc5c9a235abdb704b931d4db2f47667e043e8995c

Thanks,
Ramya

[Aaron_Caldwell]

Hello Ramya,

No need to include the download instructions, I get notified when the upload's been made. Are you certain you've uploaded the correct file though? The file I received is called all_countries.json which is GeoJSON but is only 1MB in size. Just to be certain, here's another download link in case you need to upload something different:

https://upload.elastic.co/u/86e0b745-dbd5-40e3-983b-2d72dad06840

Thanks,
Aaron

[RamyaGowda (Ramya)]

Hello Aaron,

Last time by mistakenly I have uploaded wrong file.
I have uploaded the correct one this time, filename is India_geojson.json

Thanks,
Ramya

[Aaron_Caldwell]

Hello Ramya,

Thanks, I got the correct file this time. Interestingly I had no issues uploading it:

You could try loading Kibana in a different browser and then attempting to upload the file to see if you get different results. Please let me know if you do!

I've added an item to an issue we've created to track GeoJSON Upload Error Handling. File upload is likely to improve in the future, but details are TBD. If you don't have any luck in a different browser, your best bet would be to use one of our other options for data ingest.

Regards,
Aaron

[RamyaGowda (Ramya)]

Hello Aaron,

Thanks, I tried with Chrome, Firefox and IE but no luck in loading the data.
I also tried by increasing the http.max_content_length to 500mb to see if this helps, but it didn't worked.

surprisingly I'm able to load this data in a 3 ES with Kibana cluster without any changes.
I don't understand why it is not working for single instance.

`

but there are occasional exceptions and also local client factors that can affect this limit.

from your previous message , what are these factor?

I used beats and logstash to load different type of data to ES, but not sure how it works for GeoJSON data , can you please shed some light here.

Thanks,
Ramya