# \[MachineLearning/DataVisualizer/ImportData\] - File too large (?)

**URL:** <https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882>\
**Category:** Kibana\
**Tags:** elastic-stack-machine-learning\
**Created:** [February 11, 2019, 3:14pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882 "2019-02-11T15:14:48Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![GitsBdr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gitsbdr/32/58828_2.png) [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\
**Post date:** [February 11, 2019, 3:14pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/1 "2019-02-11T15:14:48Z")

</div>

Hi here,  
Thanks in advance for your time

I was trying to use the new machine learning tool and it worked well for a first test fill  
Then, I've been trying with a fill much larger (header of 9 fields, 45120 lines of data) and the "Data analyzing load" never ended.  
So, I tried to split this fill with the first 15 000 lines and it worked fine but, after adding the next 1 000 lines, I've got the same behavior again ...  
So I tried to check if something was wrong between the line 15 000 and 16 000 but I'm able to load a file with the lines from 14 000 to 17 000 ...

The only issue I can think about now is that my file is too large (?). Even if my fill is \< 100MB (2,9MB)

Regards  
Guillaume

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [February 11, 2019, 9:08pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/2 "2019-02-11T21:08:06Z")

</div>

I've seen this "never ending" behavior when there were odd characters in the file (for example, DOS-like newline chars like ^M).

I would look at the file closely in a text editor that can show you hidden symbols (such as using `:set list` in `vi`) and ensure there are no wacky symbols in there. Keep in mind that the `$` symbol for a newline in `vi` is okay.

---

<div class="post-metadata">

**Author:** ![GitsBdr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gitsbdr/32/58828_2.png) [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\
**Post date:** [February 12, 2019, 9:49am UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/3 "2019-02-12T09:49:41Z")

</div>

Hi @richcollier, thanks a lot for your answer,  
I thought you had found my issue but after removing every single `^M` I've got the same result ...  
Using `:set list` in `vi`, I can confirm that all my lines look like aa;bb;cc;dd$ now  
Still able to import a file with my first 15 000 lines, cannot figure out what's wrong here

Also tried with another test file looking like field1;field2;field3;field4;field5;field6;field7;field8;field9 for the header and 45 000 data lines like aaa;bbb;ccc;dddd;eeee;ffff;gggg;hhhh;iiii  
Same wrong behavior

Regards

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [February 12, 2019, 1:18pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/4 "2019-02-12T13:18:29Z")

</div>

Hmmm... I'm not sure how we can help unless we had your problematic file (or an anonymized version of it) to reproduce the issue. Any way to provide?

---

<div class="post-metadata">

**Author:** ![GitsBdr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gitsbdr/32/58828_2.png) [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\
**Post date:** [February 12, 2019, 1:37pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/5 "2019-02-12T13:37:37Z")

</div>

Are you able/allowed to download my test file from my google drive here : [https://drive.google.com/open?id=1s8Iz-kALilsBfayipATKSqlU9MwBKTwk](https://drive.google.com/open?id=1s8Iz-kALilsBfayipATKSqlU9MwBKTwk)

If not, how do you want me to share it with you ?

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [February 12, 2019, 2:11pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/6 "2019-02-12T14:11:37Z")

</div>

Thanks! Was able to download the file and it imported perfectly!

![image](https://us1.discourse-cdn.com/elastic/original/3X/6/4/64b9a40dd3006d795974d15ef515bf48db03ba5b.png)

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/6/2/62df772161eafb0fef693e58b6dbfd27b8848aec.png)

---

<div class="post-metadata">

**Author:** ![GitsBdr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gitsbdr/32/58828_2.png) [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\
**Post date:** [February 12, 2019, 2:28pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/7 "2019-02-12T14:28:56Z")

</div>

Feeling stupid ... Haha  
I've tried again but nothing changed  
Is there any configuration to modify / enable on the server. Any logs to verify ?  
Thanks for your time

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [February 12, 2019, 3:19pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/8 "2019-02-12T15:19:07Z")

</div>

Perhaps enabling developer mode/console on the browser to see where things might be getting stuck for you might be helpful ??)

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/b/2/b2d9116256387175591c04f7cc72435522ab4c5b.png)

Are you doing this locally (i.e. running ES/Kibana on your local machine) or is this on Elastic Cloud or is the destination system far away (network-wise?). Is there a possible proxy/firewall in place that is disallowing uploads of certain sizes? Just trying to think outside the box here....

---

<div class="post-metadata">

**Author:** ![GitsBdr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gitsbdr/32/58828_2.png) [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\
**Post date:** [February 12, 2019, 5:24pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/9 "2019-02-12T17:24:17Z")

</div>

Thanks again for your very helpful answer  
As you suggested, I opened the network console of my browser and I've found the issue  
Nothing about Kibana but our network, I've got the 413 http status - Request Entity Too Large  
Issue closed !  
Thanks for your help and time  
Regards  
Guillaume

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 12, 2019, 5:24pm UTC](https://discuss.elastic.co/t/machinelearning-datavisualizer-importdata-file-too-large/167882/10 "2019-03-12T17:24:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
