# How to increase line\_merge\_size\_limit when importing from Visualizer

**URL:** <https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912>\
**Category:** Kibana\
**Tags:** elastic-stack-machine-learning\
**Created:** [August 21, 2020, 11:23am UTC](https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912 "2020-08-21T11:23:35Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Fosiul\_Alam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fosiul_alam/32/43335_2.png) [@Fosiul\_Alam](https://discuss.elastic.co/u/Fosiul_Alam)\
**Post date:** [August 21, 2020, 11:23am UTC](https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912/1 "2020-08-21T11:23:35Z")

</div>

Hi,  
I am trying to import IIS log file manually via [Data Visualizer]  
however I am keep getting bellow message.

Now one solution is to increase "line\_merge\_size\_limit"  
Ref: [https://www.elastic.co/guide/en/elasticsearch/reference/current/ml-find-file-structure.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/ml-find-file-structure.html)  
however, I am not understanding how to do it,

Can you please help me, do i need to change any setting in yml file or will it by by POST Api

some samples lines are

> 2020-08-11 14:53:18 GET /resttst1/longlinesREMOVED=20200601 200 3082 -  
> 2020-08-11 14:53:17 POST /resttst1/longlinesREMOVED=20200601 500 1686 -

> ```
> [illegal_argument_exception] Merging lines into messages resulted in an unacceptably long message. Merged message would have [21] lines and [10535] characters (limit [10000]). If you have messages this big please increase the value of [line_merge_size_limit]. Otherwise it probably means the timestamp has been incorrectly detected, so try overriding that.
> 
> Explanation so far:
> 
> [Using character encoding [UTF-8], which matched the input with [15%] confidence - first [8kB] of input was pure ASCII]
> 
> [Not NDJSON because there was a parsing exception: [Unexpected character ('#' (code 35)): expected a valid value (JSON String, Number, Array, Object or token 'null', 'true' or 'false') at [Source: (org.elasticsearch.xpack.ml.filestructurefinder.NdJsonFileStructureFinderFactory$ContextPrintingStringReader); line: 1, column: 2]]]
> 
> [Not XML because there was a parsing exception: [ParseError at [row,col]:[1,1] Message: Content is not allowed in prolog.]]
> 
> [Not CSV because the first row has fewer than [2] fields: [1]]
> 
> [Not TSV because the first row has fewer than [2] fields: [1]]
> 
> [Not semicolon delimited values because the first row has fewer than [4] fields: [1]]
> 
> [Not vertical line delimited values because the first row has fewer than [5] fields: [1]]
> 
> [Deciding sample is text]
> 
> [Most likely timestamp format is [yyyy-MM-dd HH:mm:ss]]
> 
> ```

---

<div class="post-metadata">

**Author:** ![wei.wang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wei.wang/32/51803_2.png) [@wei.wang](https://discuss.elastic.co/u/wei.wang)\
**Post date:** [August 21, 2020, 7:58pm UTC](https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912/2 "2020-08-21T19:58:38Z")

</div>

Hi there,

The first thing to check is the log file itself.

- Is there any long line(s) which doesn't have date-time timestamp at the beginning?

or

- Is there any long line(s) which has different format or invalid date-time timestamp at the beginning, which is not the same as the one in your sample `2020-08-11 14:53:17` ?

If the answer is yes , the log file might have to be corrected before uploading through the Data Visualizer UI.

Cheers.  
Wei

---

<div class="post-metadata">

**Author:** ![Fosiul\_Alam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fosiul_alam/32/43335_2.png) [@Fosiul\_Alam](https://discuss.elastic.co/u/Fosiul_Alam)\
**Post date:** [August 22, 2020, 9:58am UTC](https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912/3 "2020-08-22T09:58:48Z")

</div>

Hi Wei.wang  
Thanks for repling  
i have tested, if i shorted the log lines it works, so which means we have limitation how long the lines can be imported  
so date time stamp is not a prolem , is the length of the lines

Thanks

---

<div class="post-metadata">

**Author:** ![wei.wang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wei.wang/32/51803_2.png) [@wei.wang](https://discuss.elastic.co/u/wei.wang)\
**Post date:** [August 23, 2020, 1:57am UTC](https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912/4 "2020-08-23T01:57:32Z")

</div>

Hi,

If it is confirmed that was caused by 10000+ character lines, unfortunately, there’s no way to import it using the Data Visualizer UI at this moment. Feel free to open an enhancement request, we will evaluate and see if we could support it in the future release.

cheers.  
Wei

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 20, 2020, 1:57am UTC](https://discuss.elastic.co/t/how-to-increase-line-merge-size-limit-when-importing-from-visualizer/245912/5 "2020-09-20T01:57:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
