# I want to know how to avoid parsing error in foreign language

**URL:** <https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170>\
**Category:** Logstash\
**Created:** [January 11, 2017, 4:55am UTC](https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170 "2017-01-11T04:55:25Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![111146](https://avatars.discourse-cdn.com/v4/letter/1/2bfe46/32.png) [@111146](https://discuss.elastic.co/u/111146)\
**Post date:** [January 11, 2017, 4:55am UTC](https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170/1 "2017-01-11T04:55:25Z")

</div>

I have found that Vietnamese has a parsing error in logStash  
I want to know how to avoid errors.

## **test.xml**

## Tập 12 - Mười Tội Ác - The Ten Deadly Sins 2016

## **error message**

Trouble parsing xml with XmlSimple {:source=\>"message", :value=\>"e\>\n", :exception=\>#\<REXML::ParseException: #\<REXML::ParseException: Missing end tag for '' (got "xml-fragment")

* * *

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [January 12, 2017, 6:17pm UTC](https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170/2 "2017-01-12T18:17:04Z")

</div>

This looks like a case of broken XML. Can you share the full XML document?

---

<div class="post-metadata">

**Author:** ![111146](https://avatars.discourse-cdn.com/v4/letter/1/2bfe46/32.png) [@111146](https://discuss.elastic.co/u/111146)\
**Post date:** [January 13, 2017, 12:22am UTC](https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170/3 "2017-01-13T00:22:04Z")

</div>

![](https://us1.discourse-cdn.com/elastic/original/2X/4/4fd785cb19b99fde822da6646dca033fa0cde53d.PNG)

\<?xml version="1.0" encoding="UTF-8" standalone="no"?\> 95953\_4 Tập1 - Biến Hóa HoànTEST Hảo 01 01:05 HQ AAC MOBILE 2 0 N CDBR\_KT1 Y 2016-07-08 9999-12-31

---

<div class="post-metadata">

**Author:** ![111146](https://avatars.discourse-cdn.com/v4/letter/1/2bfe46/32.png) [@111146](https://discuss.elastic.co/u/111146)\
**Post date:** [January 13, 2017, 12:35am UTC](https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170/4 "2017-01-13T00:35:08Z")

</div>

We parse more than 100 xml files at a time. Then an error occurs and Incorrect data is entered.  
Note that we delete files stored in Elastic Search DB after 7 days.

It is difficult to find the cause of the error. There is nothing in common.

and LogStash has a bug that does not work if there are more than 5000 files to process.  
so we delete the files stored in Elastic Search DB

Any help appreciated.

**1) error**

 ![](https://us1.discourse-cdn.com/elastic/original/2X/3/3a1cdcb08b5f81624d4fe8e520683d23f09c1574.PNG)

**2) incorred data**  
 ![](https://us1.discourse-cdn.com/elastic/original/2X/c/c0e252f826770a2ca8fdcc66766125f9f9cffc73.png)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 10, 2017, 12:35am UTC](https://discuss.elastic.co/t/i-want-to-know-how-to-avoid-parsing-error-in-foreign-language/71170/5 "2017-02-10T00:35:59Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.