# Logtash CSV Parser Fail Muline Value is counting next raw

**URL:** <https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617>\
**Category:** Logstash\
**Created:** [November 10, 2022, 7:06am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617 "2022-11-10T07:06:46Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![dharminfadia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dharminfadia/32/119587_2.png) [@dharminfadia](https://discuss.elastic.co/u/dharminfadia)\
**Post date:** [November 10, 2022, 7:06am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/1 "2022-11-10T07:06:46Z")

</div>

![image](https://us1.discourse-cdn.com/elastic/original/3X/e/0/e01ef4413248b2b97108d36943674e60c5cb58d4.png)

**see in my First raw last coulumn have multiline and second raw haveing signle line**

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 10, 2022, 7:17am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/2 "2022-11-10T07:17:00Z")

</div>

It would help if you could show your current config as well as some sample data illustrating the problem.

---

<div class="post-metadata">

**Author:** ![dharminfadia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dharminfadia/32/119587_2.png) [@dharminfadia](https://discuss.elastic.co/u/dharminfadia)\
**Post date:** [November 10, 2022, 8:16am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/3 "2022-11-10T08:16:44Z")

</div>

@Christian_Dahlqvist

Sure Thanks for Reply

This is my Currunt Config

input {  
file {  
path =\> "/home/query.csv"  
start\_position =\> "beginning"  
sincedb\_path =\> "/dev/null"  
}  
}

filter {  
mutate {  
gsub =\> [  
'statement\_text', '\"', '',  
'statement\_text', '"', '',  
'statement\_text', ',\s+', ','

```
]

```

}

csv {  
separator =\> ","  
columns =\> ["db\_name","dbid","objectid","creation\_time","last\_execution\_time","execution\_count","total\_rows","min\_rows","max\_rows","avg\_rows","total\_elapsed\_time\_ms","min\_elapsed\_time\_ms","max\_elapsed\_time\_ms","avg\_elapsed\_time\_ms","total\_cpu\_time\_ms","min\_cpu\_time\_ms","max\_cpu\_time\_ms","avg\_cpu\_time\_ms","statement\_text"]  
}

mutate {  
remove\_field =\> ["desc"]  
}  
}

output {  
elasticsearch {  
hosts =\> "[http://xyz:9200](http://xyz:9200)"  
index =\> "project"  
}  
stdout {}  
}

**Data Output is Proper but some coulumn have multiline so its not taking proper.**

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 10, 2022, 8:25am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/4 "2022-11-10T08:25:36Z")

</div>

Please show an example of the data you are having issues with.

---

<div class="post-metadata">

**Author:** ![dharminfadia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dharminfadia/32/119587_2.png) [@dharminfadia](https://discuss.elastic.co/u/dharminfadia)\
**Post date:** [November 10, 2022, 8:39am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/5 "2022-11-10T08:39:47Z")

</div>

![image](https://us1.discourse-cdn.com/elastic/original/3X/0/1/01104e40499d1a3ed7bbb15e4dbcd8ec8110028a.png)

**See this is my output some of the document is not comming poper mostly if any coulumn have multiline data**

---

<div class="post-metadata">

**Author:** ![dharminfadia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dharminfadia/32/119587_2.png) [@dharminfadia](https://discuss.elastic.co/u/dharminfadia)\
**Post date:** [November 10, 2022, 8:52am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/6 "2022-11-10T08:52:44Z")

</div>

![image](https://us1.discourse-cdn.com/elastic/original/3X/5/e/5e7496a5a3d5c9de84aabf63302bdf452e4059c6.png)

Getting Error like CSV Parser Fail

@Christian_Dahlqvist

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 10, 2022, 8:53am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/7 "2022-11-10T08:53:07Z")

</div>

What does the raw data that is input into Logstash look like?

---

<div class="post-metadata">

**Author:** ![dharminfadia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dharminfadia/32/119587_2.png) [@dharminfadia](https://discuss.elastic.co/u/dharminfadia)\
**Post date:** [November 10, 2022, 8:58am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/8 "2022-11-10T08:58:35Z")

</div>

> [@Christian\_Dahlqvist](#):
>
> What does the raw data that is input into Logstash look like?

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/8/9/895988a991c89736ea05bafbc60e10427307322d.png)

this is my csv file see in first raw last coulumn and cmpaire with second raw last coulumn my second raw data is properly showing but if the data is in multiline in coulumn its not showing properly  
@Christian_Dahlqvist

I have to use mutate gsub after csv parser ?

---

<div class="post-metadata">

**Author:** ![dharminfadia](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dharminfadia/32/119587_2.png) [@dharminfadia](https://discuss.elastic.co/u/dharminfadia)\
**Post date:** [November 11, 2022, 5:23am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/9 "2022-11-11T05:23:47Z")

</div>

@Christian_Dahlqvist

Any thing you can help ?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 11, 2022, 6:11am UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/10 "2022-11-11T06:11:03Z")

</div>

If it breaks across multiple lines in the CSV text file you will need to use a [multiline codec](https://www.elastic.co/guide/en/logstash/current/plugins-codecs-multiline.html) with your file input.

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [November 11, 2022, 6:33pm UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/11 "2022-11-11T18:33:14Z")

</div>

Can you show what LS received in the message field?  
Use ruby debug in the output. Pls don't post pics.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 9, 2022, 6:33pm UTC](https://discuss.elastic.co/t/logtash-csv-parser-fail-muline-value-is-counting-next-raw/318617/12 "2022-12-09T18:33:36Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
