# CSV plugin problem

**URL:** <https://discuss.elastic.co/t/csv-plugin-problem/100070>\
**Category:** Logstash\
**Created:** [September 11, 2017, 1:49pm UTC](https://discuss.elastic.co/t/csv-plugin-problem/100070 "2017-09-11T13:49:26Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![avik\_ewu](https://avatars.discourse-cdn.com/v4/letter/a/a6a055/32.png) [@avik\_ewu](https://discuss.elastic.co/u/avik_ewu)\
**Post date:** [September 11, 2017, 1:49pm UTC](https://discuss.elastic.co/t/csv-plugin-problem/100070/1 "2017-09-11T13:49:26Z")

</div>

![image](https://us1.discourse-cdn.com/elastic/original/3X/3/2/32156c9a17af9074c99b09fb572a746496ca3bbf.png)

My sample data is like this and my config file is below. data not converted properly.

input {  
file {  
path =\> "/home/node/Copy/SDP/SDP-testdata/sdptestdata.csv"  
start\_position=\> beginning  
#sincedb\_path =\> "/dev/null"  
}  
}

filter {  
if [message] =~ /^\s\*$/ { drop { } }  
if [message] =~ /Press/ { drop {} }  
if [message] =~ "-"{mutate {replace =\> ["message", "float"]}}  
csv {  
separator =\> " "  
convert =\>

```
 {

  "SDP.succrate" => "float"
  "SDP.Failrate" => "float"
  "SDP.Rejectrate" => "integer"
  "SDP.Retransmission.Detected" => "integer"
  "SDP.Duplicate.Answered" => "float"
  "SDP.Throughput.persec" => "float"
}
columns => ["SDP.Incident.Date","SDP.Attributes.Name","SDP.succrate","SDP.Failrate","SDP.Rejectrate", "SDP.Retransmission.Detected","SDP.Duplicate.Answered", "SDP.Throughput.persec","SDP.RT.Avg","SDP.RT.Min","SDP.RT.Max"]

```

}

date {  
match =\> ["SDP.Incident.Date" , "dd-mm-yy HH:mm:ss"]  
}

mutate {convert =\> ["SDP.RT.Avg", "float"]}  
mutate {convert =\> ["SDP.RT.Min", "float"]}  
mutate {convert =\> ["SDP.RT.Max", "float"]}

}

output {  
stdout {codec=\>rubydebug}  
}

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [September 11, 2017, 6:31pm UTC](https://discuss.elastic.co/t/csv-plugin-problem/100070/2 "2017-09-11T18:31:29Z")

</div>

> My sample data is like this and my config file is below. data not converted properly.

Please show an example event produced by Logstash (use your `stdout {codec=>rubydebug}` output) and explain what's wrong about it.

---

<div class="post-metadata">

**Author:** ![avik\_ewu](https://avatars.discourse-cdn.com/v4/letter/a/a6a055/32.png) [@avik\_ewu](https://discuss.elastic.co/u/avik_ewu)\
**Post date:** [September 12, 2017, 12:16pm UTC](https://discuss.elastic.co/t/csv-plugin-problem/100070/3 "2017-09-12T12:16:25Z")

</div>

able to send data to the kibana now the problem is want to convert "-" into 0 . this is kibana output.  
![image|690x212](upload://6yYytbRwIjhRkzd4xJZExcm1

Logstash output:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/c/0c39ae6b61010dc82e4bd9cdec5ff54499255db0.png)

---

<div class="post-metadata">

**Author:** ![avik\_ewu](https://avatars.discourse-cdn.com/v4/letter/a/a6a055/32.png) [@avik\_ewu](https://discuss.elastic.co/u/avik_ewu)\
**Post date:** [September 12, 2017, 2:33pm UTC](https://discuss.elastic.co/t/csv-plugin-problem/100070/4 "2017-09-12T14:33:48Z")

</div>

I managed to solve this problem using gsub filter , now facing another issue adding timestamp .

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 10, 2017, 2:33pm UTC](https://discuss.elastic.co/t/csv-plugin-problem/100070/5 "2017-10-10T14:33:54Z")

</div>

Closed on October 10, 2017, 2:33pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.