# CSV file with mutated fields does not get indexed

**URL:** <https://discuss.elastic.co/t/csv-file-with-mutated-fields-does-not-get-indexed/36854>\
**Category:** Logstash\
**Created:** [December 10, 2015, 9:45am UTC](https://discuss.elastic.co/t/csv-file-with-mutated-fields-does-not-get-indexed/36854 "2015-12-10T09:45:45Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Kranthi\_Paidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kranthi_paidi/32/5257_2.png) [@Kranthi\_Paidi](https://discuss.elastic.co/u/Kranthi_Paidi)\
**Post date:** [December 10, 2015, 9:45am UTC](https://discuss.elastic.co/t/csv-file-with-mutated-fields-does-not-get-indexed/36854/1 "2015-12-10T09:45:45Z")

</div>

Hi,  
I am pretty new to ELK stack. We are trying to build some performance test result dashboards by indexing results csv fils. I am trying to index a .csv file with columns mutated to float data types. Here is my config file:

input {  
file {  
path =\> "C:\Test4\Beacon&Ecommerce.csv"  
start\_position =\> beginning

```
}

```

}  
filter {  
csv {  
columns =\> [  
"Minute\_of\_Test",  
"Time",  
"EC\_T01\_BrowsingCatalouge\_Homepage",  
"EC\_T01\_CreateNewOrderLink\_Homepage",  
"EC\_T01\_ViewOrderHistory\_Homepage",  
"EC\_T02\_BrowsingCatalouge\_Login",  
"EC\_T02\_CreateNewOrderLink\_Login",  
"EC\_T02\_ViewOrderHistory\_Login",  
"EC\_T03\_BrowsingCatalouge\_ClickOnTestProduct",  
"EC\_T03\_CreateNewOrderLink\_ClickNewOrder",  
"EC\_T03\_ViewOrderHistory\_ClickOrderHistory",  
"EC\_T04\_BrowsingCatalouge\_LogOff",  
"EC\_T04\_CreateNewOrderLink\_EnterDetailsClickNext",  
"EC\_T04\_ViewOrderHistory\_ClickViewOrder",  
"EC\_T05\_CreateNewOrderLink\_ClickSubmitOrder",  
"EC\_T05\_QuerySavedOrders\_LogOff",  
"EC\_T06\_CreateNewOrderLink\_LogOff",  
"FetchAcountDetails",  
"Order\_History\_User\_Search\_for\_Order\_History",  
"Order\_Request\_Order\_Simulate",  
"Order\_Request\_Order\_Submit",  
"Practice\_Search\_Against\_SAP",  
"Search\_and\_Load\_Practice\_I3"  
]  
separator =\> ","  
remove\_field =\> ["message"]  
}  
date{  
match=\>["Time","yyyy-MM-dd HH:mm:ss"]  
}  
mutate {  
convert =\> {  
"Minute\_of\_Test"=\>"integer"  
"EC\_T01\_BrowsingCatalouge\_Homepage"=\>"float"  
"EC\_T01\_CreateNewOrderLink\_Homepage"=\>"float"  
"EC\_T01\_ViewOrderHistory\_Homepage"=\>"float"  
"EC\_T02\_BrowsingCatalouge\_Login"=\>"float"  
"EC\_T02\_CreateNewOrderLink\_Login"=\>"float"  
"EC\_T02\_ViewOrderHistory\_Login"=\>"float"  
"EC\_T03\_BrowsingCatalouge\_ClickOnTestProduct"=\>"float"  
"EC\_T03\_CreateNewOrderLink\_ClickNewOrder"=\>"float"  
"EC\_T03\_ViewOrderHistory\_ClickOrderHistory"=\>"float"  
"EC\_T04\_BrowsingCatalouge\_LogOff"=\>"float"  
"EC\_T04\_CreateNewOrderLink\_EnterDetailsClickNext"=\>"float"  
"EC\_T04\_ViewOrderHistory\_ClickViewOrder"=\>"float"  
"EC\_T05\_CreateNewOrderLink\_ClickSubmitOrder"=\>"float"  
"EC\_T05\_QuerySavedOrders\_LogOff"=\>"float"  
"EC\_T06\_CreateNewOrderLink\_LogOff"=\>"float"  
"FetchAcountDetails"=\>"float"  
"Order\_History\_User\_Search\_for\_Order\_History"=\>"float"  
"Order\_Request\_Order\_Simulate"=\>"float"  
"Order\_Request\_Order\_Submit"=\>"float"  
"Practice\_Search\_Against\_SAP"=\>"float"  
"Search\_and\_Load\_Practice\_I3"=\>"float"  
}  
}

}

output {  
elasticsearch {  
action =\> "index"  
index =\> "soasta\_result\_1"  
}  
stdout { }  
}

Logstash says my config file is OK. But, it doesn't index the data into elasticsearch. Can you please let me know where I am going wrong?

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [December 10, 2015, 10:19am UTC](https://discuss.elastic.co/t/csv-file-with-mutated-fields-does-not-get-indexed/36854/2 "2015-12-10T10:19:32Z")

</div>

Logstash is probably waiting for more data to be added to Beacon&Ecommerce.csv. Unless Logstash is seeing a file for the first time `start_position => beginning` doesn't matter.

Disable the elasticsearch output for now and just use a `stdout { codec => rubydebug }` output. When that proves to give the output you need you can enable the elasticsearch output again. Practice divide and conquer.

---

<div class="post-metadata">

**Author:** ![Kranthi\_Paidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kranthi_paidi/32/5257_2.png) [@Kranthi\_Paidi](https://discuss.elastic.co/u/Kranthi_Paidi)\
**Post date:** [December 10, 2015, 6:01pm UTC](https://discuss.elastic.co/t/csv-file-with-mutated-fields-does-not-get-indexed/36854/3 "2015-12-10T18:01:05Z")

</div>

Thank you, Magnus.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:18am UTC](https://discuss.elastic.co/t/csv-file-with-mutated-fields-does-not-get-indexed/36854/4 "2017-07-06T05:18:59Z")

</div>


