# Logstash never processes some csv files

**URL:** <https://discuss.elastic.co/t/logstash-never-processes-some-csv-files/58613>\
**Category:** Logstash\
**Created:** [August 22, 2016, 7:47pm UTC](https://discuss.elastic.co/t/logstash-never-processes-some-csv-files/58613 "2016-08-22T19:47:38Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![AscendingRivers](https://avatars.discourse-cdn.com/v4/letter/a/e68b1a/32.png) [@AscendingRivers](https://discuss.elastic.co/u/AscendingRivers)\
**Post date:** [August 22, 2016, 7:47pm UTC](https://discuss.elastic.co/t/logstash-never-processes-some-csv-files/58613/1 "2016-08-22T19:47:38Z")

</div>

I have a very simple setup for Logstash 2.3.2 to process CSV files. But some of the files never get processed. This topic has been discussed elsewhere on this forum, but not solved that I can see. (Each CSV has a newline at the end of each file.)

I keep getting debug messages that contain the following line:

`file grew: /Users/Eric/dev/data/test_long.csv: old size 0, new size 207272`

If I copy a few lines out of the problem file and save them in a new file, they get processed successfully. Although, it is interesting to note that the debug message I see indicates that there is more to be processed in the file:

`file grew: /Users/Eric/dev/data/test.csv: old size` **4773** , `new size` **5049**

The logstash conf file I'm using is very simple:

```
input {
	file {
		path => "/Users/Eric/dev/data/*.csv"
		start_position => "beginning"
		ignore_older => 0
	}
}

filter {
	csv {
	    separator => ","
	}
}

output {
	stdout {
		codec => rubydebug
	}
}

```

Setup:  
Mac Pro, OS X El Capitan , Version 10.11.6  
Java SE Runtime Environment (build 1.8.0.\_31-b13)  
Logstash version 2.3.2 (installed using 'brew install logstash')

Thanks in advance for your feedback.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [August 22, 2016, 7:49pm UTC](https://discuss.elastic.co/t/logstash-never-processes-some-csv-files/58613/2 "2016-08-22T19:49:29Z")

</div>

What does the sincedb file say about this file, i.e. where does Logstash think its position is?

---

<div class="post-metadata">

**Author:** ![AscendingRivers](https://avatars.discourse-cdn.com/v4/letter/a/e68b1a/32.png) [@AscendingRivers](https://discuss.elastic.co/u/AscendingRivers)\
**Post date:** [August 22, 2016, 7:52pm UTC](https://discuss.elastic.co/t/logstash-never-processes-some-csv-files/58613/3 "2016-08-22T19:52:57Z")

</div>

Sorry, I forgot to note in my initial post that I am deleting the sincedb file before every attempt.

If I look at it after the run, I see:  
26084373 1 15 4773  
26084410 1 15 0

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:42am UTC](https://discuss.elastic.co/t/logstash-never-processes-some-csv-files/58613/4 "2017-07-06T04:42:10Z")

</div>