# Logstash stops loading text file into ES

**URL:** <https://discuss.elastic.co/t/logstash-stops-loading-text-file-into-es/31288>\
**Category:** Logstash\
**Created:** [September 28, 2015, 7:33pm UTC](https://discuss.elastic.co/t/logstash-stops-loading-text-file-into-es/31288 "2015-09-28T19:33:52Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![ankmathur14](https://avatars.discourse-cdn.com/v4/letter/a/7feea3/32.png) [@ankmathur14](https://discuss.elastic.co/u/ankmathur14)\
**Post date:** [September 28, 2015, 7:33pm UTC](https://discuss.elastic.co/t/logstash-stops-loading-text-file-into-es/31288/1 "2015-09-28T19:33:52Z")

</div>

I have many csv files each of 350MB in size and each having 1 Million lines.  
Data present in csv file is in json format  
e.g  
{"operatingsystem":"windows7","Arch":"64Bit","Program":"some.exe","IP":"0.0.0.0"}  
{"operatingsystem":"windows8","Arch":"32Bit","Program":"some.exe","IP":"0.0.0.0"}  
{"operatingsystem":"windows10","Arch":"64Bit","Program":"some.exe","IP":"0.0.0.0"}  
{"operatingsystem":"windows7","Arch":"32Bit","Program":"some.exe","IP":"0.0.0.0"}

Logstash stops reading these csv files after a while (~2-3 Hrs, ~2-3 Gb of data).  
Although no error comes from logstash or elasticssearch.

Config:

input {  
file {  
path=\> "D:\somepath\*.csv"  
position =\> "beginning"  
}  
}

filter {

```
json {
	source => "message"
}

geoip {
	......
}

date {
	.....
}

```

}

output {  
elasticssearch {  
.......  
}  
}

Logstash : 1.4, 1.5 (tried both)  
elasticssearch : 1.6  
Mapping : Dynamic  
Memory : 4 Gb to ES, default to Logstash  
Disk : HDD  
CPU : i5, 4 cores  
OS : Windows 8  
Indexing Rate : ~500 Docs/sec

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 29, 2015, 8:22am UTC](https://discuss.elastic.co/t/logstash-stops-loading-text-file-into-es/31288/2 "2015-09-29T08:22:15Z")

</div>

It might be painful but can you try with verbose or debug logging levels?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:27am UTC](https://discuss.elastic.co/t/logstash-stops-loading-text-file-into-es/31288/3 "2017-07-06T05:27:50Z")

</div>