I have many csv files each of 350MB in size and each having 1 Million lines. Data present in csv file is in json format e.g {"operatingsystem":"windows7","Arch":"64Bit","Program":"some.exe","IP":"0.0.0.0"} {"operatingsystem":"windows8","Arch":"32Bit","Program":"some.exe","IP":"0.0.0.0"} {"opera…

Logstash stops loading text file into ES

warkolm (Mark Walkom) September 29, 2015, 8:22am 2

It might be painful but can you try with verbose or debug logging levels?

Topic		Replies	Views
Logstash/Elasticsearch Slow CSV Import Elasticsearch	5	1558	July 5, 2017
Elasticsearch Logstash importing very large JSON files Logstash	4	4823	July 6, 2017
Logstash is not loading data to elasticsearch Logstash	3	3537	July 6, 2017
To give input to ELasticsearch via logstash Logstash	5	1265	July 6, 2017
Feed Data to Elastic Serach Via Logstash using CSV Logstash	4	1454	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Logstash stops loading text file into ES

Related topics