I am new here for ELK(ElasticSearch,Logstash,kibana). I would like to know how logstash parse log files and upload into an ElasticSearch. Lets take an example, If I want to load around 250GB of log files data into an ElasticSearch from S3 storage by using logstash. In logstash how that log files are…

How logstash parse log files internally?

magnusbaeck (Magnus Bäck) May 16, 2018, 7:43pm 4

but if the files are downloaded locally then how it will be efficient?

Why would it not be efficient? What do you suggest instead?

Topic		Replies	Views
S3 logstah question Logstash	1	403	July 6, 2017
Parse Amazon S3 access log with multiple files Logstash	8	3075	July 6, 2017
Read slow for large files in S3? Logstash	5	981	July 6, 2017
Slow processing in Logstash with S3 input Logstash	1	1888	July 6, 2017
Speed up processing of logs Logstash	7	6518	April 26, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

How logstash parse log files internally?

Related topics