I am using filebeat to monitor a directory for new files that get dropped in every hour. The files are then sent to logstash to be parsed before being sent to ES. The filenames are in this format aldb-E6-20201015232941.csv or possibly aldbE6-20201015232941.csv I need to be extract the data aldb an…

You could do that using grok grok { match => { "[log][file][path]" => "/(?<firstBit>.{4})(-)?(?<secondBit>.{2})-\d+\.%{WORD}$" } }

Discuss the Elastic Stack

How to extract data from filename using logstash?

Elastic Stack Logstash

reillye (Eoin) December 2, 2020, 4:46pm 3

That works, thanks!

Topic		Replies	Views
Extract file name and add as a field Logstash	3	2741	September 18, 2021
How to extract logstash log.file.path for filter Logstash	2	1321	July 30, 2020
Extract source filename in logstash received from Filebeat Logstash	2	1185	October 21, 2017
Extracting filename from log.file.path not working Logstash	9	11699	April 2, 2020
Help with file name to date logstash grok Logstash	3	319	September 21, 2023

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

How to extract data from filename using logstash?

Related topics