Can logstash parse same type of multiple log files?

Elastic Stack Logstash
1

Hello,

I have a question regarding the multiple log files (of similar type) parsing by logstash.
Scenario :-
My application generate log files every day,(2 log files in a day) by the name of intranet-YYYY-MM-DD-PORT.log like below:-

intranet-2021-02-23-8400.log
intranet-2021-02-23-8401.log

All these logs are generate in a folder.

My need is to parse these logs files every day to send it to elastic and prepare the graphs/visualization.

Basically from the logs I want to know how many error per day application is generating, how much time application is taking to restart every day etc....

Any help will be highly appreciated.

Thanks in advance.

2

I am not sure what you are asking.
But also consider using filebeat.
Cheers!

3

Hello AClerk,
Thanks for your reply.
My need is that I want to inject/push logs data every day from the log folder to elasticsearch and based on daily log data I want to create visualization.
For the moment I have C:\ELK\intralogs where I place all the logs like below

intranet-2021-02-20-8400
intranet-2021-02-21-8400
intranet-2021-02-22-8400
intranet-2021-02-23-8400
intranet-2021-02-24-8400

intranet-2021-02-28-8400

When I execute logstash it just ready & parse only one log file (ie intranet-2021-02-20-8400).
Just to let you know I created an index pattern where I I just see the data from only one log ( for example intranet-2021-02-20-8400)
So my question is how to parse and send all the log files on daily basis to elasticsearch so that my index pattern also keeps updating with latest logs.?

4

As I wrote,
I am not sure about logstash. But with filebeat, you can achieve your solution easily.
Thanks

5

Thanks A Clerk.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.