Meaning of some log lines of filebeat


(VijayKarthikeyan) #1

What exactly these lines meant for?

"2016-11-23T21:50:43-08:00 INFO Loading Prospectors completed. Number of prospectors: 1
2016-11-23T21:50:43-08:00 INFO All prospectors are initialised and running with 0 states to persist
2016-11-23T21:50:43-08:00 DBG Starting prospector 0
2016-11-23T21:50:43-08:00 INFO Starting prospector of type: log
2016-11-23T21:50:43-08:00 DBG Start next scan
2016-11-23T21:50:43-08:00 DBG Prospector states cleaned up. Before: 0, After: 0
2016-11-23T21:50:48-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:50:53-08:00 DBG Run prospector
2016-11-23T21:50:53-08:00 DBG Start next scan
2016-11-23T21:50:53-08:00 DBG Prospector states cleaned up. Before: 0, After: 0
2016-11-23T21:50:53-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:50:58-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:03-08:00 DBG Run prospector
2016-11-23T21:51:03-08:00 DBG Start next scan
2016-11-23T21:51:03-08:00 DBG Prospector states cleaned up. Before: 0, After: 0
2016-11-23T21:51:03-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:08-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:13-08:00 INFO No non-zero metrics in the last 30s
2016-11-23T21:51:13-08:00 DBG Run prospector
2016-11-23T21:51:13-08:00 DBG Start next scan
2016-11-23T21:51:13-08:00 DBG Prospector states cleaned up. Before: 0, After: 0
2016-11-23T21:51:13-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:18-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:23-08:00 DBG Run prospector
2016-11-23T21:51:23-08:00 DBG Start next scan
2016-11-23T21:51:23-08:00 DBG Prospector states cleaned up. Before: 0, After: 0
2016-11-23T21:51:23-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:28-08:00 DBG Flushing spooler because of timeout. Events flushed: 0
2016-11-23T21:51:33-08:00 DBG Run prospector
"

Can some one explain me?

I am getting these lines in my log files again and again.


(ruflin) #2

This is debug log output from filebeat. It shows what filebeat is doing in the background. Were you looking for something specific?


(VijayKarthikeyan) #3

i am working with filebeat to process the log files and send the output to either elasticsearch or logstash or a file.

But when I run the filebeat, nothing happens. Except that the above mentioned logs lines were filling.


(ruflin) #4

Can you share your config file?


(VijayKarthikeyan) #5

Hi Ruflin,

Below is the config file i have.

input {
file {
path => [ "C:\Users\547213\elk\MySQLLogs\LOGS for ELK\ERRORLOG.LOG" ]
start_position => "beginning"
codec => multiline {
pattern => "^%{TIMESTAMP_ISO8601} "
negate => true
what => previous
}
}
}

filter {
grok {
match => { 'message' => '%{TIMESTAMP_ISO8601}%{SPACE}%{WORD:Level}%{SPACE}%{GREEDYDATA:DatabaseMessage}' }
}
}

output {
elasticsearch { hosts => ["localhost:9200"] }
stdout { codec => rubydebug }
}


(ruflin) #6

That is the LS config file. Can you share the filebeat one?


(system) #7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.