[Logstash Performance]


(Varun Kumar) #1

I am running logstash with the following config

input {
file{
path => "D:/Log//MIP/"
start_position => "beginning"

}

}

filter{
mutate{
gsub => ["path","D:/Log/", ""]
}

}

output {
stdout {
codec => line {
format => "%{path}"
}
}

            file{
		path => "Z:/Logs/%{host}/%{path}"
		message_format => "%{message}"
		flush_interval => 0

}

}

The input log file location is as follows
D:\Log\3c238437-5e11-4c5c-bb16-c757794543b1\MIP\MipLogger.log

The file size is 84.7 MB

I am seeing its taking more than 30 minutes to get the output in the resultant shared location .Am I doing something wrong .If not what is the issue .

Below is my computer config

Windows 8
Processor Intel(R) Core(TM) i7-4900MQ CPU
RAM 16 GB


(Varun Kumar) #2

Hello,
Can I have any update on this issue.


(Christian Dahlqvist) #3

If you are looking for performance, you should probably not flush after every message, which is what setting the 'flush interval' to 0 does. Stick with the default settings and comment out the stdout output and see what impact that has.


(system) #4