Node stats api result after dropping the logs


(ssh) #1

hi all

may i ask one thing.

i use node stats api to check event counts and duration time for logstash pipeline performance.

pipeline config eg is:

filter {
if "Exception" in [message] {
grok {
# exceptions
match => { "message" => [ "^(?<log_timestamp>\d{4}-\d{2}-\d{2}\s\d{2}:\d{2}:\d{2},\d{1,3}).?(?\d+).?%{WORD:log_level}"]}
add_field => { "api_code" => "blablabla" }
add_field => { "log_type" => "SYSTEM_ERROR" }
}
}
else {
drop {
percentage => 100
}
}
}

then i ship 200 log to logstash
target is: match log 100 ship and un-match log 100 drop

but node stats api show me

{
"host" : "UAT-LOGSTASH-02",
"version" : "6.1.1",
"http_address" : "127.0.0.1:9600",
"id" : "e87b9426-b9d5-4fad-9360-27791cf13ca3",
"name" : "UAT-LOGSTASH-02",
"events" : {
"in" : 200,
"filtered" : 200,
"out" : 200,
"duration_in_millis" : 2761,
"queue_push_duration_in_millis" : 93
}
}

and kibana show me my target 100 hits.

so, my question is that why node api show "out" : 200?
and is drop filter plugin actual drop?

appreciate if someone explain me!! :slight_smile:


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.