we have created index to show documents count & document names.
Successfully done with index creation but when we checked on our kibana console in discover tab data is coming for documents name only but no any data is available for doc count .
We are using rsync method to take log file on kibana server also no any issue faced while doing rsync /autoexpect steps .
Attaching the log patterns screenshot .
---> please find below added logstash code which we are using to show doc counts:
input {
file
{
path =>["/log/CORRUPTION/Node_23.35/corrupted_docs_count.txt]
sincedb_path => "/dev/null"
start_position => "beginning"
tags => ["corruptioncount"]
}
}
filter {
if "corruptioncount" in [tags]
{
grok {
match => { "message" => "(?<corruption_count>[0-9]{0,30})" }
}
}
}
output { }