Hi, I have managed to get my ELK stack up and ruining which filters logs using grok and passes data to elasticsearch
and allows me to visualize in Kibana.
I have completed the above task by using one log file and passes data with logstash to one index in elasticsearch :
yellow open logstash-2016.10.19 5 1 1000807 0 364.8mb 364.8mb
What I actually want to do
If i have the following logs files which are named according to Year,Month and Date
MyLog-2016-10-16.log MyLog-2016-10-17.log MyLog-2016-10-18.log MyLog-2016-11-05.log MyLog-2016-11-02.log MyLog-2016-11-03.log
I would like to tell logstash to read by Year,Month and Date and create the following indexes :
yellow open MyLog-2016-10-16.log 5 1 1000807 0 364.8mb 364.8mb
yellow open MyLog-2016-10-17.log 1 1000807 0 364.8mb 364.8mb
yellow open MyLog-2016-10-18.log 5 1 1000807 0 364.8mb 364.8mb
yellow open MyLog-2016-11-05.log 5 1 1000807 0 364.8mb 364.8mb
yellow open MyLog-2016-11-02.log 5 1 1000807 0 364.8mb 364.8mb
yellow open MyLog-2016-11-03.log 5 1 1000807 0 364.8mb 364.8mb
Please could I have some guidance as to how do i need to go about doing this ?