I am trying to process the Service API request logs and trying to data to elasticsearch
A sample line from my logs look like
"22.214.171.124 - - [13/May/2017:08:50:35 +0000] \"GET /ContentStorageService/coss-test-bucket/resources HTTP/1.1\" 200 272584 \"-\" \"Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36\" 166"
I want the following data to go in elaticsearch in in the following format
IP -> 126.96.36.199 Request Type -> 'GET /ContentStorageService/coss-test-bucket/resources HTTP/1.1\" Status -> '200' TIME -> 272584
I tried many filters but looks like I couldn't fit any of them into my need.
Is there any suggestion / recommendation for this kind of log processing.
Is there any filter made for this specific task.