Skip Header

===============================================================================================
DATE TIME | COMPONENT |SVR| THREAD NAME | MESSAGE

14/02/2018 13:11:34:722|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,5374,2018-02-14,null,639155141696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:12:41:429|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3842,2018-02-14,null,639155142696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:13:31:178|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,4385,2018-02-14,null,639155143696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:14:28:802|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3595,2018-02-14,null,639155144696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:14:42:040|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,2818,2018-02-14,null,639155145696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:14:56:800|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,4896,2018-02-14,null,639155146696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:15:09:715|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3043,2018-02-14,null,639155147696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:15:21:399|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3176,2018-02-14,null,639155148696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:15:34:094|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3446,2018-02-14,null,639155149696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:15:53:393|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3246,2018-02-14,null,639155150696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:16:09:703|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,4715,2018-02-14,null,639155151696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:16:22:784|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,5062,2018-02-14,null,639155152696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:16:44:624|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3912,2018-02-14,null,639155153696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:16:57:282|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3037,2018-02-14,null,639155154696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:17:10:705|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3107,2018-02-14,null,639155155696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:17:28:311|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3156,2018-02-14,null,639155156696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:17:41:444|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3272,2018-02-14,null,639155157696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:17:54:607|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,2659,2018-02-14,null,639155158696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:18:06:516|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,2709,2018-02-14,null,639155159696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 13:18:37:154|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,3310,2018-02-14,null,639155160696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null
14/02/2018 15:37:22:447|MessagingRepository |INF|RGS-Nayaz-LT,MessagingBroker,PhilMoOptServlet,MO Request,11637,2018-02-14,null,639155161696,null,null,null,null,1,120,0,null,SUCCESS##MO Response : [200],null

This is my log file i want to ignore the lines below

===============================================================================================
DATE TIME | COMPONENT |SVR| THREAD NAME | MESSAGE

Please help me resolve this issue i am new to logstash

input{
file{
path => "V:/cc/7.7/mcs_7_indonesia_dev/mpower/out/log/MessagingBroker_access.log"
start_position => "beginning"
sincedb_path => "/dev/null"
}
}

output {
elasticsearch {
action => "index"
hosts => ["localhost:9200"]
index => "access_log"
document_type => "access_logs"
}

stdout { }
}
Above is config file

You can drop{} lines that match a pattern. For example,

if [message] =~ "[=]+" or [message] =~ "^DATE TIME" { drop {} }

Thanks for the quick reply its resolved the problem

i want to skip 14/02/2018 13:11:34:722|MessagingRepository |INF| this in every line. above is my sample data.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.