File have error and access log


(ramy george) #1

Good Morning Everyone i have a problem this my code
input {
file {
path =>"/home/ramy/log"
start_position => "beginning"
codec => multiline {
pattern => "^\s\t"
what => "previous"
negate => "true"
auto_flush_interval =>5
}
}
my log file contain both error and access i can't handle it because he treat every data is multiline while i want him to detect if it line make a specific grok else use another grok method can you help me how to do that ?


(Magnus Bäck) #2

Please show an example of the kind of log you want to parse.


(ramy george) #3

Hey Magnus Sorry For Late Comment This Is My Jboss Code how to make input deal with line and multiline ?

2015-08-06 14:51:07,451 INFO [io.undertow.websockets.jsr] (ServerService Thread Pool -- 58) UT026003: Adding annoated server
2015-08-06 14:55:02,223 ERROR [com.codingexplained.blog.service.PostServiceImpl] (default task -- 06) Post Not Found (ID: 1)
at com.amazonaws.auth.AbstractAWSSinger.signAndBase64Encode(AbstractAWSSinger.java:71)
at com.amazonaws.auth.AbstractAWSSinger.signAndBase64Encode(AbstractAWSSinger.java:55)
at com.amazonaws.auth.QueryStringSinger.sign(QueryStringSinger.java:83)
at com.amazonaws.auth.QueryStringSinger.sign(QueryStringSinger.java:46)
at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:238)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:170)
at com.amazonaws.services.sqs.AmazonSQSClient.invoke(AmazonSQSClient.java:766)
at com.amazonaws.services.sqs.AmazonSQSClient.listQueues(AmazonSQSClient.java:564)
at com.amazonaws.services.sqs.AmazonSQSClient.listQueues(AmazonSQSClient.java:732)
at com.base2services.jenkins.SqsProfile.createQueue(SqsProfile.java:72)
at com.base2services.jenkins.SqsProfile.createQueue(SqsProfile.java:62)
at com.base2services.jenkins.SqsQueueHandler.doRun(SqsQueueHandler.java:37)
at hudson.triggers.SafeTimerTask.run(SafeTimeTask.java:54)
at java.util.TimerThread.mainLoop(Timer.java:555)
at java.util.TimerThread.run(Timer.java.505)
Caused by: com.amazonaws.AmazonClientException: Unable to calculate a request signature: Empty key
at com.amazonaws.auth.AbstractAWSSinger.sign(AbstractAWSSinger.java:90)
at com.amazonaws.auth.AbstractAWSSinger.signAndBase64Encode(AbstractAWSSinger.java:68)
... 14 more
Caused by: java.lang.IllegalArgumentException: Empty key
at java.crypto.spec.SecureKeySpec.(SecureKeySpec.java:96)
at com.amazonaws.auth.AbstractAWSSinger.sign(AbstractAWSSinger.java:87)
.. 15 more


(Magnus Bäck) #4

See https://www.elastic.co/guide/en/logstash/6.4/multiline.html for an example of how to deal with multiline messages that begin with a timestamp.


(system) #5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.