# Logstash grok filter to generate priority number in logs

**URL:** <https://discuss.elastic.co/t/logstash-grok-filter-to-generate-priority-number-in-logs/215114>\
**Category:** Logstash\
**Created:** [January 15, 2020, 10:44am UTC](https://discuss.elastic.co/t/logstash-grok-filter-to-generate-priority-number-in-logs/215114 "2020-01-15T10:44:35Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![BIs1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bis1/32/60811_2.png) [@BIs1](https://discuss.elastic.co/u/BIs1)\
**Post date:** [January 15, 2020, 10:44am UTC](https://discuss.elastic.co/t/logstash-grok-filter-to-generate-priority-number-in-logs/215114/1 "2020-01-15T10:44:35Z")

</div>

Hi Everyone,

I am very new to Elastic Stack so I have very less knowledge regarding Logstash grok filter. Basically I am trying to get the logs with priority number so that syslog\_pri {} plugin will generate all the necessary fields in ES. Firewall logs already contains priority code and its easy but I am struggling with application logs like kafka, nifi and hadoop which comes with no pri and I don`t know if its even possible as the logs are different. I know its not upto logastash to generate pri code on logs but is it possible or do anyone know how to do that in application ? Currently using version 7.3.1 version logstash, ES and kibana same across. As an example I am listing the logs I am getting from all the components.

**NIFI LOG**

2020-01-14 11:34:48,769 INFO [NiFi Web Server-91] org.apache.nifi.web.filter.RequestLogger Attempting request for (anonymous) GET [http://10.X.X.X:9999/nifi-api/flow/cluster/summary](http://10.X.X.X:9999/nifi-api/flow/cluster/summary) (source ip: 10.X.X.X)

**HADOOP LOG**

2020-01-15 10:26:07,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Cache Size Before Clean: 0, Total Deleted: 0, Public Deleted: 0, Private Deleted: 0

**KAFKA LOG**

2020-01-15 10:25:33,106] DEBUG [Controller id=0] Topics not in preferred replica for broker 0 Map() (kafka.controller.KafkaController)

**FIREWALL LOG with pri \<189\>**

\<189\>date=2020-01-15 time=10:10:20 devname="FIREWALL389" devid="FIREWALL389" logid="0001000014" type="traffic" subtype="local" level="notice" vd="root" eventtime=1579083020 srcip=fe80::f602:70ff:fe9f:e9aa srcport=5353 srcintf="mgmt" srcintfrole="lan" dstip=ff02::fb dstport=5353 dstintf=unknown-0 dstintfrole="undefined" sessionid=338794 proto=17 action="deny" policyid=0 policytype="local-in-policy6" service="udp/5353" dstcountry="Reserved" srccountry="Reserved" trandisp="noop" app="udp/5353" duration=0 sentbyte=0 rcvdbyte=0 sentpkt=0 rcvdpkt=0 appcat="unscanned"

**Logstash config for firewall:**

input {  
udp {  
port =\> 1514  
type =\> "syslog"

}  
}

filter {  
if [type] == "syslog" {  
grok {  
match =\> { "message" =\> ["\<%{NUMBER:syslog\_pri}\>%{GREEDYDATA:Log-message}"] }  
}  
syslog\_pri {}  
}  
}

output {  
elasticsearch {  
hosts =\> "10.X.X.X:9200"  
index =\> "firewall"  
user =\> elastic  
password =\> password  
document\_type =\> "syslogs"  
}  
}

**GROK filter is generating all these fields from firewall logs with pri \<189\>**

syslog\_facility: local7  
syslog\_facility\_code: 23  
syslog\_pri: 189  
syslog\_severity: notice  
syslog\_severity\_code: 5  
type: syslog

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 12, 2020, 10:44am UTC](https://discuss.elastic.co/t/logstash-grok-filter-to-generate-priority-number-in-logs/215114/2 "2020-02-12T10:44:40Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.