# Grok failure, Grok debug OK

**URL:** <https://discuss.elastic.co/t/grok-failure-grok-debug-ok/240693>\
**Category:** Logstash\
**Created:** [July 10, 2020, 11:49am UTC](https://discuss.elastic.co/t/grok-failure-grok-debug-ok/240693 "2020-07-10T11:49:02Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Abdelhalim](https://avatars.discourse-cdn.com/v4/letter/a/838e76/32.png) [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Post date:** [July 10, 2020, 11:49am UTC](https://discuss.elastic.co/t/grok-failure-grok-debug-ok/240693/1 "2020-07-10T11:49:03Z")

</div>

Hello,

I am using grok to parse my logs, everything works in grok debugger in Kibana but when I use it in my pipeline it doesn't work!!

here is an example of my log:

` Jul 10 12:21:08 vselk-vyos kernel: [155099.389432] [ELK-IN-1-A] IN=eth1 OUT=eth0 MAC=00:0c:29:c1:78:1b:00:0c:29:b4:a3:af:08:00 SRC=10.13.81.30 DST=10.10.13.135 LEN=52 TOS=0x10 PREC=0x00 TTL=63 ID=62337 DF PROTO=TCP SPT=22 DPT=54140 WINDOW=501 RES=0x00 ACK URGP=0`

and here is my pipeline:

filter {  
grok {  
match =\> {  
"message" =\> [  
"%{SYSLOGTIMESTAMP:nf\_timestamp} %{HOSTNAME:nf\_host} kernel: [%{INT:port\_srouce}.%{INT:sourceccc}] [%{DATA:iptable\_rule}] IN=%{WORD:Interface\_entrer} OUT=%{WORD:interface\_sortie} MAC=%{DATA:MAC} SRC=%{IP:IP\_source} DST=%{IP:IP\_Dest} LEN=%{NUMBER:Pakcet\_Length} TOS=%{DATA:Type\_Of\_Service} PREC=%{DATA:Precedent\_bits} TTL=%{NUMBER:Time\_To\_Live} ID=%{NUMBER:Packet\_identifier} PROTO=%{WORD:Protocol} TYPE=%{NUMBER:Type} CODE=%{NUMBER:Code} ID=%{NUMBER:ID} SEQ=%{NUMBER:Sequence\_number}",  
"%{SYSLOGTIMESTAMP:nf\_timestamp} %{HOSTNAME:nf\_host} kernel: [%{INT:port\_srouce}.%{INT:sourceccc}] [%{DATA:iptable\_rule}] IN=%{WORD:Interface\_entrer} OUT=%{WORD:interface\_sortie} MAC=%{DATA:MAC} SRC=%{IP:IP\_source} DST=%{IP:IP\_Dest} LEN=%{NUMBER:Pakcet\_Length} TOS=%{DATA:Type\_Of\_Service} PREC=%{DATA:Precedent\_bits} TTL=%{NUMBER:Time\_To\_Live} ID=%{NUMBER:Packet\_identifier} %{WORD:Fragment\_Flag} PROTO=%{WORD:Protocol} TYPE=%{NUMBER:Type} CODE=%{NUMBER:Code} ID=%{NUMBER:ID} SEQ=%{NUMBER:Sequence\_number}",  
"**%{SYSLOGTIMESTAMP:nf\_timestamp} %{HOSTNAME:nf\_host} kernel: [%{INT:port\_srouce}.%{INT:sourceccc}] [%{DATA:iptable\_rule}] IN=%{WORD:Interface\_entrer} OUT=%{WORD:interface\_sortie} MAC=%{DATA:MAC} SRC=%{IP:IP\_source} DST=%{IP:IP\_Dest} LEN=%{NUMBER:Pakcet\_Length} TOS=%{DATA:Type\_Of\_Service} PREC=%{DATA:Precedent\_bits} TTL=%{NUMBER:Time\_To\_Live} ID=%{NUMBER:Packet\_identifier} %{WORD:fragment\_flag} PROTO=%{WORD:Protocol} SPT=%{NUMBER=source\_port} DPT=%{NUMBER:destination\_Port} WINDOW=%{NUMBER:Window\_size} RES=%{WORD:Reserved\_bytes} %{DATA:Connexion\_type} URGP=%{NUMBER:Urgent\_packet}**"]  
}  
}  
}

the line in strong is the line which is no working, could someone help me please !

Thank you

---

<div class="post-metadata">

**Author:** ![Jenni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jenni/32/29684_2.png) [@Jenni](https://discuss.elastic.co/u/Jenni)\
**Post date:** [July 11, 2020, 6:37pm UTC](https://discuss.elastic.co/t/grok-failure-grok-debug-ok/240693/2 "2020-07-11T18:37:13Z")

</div>

For that grok pattern I would suggest escaping the brackets and period as well as correcting the `NUMBER=source_port`:

`%{SYSLOGTIMESTAMP:nf_timestamp} %{HOSTNAME:nf_host} kernel: \[%{INT:port_srouce}\.%{INT:sourceccc}\] \[%{DATA:iptable_rule}\] IN=%{WORD:Interface_entrer} OUT=%{WORD:interface_sortie} MAC=%{DATA:MAC} SRC=%{IP:IP_source} DST=%{IP:IP_Dest} LEN=%{NUMBER:Pakcet_Length} TOS=%{DATA:Type_Of_Service} PREC=%{DATA:Precedent_bits} TTL=%{NUMBER:Time_To_Live} ID=%{NUMBER:Packet_identifier} %{WORD:fragment_flag} PROTO=%{WORD:Protocol} SPT=%{NUMBER:source_port} DPT=%{NUMBER:destination_Port} WINDOW=%{NUMBER:Window_size} RES=%{WORD:Reserved_bytes} %{DATA:Connexion_type} URGP=%{NUMBER:Urgent_packet}`

But further more I'd like to say that

- You've got some typos in the field names you chose.
- It would probably make it a lot easier to keep an overview if you only used grok for the first part of the log line and a KV filter for the rest and renamed the fields afterwards.  
`%{SYSLOGTIMESTAMP:nf_timestamp} %{HOSTNAME:nf_host} kernel: \[%{INT:port_srouce}\.%{INT:sourceccc}\] \[%{DATA:iptable_rule}\] %{GREEDYDATA:rest}`

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 10, 2020, 7:19am UTC](https://discuss.elastic.co/t/grok-failure-grok-debug-ok/240693/4 "2020-08-10T07:19:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.