# Filebeat & logstash Grok patterns

**URL:** <https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340>\
**Category:** Logstash\
**Created:** [March 28, 2017, 5:45pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340 "2017-03-28T17:45:48Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ravikumar\_G](https://avatars.discourse-cdn.com/v4/letter/r/71e660/32.png) [@Ravikumar\_G](https://discuss.elastic.co/u/Ravikumar_G)\
**Post date:** [March 28, 2017, 5:45pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340/1 "2017-03-28T17:45:48Z")

</div>

Hi I went through all the documents available in online have I'm sure I'm doing small mistake some were

I'm unable to see follow log in kibana dashboard

I'm transporting via filebeat to logstash

else if "drive.db" in [source] {  
grok {  
break\_on\_match =\> true  
match =\> { "message" =\> ") %{GREEDYDATA:msg}" }  
}

}

40401-01 plugins]# cat /var/log/drive.db

# Drive Database - this file is auto-generated. Do not edit.

# Slot, Serial , State , First Seen, Fail Time , Failure Source

boot24, 6XM4WYY2, Ok , 1477000831  
boot25, 6XM136KD, Ok , 1477000831  
slot00, WXC1E32JRYH9, Ok , 1477000831  
slot01, WXK1E32AUNKN, Ok , 1477000831  
slot02, WXK1E32AURFJ, Ok , 1477000831  
slot03, WXK1E32AUNFW, Ok , 1477000831  
slot04, WXF1E32TVYH2, Ok , 1477000831  
slot05, WX41EA1UVZ38, Ok , 1477000831  
slot06, WXF1E32TJFJ8, Ok , 1477000831  
slot07, WX91EC1AAYR6, Ok , 1477000831  
slot08, WXK1E32CETRD, Ok , 1477000831  
slot09, WXC1E32DUJH7, Ok , 1477000831  
slot10, WXC1E32JRXZ7, Ok , 1477000831  
slot11, WXF1E32TWEV7, Ok , 1477000831  
slot12, 2720A00NFRD2, Ok , 1490129238  
slot13, WXF1E32TVRK5, Ok , 1477000831  
slot14, WXC1E32KZUD6, Ok , 1477000831  
slot15, WXF1E32TVZJ3, Ok , 1477000831  
slot16, WXF1E32TWAN7, Ok , 1477000831  
slot17, WXF1E32TWWD8, Ok , 1477000831  
slot18, WXC1E32JRRK2, Ok , 1477000831  
slot19, WXC1E32JRMY5, Ok , 1477000831  
slot20, WXK1E32XVUR9, Ok , 1477000831  
slot21, WXF1E32TWFH5, Ok , 1477000831  
slot22, WXK1E32AJYUF, Ok , 1477000831  
slot23, WXF1E32TVTM4, Ok , 1477000831

# Historical Drive info

# Slot, Serial , State , First Seen, Fail Time , Failure Source

-- , WXF1E32LYWR1, FAILED, 1477000831, 1483934430, Dell  
[root@ccdn-ats-tk-40401-01 plugins]#

---

<div class="post-metadata">

**Author:** ![Silen\_logs](https://avatars.discourse-cdn.com/v4/letter/s/ed655f/32.png) [@Silen\_logs](https://discuss.elastic.co/u/Silen_logs)\
**Post date:** [March 28, 2017, 6:17pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340/2 "2017-03-28T18:17:04Z")

</div>

Hi,

Test this:

else if "drive.db" in [source] {  
grok {  
break\_on\_match =\> true  
match =\> { "message" =\> "%{GREEDYDATA:msg}" }

```
    }

```

}

I just remove the ")" in the line **_match =\> { "message" =\> "%{GREEDYDATA:msg}" }_**

---

<div class="post-metadata">

**Author:** ![Ravikumar\_G](https://avatars.discourse-cdn.com/v4/letter/r/71e660/32.png) [@Ravikumar\_G](https://discuss.elastic.co/u/Ravikumar_G)\
**Post date:** [March 28, 2017, 7:25pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340/3 "2017-03-28T19:25:59Z")

</div>

> [@Silen\_logs](#):
>
> else if "drive.db" in [source] {grok {break\_on\_match =\> truematch =\> { "message" =\> "%{GREEDYDATA:msg}" }
> 
> ```
> }
> 
> ```
> 
> }

thanks for you reply its was by mistake wrong copy paste of mine I do not have ")"  
however able to see logs in kibana but not in correct order I need complete messege

{code}  
@timestamp March 28th 2017, 15:18:46.363  
t @version 1  
t \_id AVsWj8ItElKBWXhcGycu  
t \_index logstash-2017.03.28

# \_score -

t \_type logs  
t beat.hostname ccdn-ats-tk-40401-01.hostname  
t beat.name ccdn-ats-tk-40401-01.hostname  
t beat.version 5.0.0  
t host ccdn-ats-tk-40401-01.hostname  
t input\_type log  
t message # Drive Database - this file is auto-generated. Do not edit.  
t msg # Drive Database - this file is auto-generated. Do not edit.

# offset 61

t source /var/log/drive.db

{code}

---

<div class="post-metadata">

**Author:** ![Ravikumar\_G](https://avatars.discourse-cdn.com/v4/letter/r/71e660/32.png) [@Ravikumar\_G](https://discuss.elastic.co/u/Ravikumar_G)\
**Post date:** [March 28, 2017, 8:24pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340/4 "2017-03-28T20:24:33Z")

</div>

I think i may need to add more lines in pattrens

# Drive Database - this file is auto-generated. Do not edit.

# Slot, Serial , State , First Seen, Fail Time , Failure Source

boot24, 6XM4WYY2, Ok , 1477000831  
boot25, 6XM136KD, Ok , 1477000831  
slot00, WXC1E32JRYH9, Ok , 1477000831  
slot01, WXK1E32AUNKN, Ok , 1477000831  
slot02, WXK1E32AURFJ, Ok , 1477000831  
slot03, WXK1E32AUNFW, Ok , 1477000831  
slot04, WXF1E32TVYH2, Ok , 1477000831  
slot05, WX41EA1UVZ38, Ok , 1477000831  
slot06, WXF1E32TJFJ8, Ok , 1477000831  
slot07, WX91EC1AAYR6, Ok , 1477000831  
slot08, WXK1E32CETRD, Ok , 1477000831  
slot09, WXC1E32DUJH7, Ok , 1477000831  
slot10, WXC1E32JRXZ7, Ok , 1477000831  
slot11, WXF1E32TWEV7, Ok , 1477000831  
slot12, 2720A00NFRD2, Ok , 1490129238  
slot13, WXF1E32TVRK5, Ok , 1477000831  
slot14, WXC1E32KZUD6, Ok , 1477000831  
slot15, WXF1E32TVZJ3, Ok , 1477000831  
slot16, WXF1E32TWAN7, Ok , 1477000831  
slot17, WXF1E32TWWD8, Ok , 1477000831  
slot18, WXC1E32JRRK2, Ok , 1477000831  
slot19, WXC1E32JRMY5, Ok , 1477000831  
slot20, WXK1E32XVUR9, Ok , 1477000831  
slot21, WXF1E32TWFH5, Ok , 1477000831  
slot22, WXK1E32AJYUF, Ok , 1477000831  
slot23, WXF1E32TVTM4, Ok , 1477000831

# Historical Drive info

# Slot, Serial , State , First Seen, Fail Time , Failure Source

-- , WXF1E32LYWR1, FAILED, 1477000831, 1483934430, Dell

---

<div class="post-metadata">

**Author:** ![Ravikumar\_G](https://avatars.discourse-cdn.com/v4/letter/r/71e660/32.png) [@Ravikumar\_G](https://discuss.elastic.co/u/Ravikumar_G)\
**Post date:** [March 29, 2017, 3:24pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340/5 "2017-03-29T15:24:54Z")

</div>

> [@Ravikumar\_G](#):
>
> boot24, 6XM4WYY2, Ok , 1477000831boot25, 6XM136KD, Ok , 1477000831slot00, WXC1E32JRYH9, Ok , 1477000831slot01, WXK1E32AUNKN, Ok , 1477000831slot02, WXK1E32AURFJ, Ok , 1477000831slot03, WXK1E32AUNFW, Ok , 1477000831slot04, WXF1E32TVYH2, Ok , 1477000831slot05, WX41EA1UVZ38, Ok , 1477000831slot06, WXF1E32TJFJ8, Ok , 1477000831slot07, WX91EC1AAYR6, Ok , 1477000831slot08, WXK1E32CETRD, Ok , 1477000831slot09, WXC1E32DUJH7, Ok , 1477000831slot10, WXC1E32JRXZ7, Ok , 1477000831slot11, WXF1E32TWEV7, Ok , 1477000831slot12, 2720A00NFRD2, Ok , 1490129238slot13, WXF1E32TVRK5, Ok , 1477000831slot14, WXC1E32KZUD6, Ok , 1477000831slot15, WXF1E32TVZJ3, Ok , 1477000831slot16, WXF1E32TWAN7, Ok , 1477000831slot17, WXF1E32TWWD8, Ok , 1477000831slot18, WXC1E32JRRK2, Ok , 1477000831slot19, WXC1E32JRMY5, Ok , 1477000831slot20, WXK1E32XVUR9, Ok , 1477000831slot21, WXF1E32TWFH5, Ok , 1477000831slot22, WXK1E32AJYUF, Ok , 1477000831slot23, WXF1E32TVTM4, Ok , 1477000831

Not sure what but I'm able to see all drive status in kibana but I would like to remove last 3 lines from ingesting reason it will count as failed metric

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 26, 2017, 3:25pm UTC](https://discuss.elastic.co/t/filebeat-logstash-grok-patterns/80340/6 "2017-04-26T15:25:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
