# Logstash Parsing Error

**URL:** <https://discuss.elastic.co/t/logstash-parsing-error/19752>\
**Category:** Elasticsearch\
**Created:** [September 12, 2014, 8:27am UTC](https://discuss.elastic.co/t/logstash-parsing-error/19752 "2014-09-12T08:27:01Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Atul\_K](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/atul_k/32/29543_2.png) [@Atul\_K](https://discuss.elastic.co/u/Atul_K)\
**Post date:** [September 12, 2014, 8:27am UTC](https://discuss.elastic.co/t/logstash-parsing-error/19752/1 "2014-09-12T08:27:01Z")

</div>

I am parsing a logfile using logstash. But somehow logstash is not parsing  
whole log file

attaching the error dump.  
I have also attached the my logstash config file. Please help

root@ryudt-023:/etc/logstash/

> conf.d# /opt/logstash/bin/logstash agent -f akamai-log.conf  
> Using milestone 2 input plugin 'file'. This plugin should be stable, but  
> if you see strange behavior, please let us know! For more information on  
> plugin milestones, see  
> [Logstash: Collect, Parse, Transform Logs | Elastic](http://logstash.net/docs/1.4.2-modified/plugin-milestones) {:level=\>:warn}  
> Using milestone 2 filter plugin 'urldecode'. This plugin should be stable,  
> but if you see strange behavior, please let us know! For more information  
> on plugin milestones, see  
> [Logstash: Collect, Parse, Transform Logs | Elastic](http://logstash.net/docs/1.4.2-modified/plugin-milestones) {:level=\>:warn}  
> Using milestone 2 filter plugin 'json'. This plugin should be stable, but  
> if you see strange behavior, please let us know! For more information on  
> plugin milestones, see  
> [Logstash: Collect, Parse, Transform Logs | Elastic](http://logstash.net/docs/1.4.2-modified/plugin-milestones) {:level=\>:warn}  
> Trouble parsing json {:source=\>"message",  
> :raw=\>"index.php","reqQuery":"path=%2F..%2Fboot.ini............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................%00.&route=product%2Fcategory","respCT":"text/html","respLen":"286","bytes":"286","UA":"mozilla-earth","fwdHost":"  
> [origin-demo2-akamaized.scoe-sil.net](http://origin-demo2-akamaized.scoe-sil.net)"},"reqHdr":{"accEnc":"gzip,  
> deflate","cookie":"PHPSESSID=no94vbt0q4hc33ncv9oeog16b3"},"respHdr":{"date":"Tue,  
> 08 Jul 2014 22:14:44 GMT","expires":"Tue, 08 Jul 2014 22:14:44  
> GMT","server":"AkamaiGHost","setCookie":""},"netPerf":{"downloadTime":"5","lastMileRTT":"95","cacheStatus":"0","firstByte":"1","lastByte":"1","asnum":"12222","edgeIP":"8.18.42.173"},"geo":{"country":"US","region":"CA","city":"SANFRANCISCO"},"waf":{"ver":"2.0","policy":"qik1\_12418","ruleVer":"2.2.6","mode":"nrm","rsr":"0","dor":"1","oft":"0","riskGroups":"","riskTuples":"","riskScores":"","pAction":"","pRate":"","warnRules":"3000002","warnData":"Ym9vdC5pbmk=","warnSlrs":"ARGS:path","denyRules":"950005","denyData":"Ym9vdC5pbmk="}}",  
> :exception=\>#\<JSON::ParserError: unexpected token at  
> 'index.php","reqQuery":"path=%2F..%2Fboot.ini............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................%00.&route=product%2Fcategory","respCT":"text/html","respLen":"286","bytes":"286","UA":"mozilla-earth","fwdHost":"  
> [origin-demo2-akamaized.scoe-sil.net](http://origin-demo2-akamaized.scoe-sil.net)"},"reqHdr":{"accEnc":"gzip,  
> deflate","cookie":"PHPSESSID=no94vbt0q4hc33ncv9oeog16b3"},"respHdr":{"date":"Tue,  
> 08 Jul 2014 22:14:44 GMT","expires":"Tue, 08 Jul 2014 22:14:44  
> GMT","server":"AkamaiGHost","setCookie":""},"netPerf":{"downloadTime":"5","lastMileRTT":"95","cacheStatus":"0","firstByte":"1","lastByte":"1","asnum":"12222","edgeIP":"8.18.42.173"},"geo":{"country":"US","region":"CA","city":"SANFRANCISCO"},"waf":{"ver":"2.0","policy":"qik1\_12418","ruleVer":"2.2.6","mode":"nrm","rsr":"0","dor":"1","oft":"0","riskGroups":"","riskTuples":"","riskScores":"","pAction":"","pRate":"","warnRules":"3000002","warnData":"Ym9vdC5pbmk=","warnSlrs":"ARGS:path","denyRules":"950005","denyData":"Ym9vdC5pbmk="}}'\>,  
> :level=\>:warn}  
> Exception in filterworker {"exception"=\>#\<TypeError: can't convert Fixnum  
> into String\>, "backtrace"=\>["org/jruby/RubyString.java:3898:in `[]='", "/opt/logstash/lib/logstash/util/accessors.rb:40:in `set'",  
> "/opt/logstash/lib/logstash/event.rb:138:in `[]='", "/opt/logstash/lib/logstash/filters/mutate.rb:272:in `convert'",  
> "org/jruby/RubyHash.java:1339:in `each'", "/opt/logstash/lib/logstash/filters/mutate.rb:255:in `convert'",  
> "/opt/logstash/lib/logstash/filters/mutate.rb:209:in `filter'", "(eval):75:in `initialize'", "org/jruby/RubyProc.java:271:in `call'", "/opt/logstash/lib/logstash/pipeline.rb:262:in `filter'",  
> "/opt/logstash/lib/logstash/pipeline.rb:203:in `filterworker'", "/opt/logstash/lib/logstash/pipeline.rb:143:in `start\_filters'"],  
> :level=\>:error}  
> log4j, [2014-09-12T12:22:06.304] WARN:  
> org.elasticsearch.discovery.zen.ping.unicast:  
> [logstash-ryudt-023-5023-4010] failed to send ping to  
> [[#zen\_unicast\_5#][ryudt-023][inet[localhost/127.0.0.1:9304]]]  
> org.elasticsearch.transport.ReceiveTimeoutTransportException:  
> [inet[localhost/127.0.0.1:9304]][discovery/zen/unicast] request\_id [2]  
> timed out after [3751ms]  
> at  
> org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:356)  
> at  
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
> at  
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
> at java.lang.Thread.run(Thread.java:745)  
> log4j, [2014-09-12T12:22:06.304] WARN:  
> org.elasticsearch.discovery.zen.ping.unicast:  
> [logstash-ryudt-023-5023-4010] failed to send ping to  
> [[#zen\_unicast\_6#][ryudt-023][inet[localhost/127.0.0.1:9305]]]  
> org.elasticsearch.transport.ReceiveTimeoutTransportException:  
> [inet[localhost/127.0.0.1:9305]][discovery/zen/unicast] request\_id [5]  
> timed out after [3750ms]  
> at  
> org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:356)  
> at  
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
> at  
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
> at java.lang.Thread.run(Thread.java:745)

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/647c756b-4913-44e3-85d2-c2583175932e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/647c756b-4913-44e3-85d2-c2583175932e%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 12, 2014, 8:33am UTC](https://discuss.elastic.co/t/logstash-parsing-error/19752/2 "2014-09-12T08:33:17Z")

</div>

You should really ask that on the logstash group -  
[https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users](https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users)

Regards,  
Mark Walkom

Infrastructure Engineer  
Campaign Monitor  
email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
web: [www.campaignmonitor.com](http://www.campaignmonitor.com)

On 12 September 2014 18:27, Atul K [atulnkhairnar@gmail.com](mailto:atulnkhairnar@gmail.com) wrote:

> I am parsing a logfile using logstash. But somehow logstash is not parsing  
> whole log file
> 
> attaching the error dump.  
> I have also attached the my logstash config file. Please help
> 
> root@ryudt-023:/etc/logstash/
> 
> > conf.d# /opt/logstash/bin/logstash agent -f akamai-log.conf  
> > Using milestone 2 input plugin 'file'. This plugin should be stable, but  
> > if you see strange behavior, please let us know! For more information on  
> > plugin milestones, see [Logstash Reference [8.11] | Elastic](http://logstash.net/docs/1.4).  
> > 2-modified/plugin-milestones {:level=\>:warn}  
> > Using milestone 2 filter plugin 'urldecode'. This plugin should be  
> > stable, but if you see strange behavior, please let us know! For more  
> > information on plugin milestones, see [Logstash Reference [8.11] | Elastic](http://logstash.net/docs/1.4).  
> > 2-modified/plugin-milestones {:level=\>:warn}  
> > Using milestone 2 filter plugin 'json'. This plugin should be stable, but  
> > if you see strange behavior, please let us know! For more information on  
> > plugin milestones, see [Logstash Reference [8.11] | Elastic](http://logstash.net/docs/1.4).  
> > 2-modified/plugin-milestones {:level=\>:warn}  
> > Trouble parsing json {:source=\>"message", :raw=\>"index.php","reqQuery  
> > ":"path=%2F..%2Fboot.ini...................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > .....%00.&route=product%2Fcategory","respCT":"  
> > text/html","respLen":"286","bytes":"286","UA":"  
> > mozilla-earth","fwdHost":"origin-demo2-akamaized.scoe-sil.net  
> > "},"reqHdr":{"accEnc":"gzip, deflate","cookie":"PHPSESSID=  
> > no94vbt0q4hc33ncv9oeog16b3"},"respHdr":{"date":"Tue, 08 Jul 2014  
> > 22:14:44 GMT","expires":"Tue, 08 Jul 2014 22:14:44 GMT","server":"  
> > AkamaiGHost","setCookie":""},"netPerf":{"downloadTime":"5","  
> > lastMileRTT":"95","cacheStatus":"0","  
> > firstByte":"1","lastByte":"1","asnum":"12222","  
> > edgeIP":"8.18.42.173"},"geo":{"country":"US","  
> > region":"CA","city":"SANFRANCISCO"},"waf":{"  
> > ver":"2.0","policy":"qik1\_12418","ruleVer":"2.  
> > 2.6","mode":"nrm","rsr":"0","dor":"1","oft":  
> > "0","riskGroups":"","riskTuples":"","  
> > riskScores":"","pAction":"","pRate":"","  
> > warnRules":"3000002","warnData":"Ym9vdC5pbmk=","  
> > warnSlrs":"ARGS:path","denyRules":"950005","  
> > denyData":"Ym9vdC5pbmk="}}", :exception=\>#\<JSON::ParserError:  
> > unexpected token at 'index.php","reqQuery":"path=%  
> > 2F..%2Fboot.ini.............................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > ............................................................  
> > .......................................................%00.&  
> > route=product%2Fcategory","respCT":"text/html","respLen":  
> > "286","bytes":"286","UA":"mozilla-earth","fwdHost":"orig  
> > [in-demo2-akamaized.scoe-sil.net](http://in-demo2-akamaized.scoe-sil.net)"},"reqHdr":{"accEnc":"gzip,  
> > deflate","cookie":"PHPSESSID=no94vbt0q4hc33ncv9oeog16b3"},"respHdr":{"date":"Tue,  
> > 08 Jul 2014 22:14:44 GMT","expires":"Tue, 08 Jul 2014 22:14:44  
> > GMT","server":"AkamaiGHost","setCookie":""},"netPerf":{"  
> > downloadTime":"5","lastMileRTT":"95","cacheStatus":"0","firstByte":"  
> > 1","lastByte":"1","asnum":"12222","edgeIP":"8.18.42.173"}  
> > ,"geo":{"country":"US","region":"CA","city":"  
> > SANFRANCISCO"},"waf":{"ver":"2.0","policy":"qik1\_12418","  
> > ruleVer":"2.2.6","mode":"nrm","rsr":"0","dor":"1","oft":"0",  
> > "riskGroups":"","riskTuples":"","riskScores":"","pAction":""  
> > ,"pRate":"","warnRules":"3000002","warnData":"Ym9vdC5pbmk=","warnSlrs":"  
> > ARGS:path","denyRules":"950005","denyData":"Ym9vdC5pbmk="}}'\>,  
> > :level=\>:warn}  
> > Exception in filterworker {"exception"=\>#\<TypeError: can't convert Fixnum  
> > into String\>, "backtrace"=\>["org/jruby/RubyString.java:3898:in `[]='", "/opt/logstash/lib/logstash/util/accessors.rb:40:in `set'",  
> > "/opt/logstash/lib/logstash/event.rb:138:in `[]='", "/opt/logstash/lib/logstash/filters/mutate.rb:272:in `convert'",  
> > "org/jruby/RubyHash.java:1339:in `each'", "/opt/logstash/lib/logstash/filters/mutate.rb:255:in `convert'", "/opt/logstash/lib/logstash/filters/mutate.rb:209:in  
> > `filter'", "(eval):75:in `initialize'", "org/jruby/RubyProc.java:271:in  
> > `call'", "/opt/logstash/lib/logstash/pipeline.rb:262:in `filter'",  
> > "/opt/logstash/lib/logstash/pipeline.rb:203:in `filterworker'", "/opt/logstash/lib/logstash/pipeline.rb:143:in `start\_filters'"],  
> > :level=\>:error}  
> > log4j, [2014-09-12T12:22:06.304] WARN: org.elasticsearch.discovery.zen.ping.unicast:  
> > [logstash-ryudt-023-5023-4010] failed to send ping to  
> > [[#zen\_unicast\_5#][ryudt-023][inet[localhost/127.0.0.1:9304]]]  
> > org.elasticsearch.transport.ReceiveTimeoutTransportException:  
> > [inet[localhost/127.0.0.1:9304]][discovery/zen/unicast] request\_id [2]  
> > timed out after [3751ms]  
> > at org.elasticsearch.transport.TransportService$TimeoutHandler.run(  
> > TransportService.java:356)  
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(  
> > ThreadPoolExecutor.java:1145)  
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(  
> > ThreadPoolExecutor.java:615)  
> > at java.lang.Thread.run(Thread.java:745)  
> > log4j, [2014-09-12T12:22:06.304] WARN: org.elasticsearch.discovery.zen.ping.unicast:  
> > [logstash-ryudt-023-5023-4010] failed to send ping to  
> > [[#zen\_unicast\_6#][ryudt-023][inet[localhost/127.0.0.1:9305]]]  
> > org.elasticsearch.transport.ReceiveTimeoutTransportException:  
> > [inet[localhost/127.0.0.1:9305]][discovery/zen/unicast] request\_id [5]  
> > timed out after [3750ms]  
> > at org.elasticsearch.transport.TransportService$TimeoutHandler.run(  
> > TransportService.java:356)  
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(  
> > ThreadPoolExecutor.java:1145)  
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(  
> > ThreadPoolExecutor.java:615)  
> > at java.lang.Thread.run(Thread.java:745)
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/647c756b-4913-44e3-85d2-c2583175932e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/647c756b-4913-44e3-85d2-c2583175932e%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/647c756b-4913-44e3-85d2-c2583175932e%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/647c756b-4913-44e3-85d2-c2583175932e%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624ZD%2Bqw-a01ZVE2B05uxDAoseV-y%2BzvR9zo\_DSiiYA%2BSTA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624ZD%2Bqw-a01ZVE2B05uxDAoseV-y%2BzvR9zo_DSiiYA%2BSTA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:02am UTC](https://discuss.elastic.co/t/logstash-parsing-error/19752/3 "2017-07-06T01:02:49Z")

</div>


