Web Crawler input for logstash

Hi All,

Is their available plugin for webcrawler.

If their any please let me now configuration steps.


If you explain the requirements in a little bit more detail maybe someone will be able to help out.

You can check out this post on how to use Scrapy to get web scraped content into Elasticsearch: http://blog.florian-hopf.de/2014/07/scrapy-and-elasticsearch.html