# Web Crawler input for logstash **URL:** \ **Category:** Logstash\ **Created:** [June 22, 2015, 4:26am UTC](https://discuss.elastic.co/t/web-crawler-input-for-logstash/24052 "2015-06-22T04:26:14Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Dan](https://avatars.discourse-cdn.com/v4/letter/d/eada6e/32.png) [@Dan](https://discuss.elastic.co/u/Dan)\ **Post date:** [June 22, 2015, 4:26am UTC](https://discuss.elastic.co/t/web-crawler-input-for-logstash/24052/1 "2015-06-22T04:26:14Z")
Hi All, Is their available plugin for webcrawler. If their any please let me now configuration steps. Thanks, Dan. ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [June 24, 2015, 8:06pm UTC](https://discuss.elastic.co/t/web-crawler-input-for-logstash/24052/2 "2015-06-24T20:06:57Z")
If you explain the requirements in a little bit more detail maybe someone will be able to help out. ---
**Author:** ![jrgns](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jrgns/32/640_2.png) [@jrgns](https://discuss.elastic.co/u/jrgns)\ **Post date:** [August 28, 2015, 6:57am UTC](https://discuss.elastic.co/t/web-crawler-input-for-logstash/24052/3 "2015-08-28T06:57:09Z")
You can check out this post on how to use Scrapy to get web scraped content into Elasticsearch: [http://blog.florian-hopf.de/2014/07/scrapy-and-elasticsearch.html](http://blog.florian-hopf.de/2014/07/scrapy-and-elasticsearch.html) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 5:30am UTC](https://discuss.elastic.co/t/web-crawler-input-for-logstash/24052/4 "2017-07-06T05:30:44Z")