# Is it mandatory to use web scrapper or just logstash to get data from public site

**URL:** <https://discuss.elastic.co/t/is-it-mandatory-to-use-web-scrapper-or-just-logstash-to-get-data-from-public-site/210019>\
**Category:** Logstash\
**Created:** [November 30, 2019, 8:18am UTC](https://discuss.elastic.co/t/is-it-mandatory-to-use-web-scrapper-or-just-logstash-to-get-data-from-public-site/210019 "2019-11-30T08:18:00Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![kumar4](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kumar4/32/48326_2.png) [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Post date:** [November 30, 2019, 8:18am UTC](https://discuss.elastic.co/t/is-it-mandatory-to-use-web-scrapper-or-just-logstash-to-get-data-from-public-site/210019/1 "2019-11-30T08:18:00Z")

</div>

a question asked by many people, in fact is it possible to ingest data from an internet sales website, is it mandatory to use web scrapper or just logstash can be configured to retrieve articles posted on a site in real time. if this is possible plz can you tell me how to do it (plugin or tierce app or configuration)  
thank you in advance

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 30, 2019, 9:12am UTC](https://discuss.elastic.co/t/is-it-mandatory-to-use-web-scrapper-or-just-logstash-to-get-data-from-public-site/210019/2 "2019-11-30T09:12:40Z")

</div>

I do not think Logstash is the right tool for that. You need a web scraper.

---

<div class="post-metadata">

**Author:** ![kumar4](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kumar4/32/48326_2.png) [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Post date:** [November 30, 2019, 12:31pm UTC](https://discuss.elastic.co/t/is-it-mandatory-to-use-web-scrapper-or-just-logstash-to-get-data-from-public-site/210019/3 "2019-11-30T12:31:13Z")

</div>

ok so i need a web scrapper then i will wonfigure the logstash to read from the utput of the web scrapper

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 28, 2019, 12:31pm UTC](https://discuss.elastic.co/t/is-it-mandatory-to-use-web-scrapper-or-just-logstash-to-get-data-from-public-site/210019/4 "2019-12-28T12:31:27Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.