# Web crawler for elastic leatest versions

**URL:** <https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260>\
**Category:** Elasticsearch\
**Created:** [December 18, 2017, 3:02pm UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260 "2017-12-18T15:02:47Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![elitzur\_e](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/elitzur_e/32/48445_2.png) [@elitzur\_e](https://discuss.elastic.co/u/elitzur_e)\
**Post date:** [December 18, 2017, 3:02pm UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260/1 "2017-12-18T15:02:47Z")

</div>

Hi guys,  
i have been looking around for a solution to replace the now dead ,google on premise solution.  
i really want to use a solution based on ES. though i can’t seem to find a crawler for the job.  
i saw a few projects like river web and others.  
tho non of them seems to be compliant with ES 5+  
does any one know of a good crawler that works with the latest ES? (preferably .net)

thanks:slight\_smile:

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 18, 2017, 3:26pm UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260/2 "2017-12-18T15:26:04Z")

</div>

The official solution from elastic is now [https://swiftype.com/](https://swiftype.com/) which can replace basically GSA or GSS. Specifically see [https://swiftype.com/enterprise-search](https://swiftype.com/enterprise-search)

HTH

---

<div class="post-metadata">

**Author:** ![elitzur\_e](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/elitzur_e/32/48445_2.png) [@elitzur\_e](https://discuss.elastic.co/u/elitzur_e)\
**Post date:** [December 20, 2017, 9:27am UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260/3 "2017-12-20T09:27:38Z")

</div>

Thanks.  
it seems that swiftype web crawler solution is a cloud solution. i need to find an on premise solution. any suggestions?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 20, 2017, 3:47pm UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260/4 "2017-12-20T15:47:24Z")

</div>

I think this might be interesting: [Dec 20th, 2017: [EN][Elasticsearch] Build your own Google with Elasticsearch and Gopa](https://discuss.elastic.co/t/dec-20th-2017-en-elasticsearch-build-your-own-google-with-elasticsearch-and-gopa/112340)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 17, 2018, 3:47pm UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260/5 "2018-01-17T15:47:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.