# Crawling web content **URL:** \ **Category:** Elasticsearch\ **Created:** [February 20, 2013, 9:41am UTC](https://discuss.elastic.co/t/crawling-web-content/10814 "2013-02-20T09:41:04Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![yahia](https://avatars.discourse-cdn.com/v4/letter/y/d9b06d/32.png) [@yahia](https://discuss.elastic.co/u/yahia)\ **Post date:** [February 20, 2013, 9:41am UTC](https://discuss.elastic.co/t/crawling-web-content/10814/1 "2013-02-20T09:41:04Z")
does anybody have any experience crawling web content and indexing it with Elastic Search? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [February 20, 2013, 9:53am UTC](https://discuss.elastic.co/t/crawling-web-content/10814/2 "2013-02-20T09:53:10Z")
Perhaps this could help. I never used it myself. [http://manifoldcf.apache.org/release/release-1.1.1/en\_US/included-connectors.html](http://manifoldcf.apache.org/release/release-1.1.1/en_US/included-connectors.html) -- David Pilato | Technical Advocate | [Elasticsearch.com](http://Elasticsearch.com) @dadoonet | @elasticsearchfr | @scrutmydocs Le 20 févr. 2013 à 10:41, Ammar Yahia [yahia.ammar.info@gmail.com](mailto:yahia.ammar.info@gmail.com) a écrit : > does anybody have any experience crawling web content and indexing it with Elastic Search? > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [February 21, 2013, 6:48am UTC](https://discuss.elastic.co/t/crawling-web-content/10814/3 "2013-02-21T06:48:40Z")
Hi, Have a look at Nutch and ES: [http://search-lucene.com/?q=elasticsearch&fc\_project=Nutch&fc\_type=issue](http://search-lucene.com/?q=elasticsearch&fc_project=Nutch&fc_type=issue) ## Otis ES Performance Monitoring: > **[Elasticsearch - Sematext Documentation](https://sematext.com/docs/integration/elasticsearch-integration/)** > > Collect and monitor key Elasticsearch metrics such as request latency, indexing rate, and segment merges with built-in anomaly detection, threshold, and heartbeat alerts. Send notifications to email and various chatops messaging services, correlate... On Wednesday, February 20, 2013 4:41:04 AM UTC-5, Ammar Yahia wrote: > does anybody have any experience crawling web content and indexing it with > Elastic Search? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [February 21, 2013, 8:05am UTC](https://discuss.elastic.co/t/crawling-web-content/10814/4 "2013-02-21T08:05:46Z")
There is an Elasticsearch Indexer for Nutch [https://github.com/ctjmorgan/nutch-elasticsearch-indexer](https://github.com/ctjmorgan/nutch-elasticsearch-indexer) Jörg On Thursday, February 21, 2013 7:48:40 AM UTC+1, Otis Gospodnetic wrote: > Hi, > > Have a look at Nutch and ES: > [http://search-lucene.com/?q=elasticsearch&fc\_project=Nutch&fc\_type=issue](http://search-lucene.com/?q=elasticsearch&fc_project=Nutch&fc_type=issue) > > ## Otis > > ES Performance Monitoring: > [Elasticsearch Monitoring](http://sematext.com/spm/elasticsearch-performance-monitoring/index.html) > > On Wednesday, February 20, 2013 4:41:04 AM UTC-5, Ammar Yahia wrote: > > > does anybody have any experience crawling web content and indexing it > > with Elastic Search? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:50am UTC](https://discuss.elastic.co/t/crawling-web-content/10814/5 "2017-07-06T02:50:24Z")