Using Elastic Search to Crawl Web Pages with Query Parameters


(Vikram Srivatsa) #1

Hi,

I am new to Elastic Stack and we are planning to do a Proof of Concept with Elastic Stack to evaluate if it meets our Search Engine Needs.

One of the key requirements we have is to be able to crawl websites that have pages having Query Parameters.
Sample URL: http://healthlibrary.epnet.com/GetContent.aspx?token=3bb6e77f-7239-4082-81fb-4aeb0064ca19&chunkiid=23625

Does Elastic Stack support crawling of such URLs?

Also for the POC, is it possible to setup all components of the Elastic Stack on a single Windows Server?

Thanks,
Vikram


(Mark Walkom) #2

Elasticsearch is passive, it doesn't reach out and do this sort of thing.
So you need something to do the crawling.

Yes!


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.