How to get index contents of a website

I think you already asked for a similar question at Is Elasticsearch webcrawler an open source feature or it is paid?.

I believe it would be better to keep the discussion in one place.