Can Elastic Web Crawler fetch HTTP response headers

Elastic Search
1

Hi all,

can the Elastic Web Crawler fetch HTTP response headers of a HTML resource to get headers like Content-Length or other?

Regards

Sebastian

2

HI @sebastianboelling ,

As of now crawler not fetching HTTP Response headers.

You can check web-crawler-reference-content-discovery

Thanks

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.