All web crawler executions failed

I've run the web crawler 8 times and only the first run was successful. The other 7 failed.

I also configured Kibana logs according to the link [1] but there is no explanation in the log as to why the failure. Apparently, the web crawler works and fails abruptly.

How can I find the reason for the failure?

[1] View web crawler events logs | Elastic App Search Documentation [7.15] | Elastic

Do the logs indicate that a crawl gets started?

Also, have you checked log/crawler.log? Do you see something there?

Apparently the crawl starts, as shown the attached image.
It runs for a few hours, stops and in the "Recent crawl requests" table, it is displayed as failed.

How can I check log/crawler.log ? I am using the cloud version (https://www.elastic.co/).

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.