I've run the web crawler 8 times and only the first run was successful. The other 7 failed.
I also configured Kibana logs according to the link  but there is no explanation in the log as to why the failure. Apparently, the web crawler works and fails abruptly.
How can I find the reason for the failure?
 View web crawler events logs | Elastic App Search Documentation [7.15] | Elastic
Do the logs indicate that a crawl gets started?
Also, have you checked
log/crawler.log? Do you see something there?
Apparently the crawl starts, as shown the attached image.
It runs for a few hours, stops and in the "Recent crawl requests" table, it is displayed as failed.
How can I check
log/crawler.log ? I am using the cloud version (https://www.elastic.co/).
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.