I've run the web crawler 8 times and only the first run was successful. The other 7 failed.
I also configured Kibana logs according to the link [1] but there is no explanation in the log as to why the failure. Apparently, the web crawler works and fails abruptly.
How can I find the reason for the failure?
[1] View web crawler events logs | Elastic App Search Documentation [7.15] | Elastic
Do the logs indicate that a crawl gets started?
Also, have you checked log/crawler.log? Do you see something there?
Apparently the crawl starts, as shown the attached image.
It runs for a few hours, stops and in the "Recent crawl requests" table, it is displayed as failed.
How can I check log/crawler.log ? I am using the cloud version (https://www.elastic.co/).
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.
