# Web Crawler stucks in Pending status

**URL:** <https://discuss.elastic.co/t/web-crawler-stucks-in-pending-status/282784>\
**Category:** Elastic Search\
**Tags:** docker, elastic-app-search\
**Created:** [August 30, 2021, 8:35am UTC](https://discuss.elastic.co/t/web-crawler-stucks-in-pending-status/282784 "2021-08-30T08:35:34Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yuriy\_Stakhniak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yuriy_stakhniak/32/79051_2.png) [@Yuriy\_Stakhniak](https://discuss.elastic.co/u/Yuriy_Stakhniak)\
**Post date:** [August 30, 2021, 8:35am UTC](https://discuss.elastic.co/t/web-crawler-stucks-in-pending-status/282784/1 "2021-08-30T08:35:34Z")

</div>

Hey guys. I'm trying to execute several crawl jobs one after another. Each job starts in a different engine.  
The first job is working perfectly. After SUCCESS I delete the engine and create the new one where I try to start a new crawl job but the status of this job is always PENDING. The only way to get rid of this is to redeploy App Search. This behavior is reproduced in docker-compose deployment and in stand-alone deployment on EC2 instance.  
Do you have any suggestions what is the reason for this issue?

---

<div class="post-metadata">

**Author:** ![oleksiy-elastic](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/oleksiy-elastic/32/49074_2.png) [@oleksiy-elastic](https://discuss.elastic.co/u/oleksiy-elastic)\
**Post date:** [September 1, 2021, 4:27pm UTC](https://discuss.elastic.co/t/web-crawler-stucks-in-pending-status/282784/2 "2021-09-01T16:27:46Z")

</div>

When you start the second crawl, what does it say in the logs? There should be clear set of messages about the progress of a crawl request: it should be created when you click "start crawl", then it should be picked up by the CQM (crawl queue manager component of the product) and a new crawler worker should be started... If it always stays pending, that could mean that the solution has no more capacity (crawler worker threads) left and you need to wait for active crawls to finish or that the CQM is dead (which would be bad, but should never happen).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 29, 2021, 4:28pm UTC](https://discuss.elastic.co/t/web-crawler-stucks-in-pending-status/282784/3 "2021-09-29T16:28:16Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
