# If fscrawler is stopped before finishing an index, when it restarts, will it start from the beginning?

**URL:** <https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787>\
**Category:** Elasticsearch\
**Created:** [September 17, 2019, 8:31am UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787 "2019-09-17T08:31:32Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![neergttocsdivad](https://avatars.discourse-cdn.com/v4/letter/n/43a26b/32.png) [@neergttocsdivad](https://discuss.elastic.co/u/neergttocsdivad)\
**Post date:** [September 17, 2019, 8:31am UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787/1 "2019-09-17T08:31:32Z")

</div>

. . . . or will it restart from where it was stopped?

The 'CLI options' of the fscrawler manual states that `--restart` restarts a job from scratch. This suggests that the default is to restart from where the fscrawler was stopped.

I have just noticed that although the Kibana Index Management 'docs count' has not changed since fscrawler was restarted, the storage size HAS increased, suggesting that files ARE being indexed.

Is there some way of causing the 'docs count' to refresh?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [September 18, 2019, 6:51pm UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787/2 "2019-09-18T18:51:25Z")

</div>

I think that if it did not finish entirely one run, it will restart from the beginning.

---

<div class="post-metadata">

**Author:** ![neergttocsdivad](https://avatars.discourse-cdn.com/v4/letter/n/43a26b/32.png) [@neergttocsdivad](https://discuss.elastic.co/u/neergttocsdivad)\
**Post date:** [September 22, 2019, 8:37am UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787/3 "2019-09-22T08:37:48Z")

</div>

It has happened again, but this time look at the elasticsearch-head display  
the docs count shows two numbers . . . . the static 4.3M and the updating 4.4M  
This appears to be reflected in the two kibana screenshots showing a static count but increasing storage size.  
May I assume that the index is being updated ?  
Can you suggest how the kibana doc count may be brought back to life ?

 ![3](https://us1.discourse-cdn.com/elastic/original/3X/e/f/ef0eeb56f804dab6a44fd5002bf8668ebaafd8c3.jpeg)  
 ![2](https://us1.discourse-cdn.com/elastic/original/3X/5/e/5e5b17efa28845bfad2673a21e78d6ab656cddc4.jpeg) ![1](https://us1.discourse-cdn.com/elastic/original/3X/e/e/ee182ea00c819f558959568a5d2e55177feb328b.jpeg)

---

<div class="post-metadata">

**Author:** ![neergttocsdivad](https://avatars.discourse-cdn.com/v4/letter/n/43a26b/32.png) [@neergttocsdivad](https://discuss.elastic.co/u/neergttocsdivad)\
**Post date:** [September 24, 2019, 1:12pm UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787/4 "2019-09-24T13:12:34Z")

</div>

what is the purpose/value of the two 'docs' values?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [September 27, 2019, 9:28am UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787/5 "2019-09-27T09:28:11Z")

</div>

Hard to say. I did not use HEAD plugin for a long time.  
I'd just trust:

```auto
GET index/_search?size=0

```

To get the current count of documents.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 25, 2019, 9:28am UTC](https://discuss.elastic.co/t/if-fscrawler-is-stopped-before-finishing-an-index-when-it-restarts-will-it-start-from-the-beginning/199787/6 "2019-10-25T09:28:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
