# New Document not getting added by fscrawler

**URL:** <https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472>\
**Category:** Elasticsearch\
**Created:** [December 19, 2019, 11:20am UTC](https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472 "2019-12-19T11:20:54Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![mdr\_8](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@mdr\_8](https://discuss.elastic.co/u/mdr_8)\
**Post date:** [December 19, 2019, 11:20am UTC](https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472/1 "2019-12-19T11:20:54Z")

</div>

I have added 'Rule engine evaluation.docx' in c:\tmp\es  
I have run the 'touch' command for the above file.  
The file is not getting added in the index.

Following is the output for fscrawler job execution for the above file in debug mode

16:23:46,331 DEBUG [f.p.e.c.f.f.FsCrawlerUtil] computeVirtualPathName(C:\tmp\es, C:\tmp\es\Rule engine evaluation.docx) = /Rule engine evaluation.docx  
16:23:46,334 DEBUG [f.p.e.c.f.f.FsCrawlerUtil] directory = [false], filename = [/Rule engine evaluation.docx], includes = [null], excludes = [[_/~_]]  
16:23:46,344 DEBUG [f.p.e.c.f.f.FsCrawlerUtil] filename = [/Rule engine evaluation.docx], excludes = [[_/~_]]  
16:23:46,346 DEBUG [f.p.e.c.f.f.FsCrawlerUtil] filename = [/Rule engine evaluation.docx], includes = [null]  
16:23:46,354 DEBUG [f.p.e.c.f.FsParserAbstract] [/Rule engine evaluation.docx] can be indexed: [true]  
16:23:46,361 DEBUG [f.p.e.c.f.FsParserAbstract] - file: /Rule engine evaluation.docx  
16:23:46,363 DEBUG [f.p.e.c.f.FsParserAbstract] fetching content from [C:\tmp\es],[Rule engine evaluation.docx]  
16:23:46,370 DEBUG [f.p.e.c.f.f.FsCrawlerUtil] computeVirtualPathName(C:\tmp\es, C:\tmp\es\Rule engine evaluation.docx) = /Rule engine evaluation.docx  
16:23:47,138 DEBUG [f.p.e.c.f.FsParserAbstract] Indexing localfolder\_job/ec8359577293fd45f98652ffae354dd?pipeline=null

But actually the above document i.e. 'Rule engine evaluation.docx' is not added in the index (Not able to get it with elasticsearch '\_search' api)

I am executing fscrawler in Windows 10  
fscrawer version is - fscrawler-es7-2.7-20191210.051423-63  
elasticsearch version is - elasticsearch-7.3.0-windows-x86\_64

IF I restart the job then also the document is not going to get added in the index.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 19, 2019, 11:40am UTC](https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472/2 "2019-12-19T11:40:15Z")

</div>

Welcome!

How do you search for this document?  
Could you run the same test with `--trace` ?

---

<div class="post-metadata">

**Author:** ![mdr\_8](https://avatars.discourse-cdn.com/v4/letter/m/b9e5f3/32.png) [@mdr\_8](https://discuss.elastic.co/u/mdr_8)\
**Post date:** [December 19, 2019, 12:10pm UTC](https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472/3 "2019-12-19T12:10:22Z")

</div>

When I run the search API from tool like Postman with following url  
[http://localhost:9200/localfolder\_job/\_search](http://localhost:9200/localfolder_job/_search)  
It is not returning the above document in the result.

If I run with --trace still it is not adding the doc.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 19, 2019, 12:22pm UTC](https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472/4 "2019-12-19T12:22:35Z")

</div>

Please format your code, logs or configuration files using `</>` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21) and not the citation button. It will make your post more readable.

Or use markdown style like:

````
```
CODE
```

````

This is the icon to use if you are not using markdown format:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/e/7e6e239431ec2d71cbf1beef741f2e93e7cc762c.jpg)

There's a live preview panel for exactly this reasons.

Lots of people read these forums, and many of them will simply skip over a post that is difficult to read, because it's just too large an investment of their time to try and follow a wall of badly formatted text.  
If your goal is to get an answer to your questions, it's in your interest to make it as easy to read and understand as possible.  
Please update your post.

Could you share the full logs?  
Could you share the output of your search request?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 16, 2020, 12:22pm UTC](https://discuss.elastic.co/t/new-document-not-getting-added-by-fscrawler/212472/5 "2020-01-16T12:22:37Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
