# How to start with fscrawler?

**URL:** <https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293>\
**Category:** Elasticsearch\
**Created:** [October 27, 2018, 3:45pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293 "2018-10-27T15:45:49Z")\
**Posts on this page:** 14\
**Page:** 1

<div class="post-metadata">

**Author:** ![Technical\_Stuffer\_S](https://avatars.discourse-cdn.com/v4/letter/t/41988e/32.png) [@Technical\_Stuffer\_S](https://discuss.elastic.co/u/Technical_Stuffer_S)\
**Post date:** [October 27, 2018, 3:45pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/1 "2018-10-27T15:45:49Z")

</div>

actually i have installed fscrawler 2.5 zipped file and after unzipping it ,when i opened the (.bat) file it could not opened and from there i am unable to understand whats going wron.....

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 27, 2018, 5:10pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/2 "2018-10-27T17:10:44Z")

</div>

Run fscrawler from the command line. It will probably tell you something.

---

<div class="post-metadata">

**Author:** ![Technical\_Stuffer\_S](https://avatars.discourse-cdn.com/v4/letter/t/41988e/32.png) [@Technical\_Stuffer\_S](https://discuss.elastic.co/u/Technical_Stuffer_S)\
**Post date:** [October 28, 2018, 9:45am UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/3 "2018-10-28T09:45:10Z")

</div>

Pls give me the commands to run.....  
I HV typed fscrawler on the command line but it's showing errors

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 28, 2018, 10:47am UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/4 "2018-10-28T10:47:25Z")

</div>

Which errors?

---

<div class="post-metadata">

**Author:** ![Technical\_Stuffer\_S](https://avatars.discourse-cdn.com/v4/letter/t/41988e/32.png) [@Technical\_Stuffer\_S](https://discuss.elastic.co/u/Technical_Stuffer_S)\
**Post date:** [November 4, 2018, 7:06am UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/5 "2018-11-04T07:06:42Z")

</div>

this is the output i am getting.....  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/1/d/1d6c34bc469b5e0eda76f84eb311047ba6446d81.jpeg)

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 4, 2018, 8:02am UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/6 "2018-11-04T08:02:21Z")

</div>

What you do not understand in the message?  
Please read: [https://fscrawler.readthedocs.io/en/fscrawler-2.5/user/getting\_started.html#start-fscrawler](https://fscrawler.readthedocs.io/en/fscrawler-2.5/user/getting_started.html#start-fscrawler)

---

<div class="post-metadata">

**Author:** ![Technical\_Stuffer\_S](https://avatars.discourse-cdn.com/v4/letter/t/41988e/32.png) [@Technical\_Stuffer\_S](https://discuss.elastic.co/u/Technical_Stuffer_S)\
**Post date:** [November 4, 2018, 4:23pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/7 "2018-11-04T16:23:10Z")

</div>

![image](https://us1.discourse-cdn.com/elastic/original/3X/5/d/5dd87597bb9d1e9c6727762405cbb9ebbc0f2c4d.png)

sir, now getting this error......fscrawler stopped

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 4, 2018, 4:48pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/8 "2018-11-04T16:48:37Z")

</div>

Please don't post images of text as they are hardly readable and not searchable.

Instead paste the text and format it with `</>` icon. Check the preview window.

Try to run with --debug option.

Most likely elasticsearch is not started here.

---

<div class="post-metadata">

**Author:** ![Technical\_Stuffer\_S](https://avatars.discourse-cdn.com/v4/letter/t/41988e/32.png) [@Technical\_Stuffer\_S](https://discuss.elastic.co/u/Technical_Stuffer_S)\
**Post date:** [November 5, 2018, 4:11pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/9 "2018-11-05T16:11:50Z")

</div>

\<fscrawler --config\_dir ./jp catalogs/\>  
sir this command is not working .....

and elastic serach is running already

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 5, 2018, 4:40pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/10 "2018-11-05T16:40:33Z")

</div>

Share the logs that you are getting in debug mode please.  
Share your FSCrawler configuration json file as well for the `catalog` job.  
Share your elasticsearch logs as well.

And please format your code, logs or configuration files using `</>` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21) and not the citation button. It will make your post more readable.

Or use markdown style like:

````
```
CODE
```

````

This is the icon to use if you are not using markdown format:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/e/7e6e239431ec2d71cbf1beef741f2e93e7cc762c.jpg)

There's a live preview panel for exactly this reasons.

Lots of people read these forums, and many of them will simply skip over a post that is difficult to read, because it's just too large an investment of their time to try and follow a wall of badly formatted text.  
If your goal is to get an answer to your questions, it's in your interest to make it as easy to read and understand as possible.

---

<div class="post-metadata">

**Author:** ![Technical\_Stuffer\_S](https://avatars.discourse-cdn.com/v4/letter/t/41988e/32.png) [@Technical\_Stuffer\_S](https://discuss.elastic.co/u/Technical_Stuffer_S)\
**Post date:** [November 5, 2018, 5:36pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/11 "2018-11-05T17:36:42Z")

</div>

Json file-

{  
"name" : "catalogs",  
"fs" : {  
"url" : "C:\tmp\jp",  
"update\_rate" : "15m",  
"excludes" : ["_/~_"],  
"json\_support" : false,  
"filename\_as\_id" : false,  
"add\_filesize" : true,  
"remove\_deleted" : true,  
"add\_as\_inner\_object" : false,  
"store\_source" : false,  
"index\_content" : true,  
"attributes\_support" : false,  
"raw\_metadata" : true,  
"xml\_support" : false,  
"index\_folders" : true,  
"lang\_detect" : false,  
"continue\_on\_error" : false,  
"pdf\_ocr" : true,  
"ocr" : {  
"language" : "eng"  
}  
},  
"elasticsearch" : {  
"nodes" : [ {  
"host" : "127.0.0.1",  
"port" : 9200,  
"scheme" : "HTTP"  
} ],  
"bulk\_size" : 100,  
"flush\_interval" : "5s",  
"byte\_size" : "10mb"  
},  
"rest" : {  
"scheme" : "HTTP",  
"host" : "127.0.0.1",  
"port" : 8080,  
"endpoint" : "fscrawler"  
}  
}

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 5, 2018, 6:07pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/12 "2018-11-05T18:07:45Z")

</div>

Elasticsearch logs please?

And please format your code as I just described.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 5, 2018, 6:08pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/13 "2018-11-05T18:08:10Z")

</div>

And FSCrawler logs?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 3, 2018, 6:08pm UTC](https://discuss.elastic.co/t/how-to-start-with-fscrawler/154293/14 "2018-12-03T18:08:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
