# FScrawler issue while crawling through a remote host

**URL:** <https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456>\
**Category:** Elasticsearch\
**Created:** [May 27, 2020, 4:55am UTC](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456 "2020-05-27T04:55:17Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Umesh\_S\_Bhimani](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/umesh_s_bhimani/32/69094_2.png) [@Umesh\_S\_Bhimani](https://discuss.elastic.co/u/Umesh_S_Bhimani)\
**Post date:** [May 27, 2020, 4:55am UTC](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456/1 "2020-05-27T04:55:17Z")

</div>

Hi,

There is an issue while crawling through files from remote host. Please see the code snippet below

```auto
---
name: "new_attachment"
server:
  hostname: " **************"
  port: 22
  username: " **********"
  password: " **************"
  protocol: "ssh"
fs:
  url: "/E:/foldertoindex"
  update_rate: "15m"
  excludes:
  - "*/~*"
  json_support: false
  filename_as_id: false
  add_filesize: true
  remove_deleted: true
  add_as_inner_object: false
  store_source: false
  index_content: true
  attributes_support: false
  raw_metadata: false
  xml_support: false
  index_folders: true
  lang_detect: false
  continue_on_error: false
  ocr:
    language: "eng"
    enabled: true
    pdf_strategy: "ocr_and_text"
  follow_symlinks: false
elasticsearch:
  nodes:
  - url: "http:// ************* :9200"
  bulk_size: 100
  flush_interval: "5s"
  byte_size: "10mb"

```

Error is as follows:

```auto
04:32:42,146 DEBUG [f.p.e.c.f.FsParserAbstract] Fs crawler thread [new_attachmen
t] is now running. Run #46...
04:32:42,146 DEBUG [f.p.e.c.f.c.s.FileAbstractorSSH] Opening SSH connection to *username@hostname*
04:32:42,783 DEBUG [f.p.e.c.f.c.s.FileAbstractorSSH] SSH connection successful
04:32:42,815 WARN [f.p.e.c.f.FsParserAbstract] Error while crawling /E:/foldert
oindex: begin 0, end -1, length 17
04:32:42,815 WARN [f.p.e.c.f.FsParserAbstract] Full stacktrace
java.lang.StringIndexOutOfBoundsException: begin 0, end -1, length 17
        at java.lang.String.checkBoundsBeginEnd(String.java:3319) ~[?:?]
        at java.lang.String.substring(String.java:1874) ~[?:?]
        at fr.pilato.elasticsearch.crawler.fs.FsParserAbstract.indexDirectory(Fs
ParserAbstract.java:541) ~[fscrawler-core-2.7-SNAPSHOT.jar:?]
        at fr.pilato.elasticsearch.crawler.fs.FsParserAbstract.run(FsParserAbstr
act.java:142) [fscrawler-core-2.7-SNAPSHOT.jar:?]
        at java.lang.Thread.run(Thread.java:834) [?:?]
04:32:42,819 DEBUG [f.p.e.c.f.FsParserAbstract] Fs crawler is going to sleep for
 15m
04:47:42,905 DEBUG [f.p.e.c.f.FsParserAbstract] Fs crawler is now waking up agai
n...
04:47:42,905 DEBUG [f.p.e.c.f.FsParserAbstract] Fs crawler thread [new_attachmen
t] is now running. Run #47...
04:47:42,905 DEBUG [f.p.e.c.f.c.s.FileAbstractorSSH] Opening SSH connection to D
IR\RGadge@NL0123EPC0921.dir.slb.com
04:47:43,589 DEBUG [f.p.e.c.f.c.s.FileAbstractorSSH] SSH connection successful
04:47:43,629 WARN [f.p.e.c.f.FsParserAbstract] Error while crawling /E:/foldert
oindex: begin 0, end -1, length 17
04:47:43,629 WARN [f.p.e.c.f.FsParserAbstract] Full stacktrace
java.lang.StringIndexOutOfBoundsException: begin 0, end -1, length 17
        at java.lang.String.checkBoundsBeginEnd(String.java:3319) ~[?:?]
        at java.lang.String.substring(String.java:1874) ~[?:?]
        at fr.pilato.elasticsearch.crawler.fs.FsParserAbstract.indexDirectory(Fs
ParserAbstract.java:541) ~[fscrawler-core-2.7-SNAPSHOT.jar:?]
        at fr.pilato.elasticsearch.crawler.fs.FsParserAbstract.run(FsParserAbstr
act.java:142) [fscrawler-core-2.7-SNAPSHOT.jar:?]

```

Regards,  
Umesh

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 27, 2020, 5:15am UTC](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456/2 "2020-05-27T05:15:10Z")

</div>

Could you report this there?

> **[dadoonet/fscrawler](https://github.com/dadoonet/fscrawler)**
>
> Elasticsearch File System Crawler (FS Crawler). Contribute to dadoonet/fscrawler development by creating an account on GitHub.

Thanks !

---

<div class="post-metadata">

**Author:** ![Umesh\_S\_Bhimani](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/umesh_s_bhimani/32/69094_2.png) [@Umesh\_S\_Bhimani](https://discuss.elastic.co/u/Umesh_S_Bhimani)\
**Post date:** [May 27, 2020, 6:50am UTC](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456/3 "2020-05-27T06:50:30Z")

</div>

Done, I have created a new bug in GitHub

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 24, 2020, 6:50am UTC](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456/4 "2020-06-24T06:50:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.