Installation on ubantu

Hello Sir,
I have done the search functionality with fscrawler on local server. It is working good.
Now I am uploading on ubantu server. Elastic search is active. But for fscralwer getting error for file content. Elastic search service client cant not restart error on command prompt.
Please help.

Could you share the error message?

Sir,Now it is on window server. And fscrawler giving error like warning-set-filename-as-stored-field and cant taking the contents of new files having only email and phone numbers.
Error while crawling ..... Mapping is incorrect: please set stored: true on field [file.filename].
Please reply Sir.

but i checked _default folder in all folder file.filename store filed is true.

This message indicates that the mapping in Elasticsearch is not correct for the index or the index_folder index.

The easiest way is to remove those 2 indices and restart FSCrawler. But this will remove everything.

ok Sir.But after removal of two indexes need to create again through elasticsearch ? and Then we have to restart fscrawler?

Do not create indices manually or if you do, please use the provided mapping.

ok Sir . I am saying like using the curl command curl -X PUT -"localhost:9200/test_index?pretty".

So there is no need to create index .When we start fscrawler it will automatic create index correct?


  1. DELETE the indices
  2. Start fscrawler
  3. Enjoy


Ok Sir. I will do and check. Thank you So much :slight_smile:

failed to create index [resumes], disabling crawler...
07:44:33,338 FATAL [f.p.e.c.f.c.FsCrawlerCli] We can not start Elasticsearch Client. Exiting.
fr.pilato.elasticsearch.crawler.fs.client.ElasticsearchClientException: error while creating index resumes: {error={root_cause=[{"type":"cluster_block_exception","reason":"index [resumes] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];"}], type=cluster_block_exception, reason=index [resumes] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];}, status=429}

sir now giving this error. Please help me.

Not enough free disk space available apparently.

ok Sir. I will remove unwanted data.

After that you will need to set the index to read-write or easier to delete the index and start again.

Ok Sir. Thank you for your reply.

Now It's Working Properly Sir.
Thank you So much for your valuable and quick reply.

Thank you :slight_smile:

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.