Regarding Implementation of NLP while crawling using FSCrawler 2.5

Elastic Stack Elasticsearch
1

ELasticsearch Version 6.4.3
Kibana Version 6.4.3
Fscrawler 2.5
OS : Windows 8.

I am trying to implement NLP while crawling my unstructured data kept in folders. i wish to implemnet NLP while the crawling is being performed by FSCrawler. could i get a detailed description of where all i have to made changes in FScrawler settings file to use the ingest-opennlp pipeline which i had installed in elasticsearch so as to enable automatic entity extraction at the time of crawling by FSCrawler.

Regards,
Neel

2

SYou need to create an ingest pipeline on elasticsearch side.
Then you can define it in FSCrawler with https://fscrawler.readthedocs.io/en/latest/admin/fs/elasticsearch.html#using-ingest-node-pipeline

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.