# Regarding Implementation of NLP while crawling using FSCrawler 2.5

**URL:** <https://discuss.elastic.co/t/regarding-implementation-of-nlp-while-crawling-using-fscrawler-2-5/181670>\
**Category:** Elasticsearch\
**Created:** [May 18, 2019, 6:40am UTC](https://discuss.elastic.co/t/regarding-implementation-of-nlp-while-crawling-using-fscrawler-2-5/181670 "2019-05-18T06:40:38Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Neel.Gagan](https://avatars.discourse-cdn.com/v4/letter/n/7bcc69/32.png) [@Neel.Gagan](https://discuss.elastic.co/u/Neel.Gagan)\
**Post date:** [May 18, 2019, 6:40am UTC](https://discuss.elastic.co/t/regarding-implementation-of-nlp-while-crawling-using-fscrawler-2-5/181670/1 "2019-05-18T06:40:38Z")

</div>

ELasticsearch Version 6.4.3  
Kibana Version 6.4.3  
Fscrawler 2.5  
OS : Windows 8.

I am trying to implement NLP while crawling my unstructured data kept in folders. i wish to implemnet NLP while the crawling is being performed by FSCrawler. could i get a detailed description of where all i have to made changes in FScrawler settings file to use the ingest-opennlp pipeline which i had installed in elasticsearch so as to enable automatic entity extraction at the time of crawling by FSCrawler.

Regards,  
Neel

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [May 18, 2019, 2:43pm UTC](https://discuss.elastic.co/t/regarding-implementation-of-nlp-while-crawling-using-fscrawler-2-5/181670/2 "2019-05-18T14:43:24Z")

</div>

SYou need to create an ingest pipeline on elasticsearch side.  
Then you can define it in FSCrawler with [https://fscrawler.readthedocs.io/en/latest/admin/fs/elasticsearch.html#using-ingest-node-pipeline](https://fscrawler.readthedocs.io/en/latest/admin/fs/elasticsearch.html#using-ingest-node-pipeline)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 15, 2019, 2:43pm UTC](https://discuss.elastic.co/t/regarding-implementation-of-nlp-while-crawling-using-fscrawler-2-5/181670/3 "2019-06-15T14:43:39Z")

</div>

Closed on June 15, 2019, 2:43pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.