# Separate clauses while index in elastic search with FScrawler

**URL:** <https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333>\
**Category:** Elasticsearch\
**Created:** [June 5, 2019, 10:55am UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333 "2019-06-05T10:55:11Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![masume](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/masume/32/47541_2.png) [@masume](https://discuss.elastic.co/u/masume)\
**Post date:** [June 5, 2019, 10:55am UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/1 "2019-06-05T10:55:11Z")

</div>

Hi All,  
I indexed a pdf file in elastic search with fscrawler (elastic version 7.1)  
in kibana every thing is ok and I can see the index but the problem is all pdf file index as one content filed and when i search the whole of pdf content selected, i am looking for some thing that index pdf file sentence by sentence , can any body help me

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [June 5, 2019, 11:30am UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/2 "2019-06-05T11:30:21Z")

</div>

You need to manage that by yourself I'm afraid. What is a sentence after all? You can may be write an ingest pipeline which does that on the text that has been extracted by the crawler. Script Processor might be a good candidate...

---

<div class="post-metadata">

**Author:** ![masume](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/masume/32/47541_2.png) [@masume](https://discuss.elastic.co/u/masume)\
**Post date:** [June 5, 2019, 11:37am UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/3 "2019-06-05T11:37:25Z")

</div>

> [@dadoonet](#):
>
> What is a sentence after all

Hi dadoonet , It means word by word or clause by caluse some thing like this:

> content : your guide to healthy eating use the food pyramid to plan meals and snacks healthy food. eating a wide variety of nourishing foods provides the energy and nutrients you need every day to stay healthy. plan what you eat using these tips. take time to plan your meals in advance.

I want add to index each clause separately, like this

> content : your guide to healthy eating use the food pyramid to plan meals and snacks healthy food.

> content: eating a wide variety of nourishing foods provides the energy and nutrients you need every day to stay healthy. plan what you eat using these tips.

> content: take time to plan your meals in advance.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [June 5, 2019, 11:59am UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/4 "2019-06-05T11:59:34Z")

</div>

I understood that. Was just saying that you need to implement your own rules.

What about question marks? What about exclamation points? And other signs?

What is the use case then?

---

<div class="post-metadata">

**Author:** ![masume](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/masume/32/47541_2.png) [@masume](https://discuss.elastic.co/u/masume)\
**Post date:** [June 5, 2019, 12:04pm UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/5 "2019-06-05T12:04:38Z")

</div>

Yes exactly I want to do , separate by [. ! ?] for understanding of clause type. My plan is deploying a dictionary of clauses and my resources are only pdfs.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [June 5, 2019, 1:56pm UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/6 "2019-06-05T13:56:49Z")

</div>

As I said you need to do that transformation by yourself.

---

<div class="post-metadata">

**Author:** ![masume](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/masume/32/47541_2.png) [@masume](https://discuss.elastic.co/u/masume)\
**Post date:** [June 5, 2019, 2:04pm UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/7 "2019-06-05T14:04:03Z")

</div>

> [@dadoonet](#):
>
> s I said you need to do that transformation by yourself.

Many Thanks for your response();

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 3, 2019, 2:04pm UTC](https://discuss.elastic.co/t/separate-clauses-while-index-in-elastic-search-with-fscrawler/184333/8 "2019-07-03T14:04:09Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
