# Indexing the document is recommend approach

**URL:** <https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395>\
**Category:** Elasticsearch\
**Created:** [February 14, 2020, 3:12pm UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395 "2020-02-14T15:12:46Z")\
**Posts on this page:** 14\
**Page:** 1

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 14, 2020, 3:12pm UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/1 "2020-02-14T15:12:46Z")

</div>

Hello,

Is it recommended approach to store documents on elastic search?

what if we extract keywords from document and creating index on those keywords( assumption is file path will stored index along with keywords physical file not existing on elastic search) instead of applying index on the document.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 14, 2020, 3:32pm UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/2 "2020-02-14T15:32:21Z")

</div>

Yes. If you don't need to index the whole document but you have access to the keywords and that's the only text you want to be able to search for, then that's probably right.

---

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 15, 2020, 1:40am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/3 "2020-02-15T01:40:16Z")

</div>

Thanks for your quick response.

Here i am providing some more details on my requirement, can you please suggest which is better option.

I am looking for index on whole document.

Actually my requirement is to store files may be in size of GB.

My allowed file extensions will be pdf,docx,excel,csv,ppt,pptx, images(png,jpeg,tiff,svg,etc..),audio files (search on audio content),video files,..etc.

can you please suggest me based on above requirement, which is the better option to go with.

thanks in advance.

Thanks,  
Siva A.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 15, 2020, 4:13am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/4 "2020-02-15T04:13:40Z")

</div>

My advice is to index the content and not to store the binary version of the document.

Did you look at FSCrawler project by any chance?

---

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 15, 2020, 4:35am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/5 "2020-02-15T04:35:14Z")

</div>

Thanks for information David.  
I really appreciate your effort to reply over weekend.

I didn't go through FSC cwrler. I am completely new to elastic search option.

I looking for help to make a decision, how to implement it in better manner.

It's really important to me make a decision on it. System should be stable for next 15 years of span.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 15, 2020, 6:38am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/6 "2020-02-15T06:38:19Z")

</div>

FSCrawler is here: [https://fscrawler.readthedocs.io/en/latest/](https://fscrawler.readthedocs.io/en/latest/)

Where is your data coming from?

---

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 15, 2020, 9:01am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/7 "2020-02-15T09:01:59Z")

</div>

Files will come from external web application.

I am planing to add ftp server to maintain those files, will save file repository location in elastic search along with crawler data(indexed keywords).

Please correct me if assumption is wrong?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 15, 2020, 9:42am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/8 "2020-02-15T09:42:21Z")

</div>

Have a look at the attachment ingest plugin.  
It will help you to extract some metadata.

---

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 15, 2020, 11:20am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/9 "2020-02-15T11:20:14Z")

</div>

If you dont mind, can you please elaborate it.

Please confirm me on my decision.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 15, 2020, 11:40am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/10 "2020-02-15T11:40:18Z")

</div>

> [@SivaPrasad\_Ampolu](#):
>
> Please confirm me on my decision.

I don't think I understood what you're going to do.

---

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 15, 2020, 11:43am UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/11 "2020-02-15T11:43:14Z")

</div>

I am planing to add ftp server to maintain files, will save file repository URL in elastic search along with indexed keywords.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 15, 2020, 1:19pm UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/12 "2020-02-15T13:19:29Z")

</div>

That looks like a good design to me.

---

<div class="post-metadata">

**Author:** ![SivaPrasad\_Ampolu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sivaprasad_ampolu/32/45310_2.png) [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\
**Post date:** [February 15, 2020, 2:18pm UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/13 "2020-02-15T14:18:33Z")

</div>

Thanks for confirmation.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 14, 2020, 2:18pm UTC](https://discuss.elastic.co/t/indexing-the-document-is-recommend-approach/219395/14 "2020-03-14T14:18:37Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
