# Best practice For big finite amount of data Transfer and managment

**URL:** <https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737>\
**Category:** Elasticsearch\
**Created:** [May 15, 2017, 10:11am UTC](https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737 "2017-05-15T10:11:10Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![sahar\_q](https://avatars.discourse-cdn.com/v4/letter/s/dbc845/32.png) [@sahar\_q](https://discuss.elastic.co/u/sahar_q)\
**Post date:** [May 15, 2017, 10:11am UTC](https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737/1 "2017-05-15T10:11:10Z")

</div>

Hello guys, I am new to elastic so im asking for guidence regarding best practices, My goal is to get alot of different data and categorize it, i am contemplating on how to do it. i thought since it is all related to the same source then i would create 1 index and under that index ill create mapping in which ill make several Documents "types" and for each type his own mapping, the amount of data could get quite big, the question is if this is the correct way  
the Data is not continuos, there is a finite amount of it, and my goal is searching in all of it once the transfer is done.

thanks 🙂

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 15, 2017, 10:16am UTC](https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737/2 "2017-05-15T10:16:10Z")

</div>

> [@sahar\_q](#):
>
> under that index ill create mapping in which ill make several Documents "types" and for each type his own mapping, the amount of data could get quite big, the question is if this is the correct way

No, things are changing in that regards and you will no longer be able to have multiple types in an index as of ES 6.0.

See [Index vs. Type | Elastic Blog](https://www.elastic.co/blog/index-vs-type) for some more info on best practises.

---

<div class="post-metadata">

**Author:** ![sahar\_q](https://avatars.discourse-cdn.com/v4/letter/s/dbc845/32.png) [@sahar\_q](https://discuss.elastic.co/u/sahar_q)\
**Post date:** [May 15, 2017, 10:54am UTC](https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737/3 "2017-05-15T10:54:25Z")

</div>

Thank you for the fast response, is there any replacment?  
or for now i should just create indice for each type i wanted to add and keep the shards value low?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 15, 2017, 10:55am UTC](https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737/4 "2017-05-15T10:55:00Z")

</div>

> [@sahar\_q](#):
>
> or for now i should just create indice for each type i wanted to add and keep the shards value low?

That is the best idea.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 12, 2017, 10:56am UTC](https://discuss.elastic.co/t/best-practice-for-big-finite-amount-of-data-transfer-and-managment/85737/5 "2017-06-12T10:56:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.