# Queries about indexing data into elastic search

**URL:** <https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542>\
**Category:** Elasticsearch\
**Created:** [September 30, 2021, 7:04am UTC](https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542 "2021-09-30T07:04:49Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Magesh\_02](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magesh_02/32/94023_2.png) [@Magesh\_02](https://discuss.elastic.co/u/Magesh_02)\
**Post date:** [September 30, 2021, 7:04am UTC](https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542/1 "2021-09-30T07:04:49Z")

</div>

I have some questions regarding indexing the data.

In my case, I needed to push 100 million JSON records into a single index on a specific date, and the date had to be included in the JSON field. I imported this data into PowerBI using the \_search rest API. Then I'll push another set of data into the same index with a different date, bringing the total index size to 200 million records. I'll also push json into the same index throughout the year. Is pushing historic data into the same index the correct way to go? Will there be a memory problem in the future?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [September 30, 2021, 10:43pm UTC](https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542/2 "2021-09-30T22:43:10Z")

</div>

It depends - how big do you expect the data set to be in the end?

---

<div class="post-metadata">

**Author:** ![Magesh\_02](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magesh_02/32/94023_2.png) [@Magesh\_02](https://discuss.elastic.co/u/Magesh_02)\
**Post date:** [October 4, 2021, 10:00am UTC](https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542/3 "2021-10-04T10:00:36Z")

</div>

Hi @warkolm

A single JSON file containing push data would be around 30 MB in size. As a result, it appears that the index size will increase by more than 2 GB over the course of the year. Is there a better way to handle this situation?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [October 10, 2021, 11:06pm UTC](https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542/4 "2021-10-10T23:06:24Z")

</div>

You will be able to store that in a single index with no dramas.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 7, 2021, 11:07pm UTC](https://discuss.elastic.co/t/queries-about-indexing-data-into-elastic-search/285542/5 "2021-11-07T23:07:23Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.