# Loading of Data in Elaticsearch **URL:** \ **Category:** Elasticsearch\ **Created:** [March 1, 2016, 8:03pm UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154 "2016-03-01T20:03:24Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![Rajeev\_Gaurav](https://avatars.discourse-cdn.com/v4/letter/r/3d9bf3/32.png) [@Rajeev\_Gaurav](https://discuss.elastic.co/u/Rajeev_Gaurav)\ **Post date:** [March 1, 2016, 8:03pm UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/1 "2016-03-01T20:03:24Z")
Hi, I am working with something in which I loading data (around 2.5 GB) into ES per day and then Delete once in a week .I want a device that whether it will good to load data daily into single index or load the data daily into each respective index( 7 index for 7 day and then deleting all once in a week).Kindly explain with the reason as I am new to ES. Thanks, Rajeev ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 1, 2016, 9:06pm UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/2 "2016-03-01T21:06:17Z")
You can use Logstash for this - [https://www.elastic.co/guide/en/logstash/current/index.html](https://www.elastic.co/guide/en/logstash/current/index.html) But without more information it's a bit hard to help. ---
**Author:** ![Rajeev\_Gaurav](https://avatars.discourse-cdn.com/v4/letter/r/3d9bf3/32.png) [@Rajeev\_Gaurav](https://discuss.elastic.co/u/Rajeev_Gaurav)\ **Post date:** [March 2, 2016, 6:58am UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/3 "2016-03-02T06:58:36Z")
I am able to load data into ES. I am asking about the approac so that I can't have dataloss in the case of failing due to overload in an index or shred. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 2, 2016, 7:01am UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/4 "2016-03-02T07:01:54Z")
Then you want at least 3 nodes and 1 replica of the index. ---
**Author:** ![Rajeev\_Gaurav](https://avatars.discourse-cdn.com/v4/letter/r/3d9bf3/32.png) [@Rajeev\_Gaurav](https://discuss.elastic.co/u/Rajeev_Gaurav)\ **Post date:** [March 2, 2016, 7:07am UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/5 "2016-03-02T07:07:46Z")
At Present I am loading data into one node and one index and when I tried to load data today size of node became around 6.5 gb and after that I am getting error with cluster health read.Can you help me in that and also any way so that I can avoid these type of failure in future. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 2, 2016, 9:05am UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/6 "2016-03-02T09:05:22Z")
How much heap did you assign? ---
**Author:** ![Rajeev\_Gaurav](https://avatars.discourse-cdn.com/v4/letter/r/3d9bf3/32.png) [@Rajeev\_Gaurav](https://discuss.elastic.co/u/Rajeev_Gaurav)\ **Post date:** [March 2, 2016, 5:52pm UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/7 "2016-03-02T17:52:37Z")
Initially It was set to default .So I now I changed it to 8GB by writing ES\_HEAP\_SIZE=8G and also locked the memory by setting bootstrap.mlockall: true in elasticsearch.yml file running on Window Server 2012 R2. Is it Correct. Suggest some points. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 2, 2016, 9:48pm UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/8 "2016-03-02T21:48:10Z")
That'll help a lot! ---
**Author:** ![Rajeev\_Gaurav](https://avatars.discourse-cdn.com/v4/letter/r/3d9bf3/32.png) [@Rajeev\_Gaurav](https://discuss.elastic.co/u/Rajeev_Gaurav)\ **Post date:** [March 3, 2016, 3:43am UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/9 "2016-03-03T03:43:21Z")
Thanks for all the information. Can you please tell where to set all these value as I am getting error When I am setting these value in elasticsearch.yml file of config folder. I have 16GB of RAM. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 3, 2016, 6:19am UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/10 "2016-03-03T06:19:36Z")
Depends how you installed ES, the easiest way is to set an environment variable of `ES_HEAP_SIZE`. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 5, 2017, 11:11pm UTC](https://discuss.elastic.co/t/loading-of-data-in-elaticsearch/43154/11 "2017-07-05T23:11:47Z")