# Balance Between Heavy Indexing and Searching **URL:** \ **Category:** Elasticsearch\ **Created:** [January 6, 2015, 7:09pm UTC](https://discuss.elastic.co/t/balance-between-heavy-indexing-and-searching/21510 "2015-01-06T19:09:27Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![David\_Mavashev](https://avatars.discourse-cdn.com/v4/letter/d/22d042/32.png) [@David\_Mavashev](https://discuss.elastic.co/u/David_Mavashev)\ **Post date:** [January 6, 2015, 7:09pm UTC](https://discuss.elastic.co/t/balance-between-heavy-indexing-and-searching/21510/1 "2015-01-06T19:09:27Z")
Hi, I have a cluster of 20 nodes, 1 TB/day of data indexed, right now we only keep the last 3 days opened but the customer wants us to open 6 months of indexes. We don't care about query execution times but only that the indexing throughput wouldn't get hurt. Is there anything we can do in the current installation without expanding it with many more nodes? What is the best way to approach this problem? Thanks you so much, David -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [January 6, 2015, 8:24pm UTC](https://discuss.elastic.co/t/balance-between-heavy-indexing-and-searching/21510/2 "2015-01-06T20:24:31Z")
The best way is to add more nodes. There isn't much you can do with that amount of data! On 7 January 2015 at 06:09, David Mavashev [cryptic86@gmail.com](mailto:cryptic86@gmail.com) wrote: > Hi, > > I have a cluster of 20 nodes, 1 TB/day of data indexed, right now we only > keep the last 3 days opened but the customer wants us to open 6 months of > indexes. > > We don't care about query execution times but only that the indexing > throughput wouldn't get hurt. > Is there anything we can do in the current installation without expanding > it with many more nodes? > > What is the best way to approach this problem? > > Thanks you so much, > David > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_HtCkWMLRh\_jSfOe6f1HG-SoVuJVrE-h%2BJaXq\_qm5KZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_HtCkWMLRh_jSfOe6f1HG-SoVuJVrE-h%2BJaXq_qm5KZA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\ **Post date:** [January 6, 2015, 9:29pm UTC](https://discuss.elastic.co/t/balance-between-heavy-indexing-and-searching/21510/3 "2015-01-06T21:29:49Z")
That is a ton of data to keep open. Can you squish it somehow? On Tue, Jan 6, 2015 at 3:24 PM, Mark Walkom [markwalkom@gmail.com](mailto:markwalkom@gmail.com) wrote: > The best way is to add more nodes. > There isn't much you can do with that amount of data! > > On 7 January 2015 at 06:09, David Mavashev [cryptic86@gmail.com](mailto:cryptic86@gmail.com) wrote: > > > Hi, > > > > I have a cluster of 20 nodes, 1 TB/day of data indexed, right now we only > > keep the last 3 days opened but the customer wants us to open 6 months of > > indexes. > > > > We don't care about query execution times but only that the indexing > > throughput wouldn't get hurt. > > Is there anything we can do in the current installation without expanding > > it with many more nodes? > > > > What is the best way to approach this problem? > > > > Thanks you so much, > > David > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/b281e94a-1bce-4bb9-adf3-3174054ec043%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_HtCkWMLRh\_jSfOe6f1HG-SoVuJVrE-h%2BJaXq\_qm5KZA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_HtCkWMLRh_jSfOe6f1HG-SoVuJVrE-h%2BJaXq_qm5KZA%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_HtCkWMLRh\_jSfOe6f1HG-SoVuJVrE-h%2BJaXq\_qm5KZA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_HtCkWMLRh_jSfOe6f1HG-SoVuJVrE-h%2BJaXq_qm5KZA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd07EW9Or9E0f8R6Dh0M%3DMGuWgRPUchcePSUcYvthctFbw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd07EW9Or9E0f8R6Dh0M%3DMGuWgRPUchcePSUcYvthctFbw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:40am UTC](https://discuss.elastic.co/t/balance-between-heavy-indexing-and-searching/21510/4 "2017-07-06T00:40:26Z")
Closed on July 6, 2017, 12:40am UTC