I have 15 GB or 80,000,000 documents generated everyday streamed from logstash pipeline into elasticsearch, and I need to allow 30 days data to be active and queriable. My queries are all aggregation quries with multiple layers of bukets. I have two choices to index the data Generate one index da…

Scale for the size and number of active indices

sharon.c July 7, 2016, 1:58pm 5

Thank you for your suggestions!

Topic		Replies	Views
Best practice to decide number of index Elasticsearch	3	790	July 5, 2017
Choosing index count balance Elasticsearch	2	295	July 6, 2017
Strategy for index over a rolling window of realtime data Elasticsearch	2	574	July 6, 2017
Recommended way to reduce overload on ES Elasticsearch	10	3694	July 6, 2017
One large index vs. many smaller indexes Elasticsearch	5	10699	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Scale for the size and number of active indices

Related topics