# Maximum limit for indexes

**URL:** <https://discuss.elastic.co/t/maximum-limit-for-indexes/6828>\
**Category:** Elasticsearch\
**Created:** [February 28, 2012, 10:48am UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828 "2012-02-28T10:48:21Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Damian\_Brhel](https://avatars.discourse-cdn.com/v4/letter/d/2bfe46/32.png) [@Damian\_Brhel](https://discuss.elastic.co/u/Damian_Brhel)\
**Post date:** [February 28, 2012, 10:48am UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/1 "2012-02-28T10:48:21Z")

</div>

Hi,

I have a project which provides to brands monitoring their brand  
names. I want to store data separately into different index for each  
brand. Is there a limit for number of indexes with the Elastic Search  
can real work? Will ES still work if i have 10k - 100k indexes? Each  
index will have around 100k new rows every month.

I want to store data separately, beacuse we always select data only  
for one brand and I want to use advantage of \_open/\_close index.

Thank you!

Damian Brhel

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [February 29, 2012, 1:53pm UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/2 "2012-02-29T13:53:16Z")

</div>

See this thread: [Redirecting to Google Groups](https://groups.google.com/forum/?fromgroups#!searchin/elasticsearch/data$20flow/elasticsearch/49q-_AgQCp8/MRol0t9asEcJ), but in general, its pretty expensive to have many indices (even with one shard).

On Tuesday, February 28, 2012 at 12:48 PM, Damian Brhel wrote:

> Hi,
> 
> I have a project which provides to brands monitoring their brand  
> names. I want to store data separately into different index for each  
> brand. Is there a limit for number of indexes with the Elastic Search  
> can real work? Will ES still work if i have 10k - 100k indexes? Each  
> index will have around 100k new rows every month.
> 
> I want to store data separately, beacuse we always select data only  
> for one brand and I want to use advantage of \_open/\_close index.
> 
> Thank you!
> 
> Damian Brhel

---

<div class="post-metadata">

**Author:** ![James\_Bardin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james_bardin/32/2536_2.png) [@James\_Bardin](https://discuss.elastic.co/u/James_Bardin)\
**Post date:** [July 17, 2012, 9:37pm UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/3 "2012-07-17T21:37:28Z")

</div>

Hi Shay,

On Wednesday, February 29, 2012 8:53:16 AM UTC-5, kimchy wrote:

> See this thread:  
> [Redirecting to Google Groups](https://groups.google.com/forum/?fromgroups#!searchin/elasticsearch/data$20flow/elasticsearch/49q-_AgQCp8/MRol0t9asEcJ),  
> but in general, its pretty expensive to have many indices (even with one  
> shard).

Could you elaborate a bit on the overhead of indices? A single  
index-per-object is gives us a perfect setup for our dataflow, but how far  
can this scale reasonably? Though we're starting out at ~20,000 indices,  
I'd like to be able to plan for 1 million if possible.

If this isn't too far fetched, which is the more important scaling factor,  
node size or node count?

Thanks,  
-jim

---

<div class="post-metadata">

**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\
**Post date:** [July 18, 2012, 8:57am UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/4 "2012-07-18T08:57:57Z")

</div>

Hi Jim

> Could you elaborate a bit on the overhead of indices? A single  
> index-per-object is gives us a perfect setup for our dataflow, but how  
> far can this scale reasonably? Though we're starting out at ~20,000  
> indices, I'd like to be able to plan for 1 million if possible.
> 
> If this isn't too far fetched, which is the more important scaling  
> factor, node size or node count?

That is indeed far fetched 🙂 Unless you plan on having hundreds of  
thousands of servers...

However, filtered aliases might be what you are after.

I suggest taking a look at Shay's presentation at berlin buzzwords this  
year:

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

clint

> Thanks,  
> -jim

---

<div class="post-metadata">

**Author:** ![James\_Bardin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james_bardin/32/2536_2.png) [@James\_Bardin](https://discuss.elastic.co/u/James_Bardin)\
**Post date:** [July 18, 2012, 1:44pm UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/5 "2012-07-18T13:44:48Z")

</div>

On Wed, Jul 18, 2012 at 4:57 AM, Clinton Gormley [clint@traveljury.com](mailto:clint@traveljury.com) wrote:

> That is indeed far fetched 🙂 Unless you plan on having hundreds of  
> thousands of servers...
> 
> However, filtered aliases might be what you are after.
> 
> I suggest taking a look at Shay's presentation at berlin buzzwords this  
> year:  
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html)

Now that's the exact information I was looking for (specifically the  
"user" dataflow section)!

Thanks!  
-jim

---

<div class="post-metadata">

**Author:** ![Brett\_Paden](https://avatars.discourse-cdn.com/v4/letter/b/958977/32.png) [@Brett\_Paden](https://discuss.elastic.co/u/Brett_Paden)\
**Post date:** [April 25, 2013, 7:51pm UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/6 "2013-04-25T19:51:01Z")

</div>

> > 
> 
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html)

404s -- is there an update location for this video?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [April 25, 2013, 9:48pm UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/7 "2013-04-25T21:48:04Z")

</div>

Just checked the video section under Resources on the new home page, and  
found it here

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

Jörg

Am 25.04.13 21:51, schrieb Brett Paden:

> ```
> >
> http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html
> <http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html>
> 
> ```
> 
> 404s -- is there an update location for this video?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Brett\_Paden](https://avatars.discourse-cdn.com/v4/letter/b/958977/32.png) [@Brett\_Paden](https://discuss.elastic.co/u/Brett_Paden)\
**Post date:** [April 25, 2013, 11:39pm UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/8 "2013-04-25T23:39:13Z")

</div>

Danke!

On Thu, Apr 25, 2013 at 5:48 PM, Jörg Prante [joergprante@gmail.com](mailto:joergprante@gmail.com) wrote:

> Just checked the video section under Resources on the new home page, and  
> found it here
> 
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/ **videos/big-data-search-and-** analytics/)[http://www.elasticsearch.org/videos/big-data-search-and-analytics/](http://www.elasticsearch.org/videos/big-data-search-and-analytics/)
> 
> Jörg
> 
> Am 25.04.13 21:51, schrieb Brett Paden:
> 
> > ```
> > >
> > http://www.elasticsearch.org/ **videos/2012/06/05/big-data-**
> > 
> > ```
> > 
> > search-and-analytics.html[http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html](http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html)
> > 
> > ```
> > <http://www.elasticsearch.org/ **videos/2012/06/05/big-data-**
> > 
> > ```
> > 
> > search-and-analytics.html[http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html](http://www.elasticsearch.org/videos/2012/06/05/big-data-search-and-analytics.html)
> > 
> > > 
> > 
> > 404s -- is there an update location for this video?
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)\*\*  
> topic/elasticsearch/\*\*kiFI0QoZ3v4/unsubscribe?hl=en-\*\*US[https://groups.google.com/d/topic/elasticsearch/kiFI0QoZ3v4/unsubscribe?hl=en-US](https://groups.google.com/d/topic/elasticsearch/kiFI0QoZ3v4/unsubscribe?hl=en-US)  
> .  
> To unsubscribe from this group and all its topics, send an email to  
> elasticsearch+unsubscribe@\*\*[googlegroups.com](http://googlegroups.com)[elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com)  
> .  
> For more options, visit [https://groups.google.com/\*\*groups/opt\_out](https://groups.google.com/**groups/opt_out)[https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out)  
> .

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 2:39am UTC](https://discuss.elastic.co/t/maximum-limit-for-indexes/6828/9 "2017-07-06T02:39:34Z")

</div>


