# Limit search on number of indices **URL:** \ **Category:** Elasticsearch\ **Created:** [December 27, 2012, 11:58am UTC](https://discuss.elastic.co/t/limit-search-on-number-of-indices/10182 "2012-12-27T11:58:01Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Robin\_Verlangen](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/robin_verlangen/32/1542_2.png) [@Robin\_Verlangen](https://discuss.elastic.co/u/Robin_Verlangen)\ **Post date:** [December 27, 2012, 11:58am UTC](https://discuss.elastic.co/t/limit-search-on-number-of-indices/10182/1 "2012-12-27T11:58:01Z")
Hi there, Is there a (hard) limit on the number of indices involved in a search. My ES design is really simple: one index per day. When I search on 1 week of data, I generate the dates of the last 7 days and perform a search on them. E.g. 2012-12-20,2012-12-21,...,2012-12-27 However when I try to search one month of data it seems that something goes wrong. Is this a limit of indices to be searched at once? Best regards, Robin Verlangen _Software engineer_ \* \* W [http://www.robinverlangen.nl](http://www.robinverlangen.nl) E robin@us2.nl [http://goo.gl/Lt7BC](http://goo.gl/Lt7BC) Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named addressee and may be confidential. If you are not the intended recipient, you are reminded that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies. -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 12:21pm UTC](https://discuss.elastic.co/t/limit-search-on-number-of-indices/10182/2 "2012-12-27T12:21:14Z")
The main issue I can see is the "too many open files" problem. Do you see that in logs? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 27 déc. 2012 à 12:58, Robin Verlangen [robin@us2.nl](mailto:robin@us2.nl) a écrit : > Hi there, > > Is there a (hard) limit on the number of indices involved in a search. > > My ES design is really simple: one index per day. When I search on 1 week of data, I generate the dates of the last 7 days and perform a search on them. E.g. 2012-12-20,2012-12-21,...,2012-12-27 > > However when I try to search one month of data it seems that something goes wrong. Is this a limit of indices to be searched at once? > > Best regards, > > Robin Verlangen > Software engineer > > W [http://www.robinverlangen.nl](http://www.robinverlangen.nl) > E robin@us2.nl > > ## Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named addressee and may be confidential. If you are not the intended recipient, you are reminded that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies. -- ---
**Author:** ![Robin\_Verlangen](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/robin_verlangen/32/1542_2.png) [@Robin\_Verlangen](https://discuss.elastic.co/u/Robin_Verlangen)\ **Post date:** [December 27, 2012, 3:25pm UTC](https://discuss.elastic.co/t/limit-search-on-number-of-indices/10182/3 "2012-12-27T15:25:09Z")
So there is no limit on the amount of indices being searched, apart from the open file limit? Best regards, Robin Verlangen _Software engineer_ \* \* W [http://www.robinverlangen.nl](http://www.robinverlangen.nl) E robin@us2.nl [http://goo.gl/Lt7BC](http://goo.gl/Lt7BC) Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named addressee and may be confidential. If you are not the intended recipient, you are reminded that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies. On Thu, Dec 27, 2012 at 1:21 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > The main issue I can see is the "too many open files" problem. > Do you see that in logs? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 12:58, Robin Verlangen [robin@us2.nl](mailto:robin@us2.nl) a écrit : > > Hi there, > > Is there a (hard) limit on the number of indices involved in a search. > > My ES design is really simple: one index per day. When I search on 1 week > of data, I generate the dates of the last 7 days and perform a search on > them. E.g. 2012-12-20,2012-12-21,...,2012-12-27 > > However when I try to search one month of data it seems that something > goes wrong. Is this a limit of indices to be searched at once? > > Best regards, > > Robin Verlangen > _Software engineer_ > \* > \* > W [http://www.robinverlangen.nl](http://www.robinverlangen.nl) > E robin@us2.nl > > [http://goo.gl/Lt7BC](http://goo.gl/Lt7BC) > > Disclaimer: The information contained in this message and attachments is > intended solely for the attention and use of the named addressee and may be > confidential. If you are not the intended recipient, you are reminded that > the information remains the property of the sender. You must not use, > disclose, distribute, copy, print or rely on this e-mail. If you have > received this message in error, please contact the sender immediately and > irrevocably delete this message and any copies. > > -- > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 3:46pm UTC](https://discuss.elastic.co/t/limit-search-on-number-of-indices/10182/4 "2012-12-27T15:46:41Z")
Hey Robin, Perhaps you could elaborate a bit more your issue. Are you using aliases? Are you searching on the whole cluster? 31 indices should not be an issue AFAIK. BTW, here's what Igor wrote some months ago on stackoverflow [http://stackoverflow.com/questions/12572234/elasticsearch-separate-index-per-user/12598894#12598894](http://stackoverflow.com/questions/12572234/elasticsearch-separate-index-per-user/12598894#12598894) : "I can also add that having a lot of indices will slow down cluster restarts and repeating user data will make modification and deletion of user records more complicated that it needs to be. In other words, you can have a lot of indices, but in your case it's, probably, a bad idea." David. Le 27 décembre 2012 à 16:25, Robin Verlangen [robin@us2.nl](mailto:robin@us2.nl) a écrit : > So there is no limit on the amount of indices being searched, apart from the > open file limit? > > Best regards, > > Robin Verlangen > Software engineer > > W [http://www.robinverlangen.nl](http://www.robinverlangen.nl) [http://www.robinverlangen.nl](http://www.robinverlangen.nl) > E robin@us2.nl [mailto:robin@us2.nl](mailto:robin@us2.nl) > [http://goo.gl/Lt7BC](http://goo.gl/Lt7BC) > > Disclaimer: The information contained in this message and attachments is > intended solely for the attention and use of the named addressee and may be > confidential. If you are not the intended recipient, you are reminded that the > information remains the property of the sender. You must not use, disclose, > distribute, copy, print or rely on this e-mail. If you have received this > message in error, please contact the sender immediately and irrevocably delete > this message and any copies. > > On Thu, Dec 27, 2012 at 1:21 PM, David Pilato \<[david@pilato.fr](mailto:david@pilato.fr) > [mailto:david@pilato.fr](mailto:david@pilato.fr) \> wrote: > > > > The main issue I can see is the "too many open files" problem. > > > Do you see that in logs? > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 27 déc. 2012 à 12:58, Robin Verlangen \< robin@us2.nl > > [mailto:robin@us2.nl](mailto:robin@us2.nl) \> a écrit : > > > > ``` > > > > > Hi there, > > > > ``` > > > > > ``` > > > Is there a (hard) limit on the number of indices involved in a > > > > > > ``` > > > > > > search. > > > > > > ``` > > > My ES design is really simple: one index per day. When I search on > > > > > > ``` > > > > > > 1 week of data, I generate the dates of the last 7 days and perform a > > > search on them. E.g. 2012-12-20,2012-12-21,...,2012-12-27 > > > > > > ``` > > > However when I try to search one month of data it seems that > > > > > > ``` > > > > > > something goes wrong. Is this a limit of indices to be searched at once? > > > > > > ``` > > > Best regards, > > > > > > Robin Verlangen > > > Software engineer > > > > > > W http://www.robinverlangen.nl > > > E robin@us2.nl > > > > > > > > > Disclaimer: The information contained in this message and > > > > > > ``` > > > > > > attachments is intended solely for the attention and use of the named > > > addressee and may be confidential. If you are not the intended recipient, > > > you are reminded that the information remains the property of the sender. > > > You must not use, disclose, distribute, copy, print or rely on this > > > e-mail. If you have received this message in error, please contact the > > > sender immediately and irrevocably delete this message and any copies. > > > > > > ``` > > > -- > > > > > > ``` > > > > > > > > > > > > -- > > > > > > > -- -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:58am UTC](https://discuss.elastic.co/t/limit-search-on-number-of-indices/10182/5 "2017-07-06T02:58:22Z")