Limits on number of indices

Elastic Stack Elasticsearch
1

Hello all;

I am planning to use elasticsearch for user based search purpose.For
each user the estimated amount of data to be indexed if of about 10
gb.If i am going to index 10 gb/user then the size of an index would
explode exponentially and would give a very poor search performance.So
as a solution to this I would plan an index per user architecture.
But my real concern in this is How many Indices an elasticsearch can
support,if there are 2000 users then there be 2000 indices
accordingly.
Please reply if this scenario would be of any practical use or should
I go for a single index having all data stored of all users in that
case size of the index would be tremendous.

Thanks;
Jay.

2

Using index a the separator is probably not a good idea.
How about using mapping type?

for example:

/users/user1/...
/users/user2/...
/users/user3/...

We have tested and have index with thousands of mapping types.
Works fine... however quite slow to create mapping and elastic head
is slower to start also.

--Andrew

On May 10, 8:51 am, jay xmea...@gmail.com wrote:

Hello all;

I am planning to use elasticsearch for user based search purpose.For
each user the estimated amount of data to be indexed if of about 10
gb.If i am going to index 10 gb/user then the size of an index would
explode exponentially and would give a very poor search performance.So
as a solution to this I would plan an index per user architecture.
But my real concern in this is How many Indices an elasticsearch can
support,if there are 2000 users then there be 2000 indices
accordingly.
Please reply if this scenario would be of any practical use or should
I go for a single index having all data stored of all users in that
case size of the index would be tremendous.

Thanks;
Jay.

3

See some answers to that question here:
https://groups.google.com/forum/?fromgroups#!searchin/elasticsearch/data$20flow/elasticsearch/49q-_AgQCp8/MRol0t9asEcJ
.

On Thu, May 10, 2012 at 4:51 PM, jay xmeajay@gmail.com wrote:

Hello all;

I am planning to use elasticsearch for user based search purpose.For
each user the estimated amount of data to be indexed if of about 10
gb.If i am going to index 10 gb/user then the size of an index would
explode exponentially and would give a very poor search performance.So
as a solution to this I would plan an index per user architecture.
But my real concern in this is How many Indices an elasticsearch can
support,if there are 2000 users then there be 2000 indices
accordingly.
Please reply if this scenario would be of any practical use or should
I go for a single index having all data stored of all users in that
case size of the index would be tremendous.

Thanks;
Jay.