# How much data can one Standalone instance handle?

**URL:** <https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698>\
**Category:** Elasticsearch\
**Created:** [August 3, 2017, 10:59am UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698 "2017-08-03T10:59:23Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![glifhits](https://avatars.discourse-cdn.com/v4/letter/g/dec6dc/32.png) [@glifhits](https://discuss.elastic.co/u/glifhits)\
**Post date:** [August 3, 2017, 10:59am UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/1 "2017-08-03T10:59:24Z")

</div>

Hi everyone,  
I am currently running one elastic-search instance on a 2 core / 16gb ram / 250 gig machine. My question is how much will this machine be able to handle until I need to expand the cluster?

Currently, the setup I ingesting about 30,000 records a day so the volume is pretty small.

I guess I'm just curious to know what one elastic search instance can handle before I have to expand.  
Thanks,  
Greg

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [August 4, 2017, 7:12am UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/2 "2017-08-04T07:12:46Z")

</div>

This not only depends on your machine, but also on the documents you are indexing, the mapping configuration (which decides how much data needs to be written per document on disk).

You can check out our [nightly benchmarks](https://elasticsearch-benchmarks.elastic.co) - which however run on more beefy machine, so the ultimate way to find out your ingestion rate is to grab [rally](https://github.com/elastic/rally), our benchmarking tool and run it without your data on your server.

--Alex

---

<div class="post-metadata">

**Author:** ![glifhits](https://avatars.discourse-cdn.com/v4/letter/g/dec6dc/32.png) [@glifhits](https://discuss.elastic.co/u/glifhits)\
**Post date:** [August 7, 2017, 11:40am UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/3 "2017-08-07T11:40:44Z")

</div>

Thanks Alex.  
So as part of this, I think one major problem is my setup I currently have 5,332 shards. Based on some reading I'm doing this is a VERY bad approch to things.

I'm currently organizing data like so:  
"Client-DataType-Day" - So, for example, a shard can look like this: "test-client-website-www.test.com-2017.07.08"  
I think this is creating some serious issues with overhead.

Any recommendations on best practices for organizing shards?

![image](https://us1.discourse-cdn.com/elastic/original/3X/c/a/ca5f899a913250b706a1ab8241605cf4d4e2104c.png)

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [August 7, 2017, 12:18pm UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/4 "2017-08-07T12:18:16Z")

</div>

you could store all that data in a single index and make use of [aliases](https://www.elastic.co/guide/en/elasticsearch/reference/5.5/indices-aliases.html) with a filter

---

<div class="post-metadata">

**Author:** ![glifhits](https://avatars.discourse-cdn.com/v4/letter/g/dec6dc/32.png) [@glifhits](https://discuss.elastic.co/u/glifhits)\
**Post date:** [August 11, 2017, 12:29pm UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/5 "2017-08-11T12:29:45Z")

</div>

Alex,  
So I actually went down this route. But now I have a question about Aliases. Is it possible to filter them by type? I'm currently trying to do it like this:  
{  
"query": {  
"type" : {  
"value" : "ola"  
}  
}

But that does not seem to be working.  
Thanks,  
Greg

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [August 11, 2017, 1:54pm UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/6 "2017-08-11T13:54:10Z")

</div>

you can try filter by `_type` - also note that types will be deprecated in the future, so you might want to change your index strategy.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 8, 2017, 1:54pm UTC](https://discuss.elastic.co/t/how-much-data-can-one-standalone-instance-handle/95698/7 "2017-09-08T13:54:11Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
