Memory requirements


(Albin Stigo) #1

Hello,

I'm building a site (a "dictionary") using couchdb, es and the couchdb
river plugin. The database contains around 40000 words and short
definitions.

I would now like to host this on a VPS and my question is: What are
the memory (ram) requirements (how can I estimate?), is there a way to
experiment with this on my dev box (it has 4gb and am just using the
standard out-of-the-box settings)? Does "top" provide a good estimate?

--Albin


(Shay Banon) #2

By default, ES_MAX_MEM is set to 1gb. For such a small index, you can certainly go with less. The way to test it is to simply index the data, run some searches, and check that things are ok memory wise.
On Saturday, February 19, 2011 at 5:54 PM, Albin Stigo wrote:

Hello,

I'm building a site (a "dictionary") using couchdb, es and the couchdb
river plugin. The database contains around 40000 words and short
definitions.

I would now like to host this on a VPS and my question is: What are
the memory (ram) requirements (how can I estimate?), is there a way to
experiment with this on my dev box (it has 4gb and am just using the
standard out-of-the-box settings)? Does "top" provide a good estimate?

--Albin


(Jagmee) #3

Hi,

If i try to index of 1 lac docs (including searches) then how much
would be of my RAM size?

-jagmee

On Feb 20, 6:15 am, Shay Banon shay.ba...@elasticsearch.com wrote:

By default, ES_MAX_MEM is set to 1gb. For such a small index, you can certainly go with less. The way to test it is to simply index the data, run some searches, and check that things are ok memory wise.

On Saturday, February 19, 2011 at 5:54 PM, Albin Stigo wrote:

Hello,

I'm building a site (a "dictionary") using couchdb, es and the couchdb
river plugin. The database contains around 40000 words and short
definitions.

I would now like to host this on a VPS and my question is: What are
the memory (ram) requirements (how can I estimate?), is there a way to
experiment with this on my dev box (it has 4gb and am just using the
standard out-of-the-box settings)? Does "top" provide a good estimate?

--Albin


(Shay Banon) #4

Can't answer that, as it varies greatly depending on many factors, including type of searches, sorting, facets, number of terms the index ends up with.

You need to test it, and see. The node stats api can give a lot of info when it comes ot memory allocations.
On Friday, February 25, 2011 at 11:30 PM, Jagmee wrote:

Hi,

If i try to index of 1 lac docs (including searches) then how much
would be of my RAM size?

-jagmee

On Feb 20, 6:15 am, Shay Banon shay.ba...@elasticsearch.com wrote:

By default, ES_MAX_MEM is set to 1gb. For such a small index, you can certainly go with less. The way to test it is to simply index the data, run some searches, and check that things are ok memory wise.

On Saturday, February 19, 2011 at 5:54 PM, Albin Stigo wrote:

Hello,

I'm building a site (a "dictionary") using couchdb, es and the couchdb
river plugin. The database contains around 40000 words and short
definitions.

I would now like to host this on a VPS and my question is: What are
the memory (ram) requirements (how can I estimate?), is there a way to
experiment with this on my dev box (it has 4gb and am just using the
standard out-of-the-box settings)? Does "top" provide a good estimate?

--Albin


(system) #5