Index size on node VS heap size


(adam.porat@gmail.com) #1

Hi,

Let's say my machine has 40G of RAM, and so I set HEAP_SIZE to 20G, as 

recommended.

And let's say I have a single index on the machine.

Rougly, how large can the index be to maintain good performance? Must 

it be somewhat less than 20G?

Thank you.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e794ceab-d16e-4405-9775-cab138b35f26%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

No it can be more, it depends on what sort of queries you are doing and
what data structures/types you are indexing.

Best bet is to keep throwing data at the index until the server can't take
it, then you know the limit.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 August 2014 16:18, Adam Porat adam.porat@gmail.com wrote:

Hi,

Let's say my machine has 40G of RAM, and so I set HEAP_SIZE to 20G, as

recommended.

And let's say I have a single index on the machine.

Rougly, how large can the index be to maintain good performance? Must

it be somewhat less than 20G?

Thank you.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e794ceab-d16e-4405-9775-cab138b35f26%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e794ceab-d16e-4405-9775-cab138b35f26%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624ZsP4K%3D%3DoKGy3JCwXcgWowcKaW0Ki%2BLS7rsJh%2BGRgWYZQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(adam.porat@gmail.com) #3

Thanks Mark.

בתאריך יום שלישי, 12 באוגוסט 2014 09:20:43 UTC+3, מאת Mark Walkom:

No it can be more, it depends on what sort of queries you are doing and
what data structures/types you are indexing.

Best bet is to keep throwing data at the index until the server can't take
it, then you know the limit.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 12 August 2014 16:18, Adam Porat <adam....@gmail.com <javascript:>>
wrote:

Hi,

Let's say my machine has 40G of RAM, and so I set HEAP_SIZE to 20G, 

as recommended.

And let's say I have a single index on the machine.

Rougly, how large can the index be to maintain good performance? Must 

it be somewhat less than 20G?

Thank you.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e794ceab-d16e-4405-9775-cab138b35f26%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e794ceab-d16e-4405-9775-cab138b35f26%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/dbfab38e-fd9f-4a84-a498-9c8d44ff5ea1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #4