ES heap size slowly but surely increasing


(Aldian) #1

Hi

I upgraded to 1.2.1 and set memory options to 2GB. Two weeks have passed
now and every day I have been checking heap memory level with Bigdesk.

At first I was not sure, but now it is clearly increasing little by little.
One day after I restarted ES it grew to approximately 1.3 GB of used Heap
Memory, and now we are at 1.6GB, which make me guess it is leaking around
150 Mo Heap Memory a week.

I am the only one experiencing such problem? And do you know what could
cause it?

Best,

Aldian

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

Are you indexing new data?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 24 June 2014 20:01, Aldian aldian.gp@gmail.com wrote:

Hi

I upgraded to 1.2.1 and set memory options to 2GB. Two weeks have passed
now and every day I have been checking heap memory level with Bigdesk.

At first I was not sure, but now it is clearly increasing little by
little. One day after I restarted ES it grew to approximately 1.3 GB of
used Heap Memory, and now we are at 1.6GB, which make me guess it is
leaking around 150 Mo Heap Memory a week.

I am the only one experiencing such problem? And do you know what could
cause it?

Best,

Aldian

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Aldian) #3

Yes I am, but... This data should be stored somewhere on the disk, right?

2014-06-24 12:03 GMT+02:00 Mark Walkom markw@campaignmonitor.com:

Are you indexing new data?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 24 June 2014 20:01, Aldian aldian.gp@gmail.com wrote:

Hi

I upgraded to 1.2.1 and set memory options to 2GB. Two weeks have passed
now and every day I have been checking heap memory level with Bigdesk.

At first I was not sure, but now it is clearly increasing little by
little. One day after I restarted ES it grew to approximately 1.3 GB of
used Heap Memory, and now we are at 1.6GB, which make me guess it is
leaking around 150 Mo Heap Memory a week.

I am the only one experiencing such problem? And do you know what could
cause it?

Best,

Aldian

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/eMA_PCZQLss/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
Cordialement,

Aldian

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAECUaLw7F-p9Rnz1Bvfr2Pwu1Jzyan0QFi8zp%2Bz-3W_Gi4m_bA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #4

Yes, but there is still overhead that the cluster needs to store in memory,
the metadata about the data.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 24 June 2014 23:38, Aldian aldian.gp@gmail.com wrote:

Yes I am, but... This data should be stored somewhere on the disk, right?

2014-06-24 12:03 GMT+02:00 Mark Walkom markw@campaignmonitor.com:

Are you indexing new data?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 24 June 2014 20:01, Aldian aldian.gp@gmail.com wrote:

Hi

I upgraded to 1.2.1 and set memory options to 2GB. Two weeks have passed
now and every day I have been checking heap memory level with Bigdesk.

At first I was not sure, but now it is clearly increasing little by
little. One day after I restarted ES it grew to approximately 1.3 GB of
used Heap Memory, and now we are at 1.6GB, which make me guess it is
leaking around 150 Mo Heap Memory a week.

I am the only one experiencing such problem? And do you know what could
cause it?

Best,

Aldian

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/eMA_PCZQLss/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
Cordialement,

Aldian

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAECUaLw7F-p9Rnz1Bvfr2Pwu1Jzyan0QFi8zp%2Bz-3W_Gi4m_bA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAECUaLw7F-p9Rnz1Bvfr2Pwu1Jzyan0QFi8zp%2Bz-3W_Gi4m_bA%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624aD%3DBCMESSSDjT6Jd7nbmp_1vNrMzXOwSRhB0s39gop-A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Michael Hart) #5

It's entirely normal for ES (or any Java program) to use 75-80% of the heap
during normal operation. The Garbage Collector will take care of things,
and is typically a bit "lazy" about cleaning up.

mike

On Tuesday, June 24, 2014 7:21:49 PM UTC-4, Mark Walkom wrote:

Yes, but there is still overhead that the cluster needs to store in
memory, the metadata about the data.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 24 June 2014 23:38, Aldian <aldi...@gmail.com <javascript:>> wrote:

Yes I am, but... This data should be stored somewhere on the disk, right?

2014-06-24 12:03 GMT+02:00 Mark Walkom <ma...@campaignmonitor.com
<javascript:>>:

Are you indexing new data?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 24 June 2014 20:01, Aldian <aldi...@gmail.com <javascript:>> wrote:

Hi

I upgraded to 1.2.1 and set memory options to 2GB. Two weeks have
passed now and every day I have been checking heap memory level with
Bigdesk.

At first I was not sure, but now it is clearly increasing little by
little. One day after I restarted ES it grew to approximately 1.3 GB of
used Heap Memory, and now we are at 1.6GB, which make me guess it is
leaking around 150 Mo Heap Memory a week.

I am the only one experiencing such problem? And do you know what could
cause it?

Best,

Aldian

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com <javascript:>.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9481c6a9-0690-4ac5-be26-d913e1700c0e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/eMA_PCZQLss/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624afa-DiX%2B4C48wCUZhhgXA16YkzEwx-_u%2B-v2Xxq7SvfA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
Cordialement,

Aldian

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAECUaLw7F-p9Rnz1Bvfr2Pwu1Jzyan0QFi8zp%2Bz-3W_Gi4m_bA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAECUaLw7F-p9Rnz1Bvfr2Pwu1Jzyan0QFi8zp%2Bz-3W_Gi4m_bA%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f9fa0c8b-8ba8-4a0f-b816-f6ab7ee47773%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #6