Mlockall fails

Ophir_Michaeli · April 4, 2013, 3:55pm

Hi,

I set "bootstrap.mlockall = true" at elasticsearch.yml and added
"common.jna: DEBUG " at config.yml.

At logs\ pinterest_cluster.log I get the following message: " unable to
link C library. native methods (mlockall) will be disabled".

Any idea how to solve this?

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

jprante · April 4, 2013, 4:34pm

Which operating system an architecture is this?

One idea to solve this: check if your OS / security subsystem allows
loading of shared libraries from the file system you have installed ES on.

Jörg

Am 04.04.13 17:55, schrieb Ophir Michaeli:

Hi,

I set "bootstrap.mlockall = true" at elasticsearch.yml and added
"common.jna: DEBUG " at config.yml.

At logs\pinterest_cluster.log I get the following message: "unable to
link C library. native methods (mlockall) will be disabled".

Any idea how to solve this?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Ophir_Michaeli · April 4, 2013, 4:40pm

Windows server 2008 R2, 64bit.

How do I check if my OS / security subsystem allows
loading of shared libraries from the file system I installed ES on?

Thanks J

On Thursday, April 4, 2013 6:55:52 PM UTC+3, Ophir Michaeli wrote:

Hi,

I set "bootstrap.mlockall = true" at elasticsearch.yml and added
"common.jna: DEBUG " at config.yml.

At logs\ pinterest_cluster.log I get the following message: " unable to
link C library. native methods (mlockall) will be disabled".

Any idea how to solve this?

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

jprante · April 4, 2013, 7:05pm

There is no mlockall() call in WIndows. It's UNIX/Linux only.

Jörg

Am 04.04.13 18:40, schrieb Ophir Michaeli:

Windows server 2008 R2, 64bit.

How do I check if my OS / security subsystem allows
loading of shared libraries from the file system I installed ES on?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Ophir_Michaeli · April 7, 2013, 7:55am

Thanks, at the elasticsearch documentation it doesn't say it's for
Unix/Linux only:

"

Memory Settings

There is an option to use mlockallhttp://opengroup.org/onlinepubs/007908799/xsh/mlockall.htmlto try and lock the process address space so it won’t be swapped. For this
to work, the bootstrap.mlockall should be set to true and it is recommended
to set both the min and max memory allocation to be the same.

In order to see if this works or not, set the common.jna logging to DEBUG
level. A solution to “Unknown mlockall error 0” can be to set ulimit -l
unlimited.

Note, this is experimental feature, and might cause the JVM or shell
session to exit if failing to allocate the memory (because not enough
memory is available on the machine).

"

On Thursday, April 4, 2013 10:05:49 PM UTC+3, Jörg Prante wrote:

There is no mlockall() call in WIndows. It's UNIX/Linux only.

Jörg

Am 04.04.13 18:40, schrieb Ophir Michaeli:

Windows server 2008 R2, 64bit.

How do I check if my OS / security subsystem allows
loading of shared libraries from the file system I installed ES on?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

simonw_2 · April 7, 2013, 10:48am

On Sunday, April 7, 2013 9:55:26 AM UTC+2, Ophir Michaeli wrote:

Thanks, at the elasticsearch documentation it doesn't say it's for
Unix/Linux only:

I added a note to the website
(Elasticsearch Platform — Find real-time answers at scale | Elastic) that
states that it is only available on linux / unix

simon

"

Memory Settings

There is an option to use mlockallhttp://opengroup.org/onlinepubs/007908799/xsh/mlockall.htmlto try and lock the process address space so it won’t be swapped. For this
to work, the bootstrap.mlockall should be set to true and it is recommended
to set both the min and max memory allocation to be the same.

In order to see if this works or not, set the common.jna logging to DEBUG
level. A solution to “Unknown mlockall error 0” can be to set ulimit -l
unlimited.

Note, this is experimental feature, and might cause the JVM or shell
session to exit if failing to allocate the memory (because not enough
memory is available on the machine).

"

On Thursday, April 4, 2013 10:05:49 PM UTC+3, Jörg Prante wrote:

There is no mlockall() call in WIndows. It's UNIX/Linux only.

Jörg

Am 04.04.13 18:40, schrieb Ophir Michaeli:

Windows server 2008 R2, 64bit.

How do I check if my OS / security subsystem allows
loading of shared libraries from the file system I installed ES on?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

timbunce · April 8, 2013, 9:35am

On Sun, Apr 07, 2013 at 03:48:44AM -0700, simonw wrote:

On Sunday, April 7, 2013 9:55:26 AM UTC+2, Ophir Michaeli wrote:

 Thanks, at the elasticsearch documentation it doesn't say it's for Unix/Linux only:

I added a note to the website (Elasticsearch Platform — Find real-time answers at scale | Elastic) that
states that it is only available on linux / unix
simon

 "
 Memory Settings

 There is an option to use [1]mlockall to try and lock the process address space so it won’t be
 swapped. For this to work, the bootstrap.mlockall should be set to true and it is recommended to set
 both the min and max memory allocation to be the same.

 In order to see if this works or not, set the common.jna logging to DEBUG level. A solution to
 “Unknown mlockall error 0” can be to set ulimit -l unlimited.

 Note, this is experimental feature, and might cause the JVM or shell session to exit if failing to
 allocate the memory (because not enough memory is available on the machine).
 "

It would be worth also pointing out that mlockall is not effective in a
virtualized environment. The guest O/S can lock the pages, but that
doesn't stop the host O/S stealing them for other processes/VMs.

Tim.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Clinton_Gormley · April 8, 2013, 7:01pm

Hi Tim

It would be worth also pointing out that mlockall is not effective in a
virtualized environment. The guest O/S can lock the pages, but that
doesn't stop the host O/S stealing them for other processes/VMs.

I know that mlockall isn't supported in Qemu, but is the above true for
Xen based VMs as well?

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.