NFS Gateway errors

Elastic Stack Elasticsearch
1

Hello,

We are deploying ElasticSearch for an exciting project at a
University. It has gone well with just a couple of errors.

One of the errors has to do with the gateway that is stored on a an
NFS file server.

[WARN] [Professor Power] [system][0] failed to obtain snapshot lock,
ignoring snapshot
org.elasticsearch.ElasticSearchIllegalStateException: failed to obtain
snapshot lock [NativeFSLock@/export/home/apps/hbs/local/localhost/WEB-
INF/data/elastic/gateway/entermediaprod/indices/system/0/
snapshot.lock] at
org.elasticsearch.index.gateway.fs.FsIndexShardGateway.obtainSnapshotLock(FsIndexShardGateway.java:
65)
at
org.elasticsearch.index.gateway.IndexShardGatewayService.snapshot(IndexShardGatewayService.java:
258)
at org.elasticsearch.index.gateway.IndexShardGatewayService
$SnapshotRunnable.run(IndexShardGatewayService.java:365)
at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

2

Looks like there is a possible solution:

gateway.fs.snapshot_lock = false

Now we will just need to keep an eye out for split brain condition.

http://elasticsearch-users.115913.n3.nabble.com/Ensuring-Gateway-integrity-td1849804.html

On Wed, Aug 10, 2011 at 5:27 PM, Christopher Burkey
cburkey@entermediasoftware.com wrote:

Hello,

We are deploying Elasticsearch for an exciting project at a
University. It has gone well with just a couple of errors.

One of the errors has to do with the gateway that is stored on a an
NFS file server.

[WARN] [Professor Power] [system][0] failed to obtain snapshot lock,
ignoring snapshot
org.elasticsearch.ElasticSearchIllegalStateException: failed to obtain
snapshot lock [NativeFSLock@/export/home/apps/hbs/local/localhost/WEB-
INF/data/elastic/gateway/entermediaprod/indices/system/0/
snapshot.lock] at
org.elasticsearch.index.gateway.fs.FsIndexShardGateway.obtainSnapshotLock(FsIndexShardGateway.java:
65)
at
org.elasticsearch.index.gateway.IndexShardGatewayService.snapshot(IndexShardGatewayService.java:
258)
at org.elasticsearch.index.gateway.IndexShardGatewayService
$SnapshotRunnable.run(IndexShardGatewayService.java:365)
at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

3

Why are you using NFS gateway? I recommend using the (default) local
gateway.

On Thu, Aug 11, 2011 at 2:11 AM, Christopher Burkey cburkey@openedit.orgwrote:

Looks like there is a possible solution:

gateway.fs.snapshot_lock = false

Now we will just need to keep an eye out for split brain condition.

http://elasticsearch-users.115913.n3.nabble.com/Ensuring-Gateway-integrity-td1849804.html

On Wed, Aug 10, 2011 at 5:27 PM, Christopher Burkey
cburkey@entermediasoftware.com wrote:

Hello,

We are deploying Elasticsearch for an exciting project at a
University. It has gone well with just a couple of errors.

One of the errors has to do with the gateway that is stored on a an
NFS file server.

[WARN] [Professor Power] [system][0] failed to obtain snapshot lock,
ignoring snapshot
org.elasticsearch.ElasticSearchIllegalStateException: failed to obtain
snapshot lock [NativeFSLock@/export/home/apps/hbs/local/localhost/WEB-
INF/data/elastic/gateway/entermediaprod/indices/system/0/
snapshot.lock] at

org.elasticsearch.index.gateway.fs.FsIndexShardGateway.obtainSnapshotLock(FsIndexShardGateway.java:

  1. at

org.elasticsearch.index.gateway.IndexShardGatewayService.snapshot(IndexShardGatewayService.java:

  1. at org.elasticsearch.index.gateway.IndexShardGatewayService
    $SnapshotRunnable.run(IndexShardGatewayService.java:365)
    at java.util.concurrent.ThreadPoolExecutor
    $Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor
    $Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)