ES Error - No commit point data is available in gateway


(senthil prabhu) #1
  1. Restart Elastic Search, any one index get following error and ES
    Indices were not opened, after the error indices deletion, cluster
    will come green and it’s working fine. So every ES restart we loss any
    one indices.

We are using Elastic search version 16.0

“[01:48:56,425][WARN ][cluster.action.shard ] [O'Sullivan,
Solomon] sending f

ailed shard for [db288_audit][2], node[SoJVrnNpSsy7uDEA3qRnBw], [P],
s[INITIALIZ

ING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException

[[db288_audit][2] No commit point data is available in gateway]]]

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to read commit point [commit-1]

java.lang.ArrayIndexOutOfBoundsException

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] listed commit_point [commit-0]/[0], but not all files exists,
ignoring

[01:48:56,582][WARN ][indices.cluster ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to start shard

org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:
[db288_audit

][2] No commit point data is available in gateway

    at

org.elasticsearch.index.gateway.blobstore.BlobStoreIndexShardGateway.

recover(BlobStoreIndexShardGateway.java:423)

    at org.elasticsearch.index.gateway.IndexShardGatewayService

$1.run(IndexS

hardGatewayService.java:144)

    at java.util.concurrent.ThreadPoolExecutor

$Worker.runTask(ThreadPoolExec

utor.java:886)

    at java.util.concurrent.ThreadPoolExecutor

$Worker.run(ThreadPoolExecutor

.java:908)

    at java.lang.Thread.run(Thread.java:619)”

What's going wrong here....?

Can any one help me...


(Shay Banon) #2

Can you please gist the exception. Which shared gateway are you using?

On Saturday, May 28, 2011 at 7:54 AM, senthil prabhu wrote:

  1. Restart Elastic Search, any one index get following error and ES
    Indices were not opened, after the error indices deletion, cluster
    will come green and it’s working fine. So every ES restart we loss any
    one indices.

We are using Elastic search version 16.0

“[01:48:56,425][WARN ][cluster.action.shard ] [O'Sullivan,
Solomon] sending f

ailed shard for [db288_audit][2], node[SoJVrnNpSsy7uDEA3qRnBw], [P],
s[INITIALIZ

ING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException

[[db288_audit][2] No commit point data is available in gateway]]]

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to read commit point [commit-1]

java.lang.ArrayIndexOutOfBoundsException

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] listed commit_point [commit-0]/[0], but not all files exists,
ignoring

[01:48:56,582][WARN ][indices.cluster ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to start shard

org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:
[db288_audit

][2] No commit point data is available in gateway

at
org.elasticsearch.index.gateway.blobstore.BlobStoreIndexShardGateway.

recover(BlobStoreIndexShardGateway.java:423)

at org.elasticsearch.index.gateway.IndexShardGatewayService
$1.run(IndexS

hardGatewayService.java:144)

at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExec

utor.java:886)

at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor

.java:908)

at java.lang.Thread.run(Thread.java:619)”

What's going wrong here....?

Can any one help me...


(senthil prabhu) #3

We are using FS shared gateway and the Exception i am getting is

“[01:48:56,425][WARN ][cluster.action.shard ] [O'Sullivan,
Solomon] sending failed shard for [db288_audit][2],
node[SoJVrnNpSsy7uDEA3qRnBw], [P], s[INITIALIZ
ING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[db288_audit][2] No commit point
data is available in gateway]]]
[01:48:56,582][WARN ][index.gateway.fs] [O'Sullivan, Solomon]
[db288_audit][2] failed to read commit point
[commit-1]java.lang.ArrayIndexOutOfBoundsException
[01:48:56,582][WARN ][index.gateway.fs] [O'Sullivan, Solomon]
[db288_audit][2] listed commit_point [commit-0]/[0], but not all files
exists, ignoring
[01:48:56,582][WARN ][indices.cluster] [O'Sullivan, Solomon]
[db288_audit][2] failed to start
shardorg.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:
[db288_audit][2] No commit point data is available in gateway at
org.elasticsearch.index.gateway.blobstore.BlobStoreIndexShardGateway.recover(BlobStoreIndexShardGateway.java:
423) at org.elasticsearch.index.gateway.IndexShardGatewayService
$1.run(IndexShardGatewayService.java:144) at
java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886) at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:908) at java.lang.Thread.run(Thread.java:619)”

On May 28, 2:18 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Can you please gist the exception. Which shared gateway are you using?

On Saturday, May 28, 2011 at 7:54 AM, senthil prabhu wrote:

  1. Restart Elastic Search, any one index get following error and ES
    Indices were not opened, after the error indices deletion, cluster
    will come green and it’s working fine. So every ES restart we loss any
    one indices.

We are using Elastic search version 16.0

“[01:48:56,425][WARN ][cluster.action.shard ] [O'Sullivan,
Solomon] sending f

ailed shard for [db288_audit][2], node[SoJVrnNpSsy7uDEA3qRnBw], [P],
s[INITIALIZ

ING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException

[[db288_audit][2] No commit point data is available in gateway]]]

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to read commit point [commit-1]

java.lang.ArrayIndexOutOfBoundsException

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] listed commit_point [commit-0]/[0], but not all files exists,
ignoring

[01:48:56,582][WARN ][indices.cluster ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to start shard

org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:
[db288_audit

][2] No commit point data is available in gateway

at
org.elasticsearch.index.gateway.blobstore.BlobStoreIndexShardGateway.

recover(BlobStoreIndexShardGateway.java:423)

at org.elasticsearch.index.gateway.IndexShardGatewayService
$1.run(IndexS

hardGatewayService.java:144)

at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExec

utor.java:886)

at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor

.java:908)

at java.lang.Thread.run(Thread.java:619)”

What's going wrong here....?

Can any one help me...


(Shay Banon) #4

Can you GIST (http://gist.github.com) the full log of the node where you see this exception?

On Saturday, May 28, 2011 at 2:30 PM, senthil prabhu wrote:

We are using FS shared gateway and the Exception i am getting is

“[01:48:56,425][WARN ][cluster.action.shard ] [O'Sullivan,
Solomon] sending failed shard for [db288_audit][2],
node[SoJVrnNpSsy7uDEA3qRnBw], [P], s[INITIALIZ
ING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[db288_audit][2] No commit point
data is available in gateway]]]
[01:48:56,582][WARN ][index.gateway.fs] [O'Sullivan, Solomon]
[db288_audit][2] failed to read commit point
[commit-1]java.lang.ArrayIndexOutOfBoundsException
[01:48:56,582][WARN ][index.gateway.fs] [O'Sullivan, Solomon]
[db288_audit][2] listed commit_point [commit-0]/[0], but not all files
exists, ignoring
[01:48:56,582][WARN ][indices.cluster] [O'Sullivan, Solomon]
[db288_audit][2] failed to start
shardorg.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:
[db288_audit][2] No commit point data is available in gateway at
org.elasticsearch.index.gateway.blobstore.BlobStoreIndexShardGateway.recover(BlobStoreIndexShardGateway.java:
423) at org.elasticsearch.index.gateway.IndexShardGatewayService
$1.run(IndexShardGatewayService.java:144) at
java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886) at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:908) at java.lang.Thread.run(Thread.java:619)”

On May 28, 2:18 pm, Shay Banon <shay.ba...@elasticsearch.com (http://elasticsearch.com)> wrote:

Can you please gist the exception. Which shared gateway are you using?

On Saturday, May 28, 2011 at 7:54 AM, senthil prabhu wrote:

  1. Restart Elastic Search, any one index get following error and ES
    Indices were not opened, after the error indices deletion, cluster
    will come green and it’s working fine. So every ES restart we loss any
    one indices.

We are using Elastic search version 16.0

“[01:48:56,425][WARN ][cluster.action.shard ] [O'Sullivan,
Solomon] sending f

ailed shard for [db288_audit][2], node[SoJVrnNpSsy7uDEA3qRnBw], [P],
s[INITIALIZ

ING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException

[[db288_audit][2] No commit point data is available in gateway]]]

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to read commit point [commit-1]

java.lang.ArrayIndexOutOfBoundsException

[01:48:56,582][WARN ][index.gateway.fs ] [O'Sullivan, Solomon]
[db288_au

dit][2] listed commit_point [commit-0]/[0], but not all files exists,
ignoring

[01:48:56,582][WARN ][indices.cluster ] [O'Sullivan, Solomon]
[db288_au

dit][2] failed to start shard

org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:
[db288_audit

][2] No commit point data is available in gateway

at
org.elasticsearch.index.gateway.blobstore.BlobStoreIndexShardGateway.

recover(BlobStoreIndexShardGateway.java:423)

at org.elasticsearch.index.gateway.IndexShardGatewayService
$1.run(IndexS

hardGatewayService.java:144)

at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExec

utor.java:886)

at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor

.java:908)

at java.lang.Thread.run(Thread.java:619)”

What's going wrong here....?

Can any one help me...


(fashionalwallet) #5
  • deleted -

(system) #6