Shard faliure


(Kartavya) #1

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message [IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested: EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested: FileNotFoundException[D:\elasticsearc
h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind
ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.


(Shay Banon) #2

Seems like a file from the index is missing, any chance you can start to
use a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message [IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind
ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.


(Kartavya) #3

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start to use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal pulkitdotcom@gmail.com
wrote:

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message [IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind
ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.


(Kartavya) #4

A fix I made for the same.

I create one more elasticsearch index with same index and mapping
configuration.
Then, I replace the 3rd shard (corrupt one) with the 3rd shard on the
running elasticsearch instance.

It cause me data loss but now the corrupted instance running fine now with
all shards.

Please validate my approach.

Thanks,
Pulkit Agrawal

On Thu, May 17, 2012 at 1:32 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start to
use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal pulkitdotcom@gmail.com
wrote:

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message
[IndexShardGatewayRecoveryExceptio

n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind

ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.


(Shay Banon) #5

That will work, yes.

On Thu, May 17, 2012 at 1:58 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

A fix I made for the same.

I create one more elasticsearch index with same index and mapping
configuration.
Then, I replace the 3rd shard (corrupt one) with the 3rd shard on the
running elasticsearch instance.

It cause me data loss but now the corrupted instance running fine now with
all shards.

Please validate my approach.

Thanks,
Pulkit Agrawal

On Thu, May 17, 2012 at 1:32 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start
to use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal <pulkitdotcom@gmail.com

wrote:

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message
[IndexShardGatewayRecoveryExceptio

n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind

ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.


(Kartavya) #6

Thanks, Shay

Regards,
Pulkit Agrawal

On Mon, May 21, 2012 at 1:13 AM, Shay Banon kimchy@gmail.com wrote:

That will work, yes.

On Thu, May 17, 2012 at 1:58 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

A fix I made for the same.

I create one more elasticsearch index with same index and mapping
configuration.
Then, I replace the 3rd shard (corrupt one) with the 3rd shard on the
running elasticsearch instance.

It cause me data loss but now the corrupted instance running fine now
with all shards.

Please validate my approach.

Thanks,
Pulkit Agrawal

On Thu, May 17, 2012 at 1:32 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start
to use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal <
pulkitdotcom@gmail.com>
wrote:

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message
[IndexShardGatewayRecoveryExceptio

n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind

ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.


(system) #7