Shard faliure

Kartavya · May 16, 2012, 5:29am

Hi

When I am starting my elastic search 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message [IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested: EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested: FileNotFoundException[D:\elasticsearc
h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind
ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.

kimchy · May 16, 2012, 10:12pm

Seems like a file from the index is missing, any chance you can start to
use a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Hi

When I am starting my Elasticsearch 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message [IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind
ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.

Kartavya · May 17, 2012, 8:02am

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start to use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal pulkitdotcom@gmail.com
wrote:

Hi

When I am starting my Elasticsearch 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message [IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind
ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.

Kartavya · May 17, 2012, 11:58am

A fix I made for the same.

I create one more elasticsearch index with same index and mapping
configuration.
Then, I replace the 3rd shard (corrupt one) with the 3rd shard on the
running elasticsearch instance.

It cause me data loss but now the corrupted instance running fine now with
all shards.

Please validate my approach.

Thanks,
Pulkit Agrawal

On Thu, May 17, 2012 at 1:32 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start to
use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal pulkitdotcom@gmail.com
wrote:

Hi

When I am starting my Elasticsearch 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message
[IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind

ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.

kimchy · May 20, 2012, 7:43pm

That will work, yes.

On Thu, May 17, 2012 at 1:58 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

A fix I made for the same.

I create one more elasticsearch index with same index and mapping
configuration.
Then, I replace the 3rd shard (corrupt one) with the 3rd shard on the
running elasticsearch instance.

It cause me data loss but now the corrupted instance running fine now with
all shards.

Please validate my approach.

Thanks,
Pulkit Agrawal

On Thu, May 17, 2012 at 1:32 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start
to use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal <pulkitdotcom@gmail.com

wrote:

Hi

When I am starting my Elasticsearch 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message
[IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind

ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.

Kartavya · May 21, 2012, 4:33am

Thanks, Shay

Regards,
Pulkit Agrawal

On Mon, May 21, 2012 at 1:13 AM, Shay Banon kimchy@gmail.com wrote:

That will work, yes.

On Thu, May 17, 2012 at 1:58 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

A fix I made for the same.

I create one more elasticsearch index with same index and mapping
configuration.
Then, I replace the 3rd shard (corrupt one) with the 3rd shard on the
running elasticsearch instance.

It cause me data loss but now the corrupted instance running fine now
with all shards.

Please validate my approach.

Thanks,
Pulkit Agrawal

On Thu, May 17, 2012 at 1:32 PM, Pulkit Agrawal pulkitdotcom@gmail.comwrote:

Thanks Shay.

can we upgrade running elasticsearch instance?

On Thu, May 17, 2012 at 3:42 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a file from the index is missing, any chance you can start
to use
a newer version of ES than 0.17.7?

On Wed, May 16, 2012 at 8:29 AM, Pulkit Agrawal <
pulkitdotcom@gmail.com>
wrote:

Hi

When I am starting my Elasticsearch 1 out of 5 shard get failed to
recover. I am getting following error.

reason [Failed to start shard, message
[IndexShardGatewayRecoveryExceptio
n[[new_index][3] failed recovery]; nested:
EngineCreationFailureException[[new_i
ndex][3] Failed to create engine]; nested:
FileNotFoundException[D:\elasticsearc

h-0.17.7\elasticsearch-0.17.7\data\elasticsearch\nodes\0\indices\new_index\3\ind

ex_3dsqg.fnm (The system cannot find the file specified)]; ]]

I am creating index using couchdb integration. Can you please tell me
what is the cause of problem and fix of it.

Thanks in advance.