Weird error while trying to create S3 Repository using elasticsearch-cloud-aws plugin

sagarit2 · February 17, 2015, 2:43am

Hi,

We are seeing some weird exception while trying to run Snapshot backup
using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES 1.4.1
clusters:

    PutRepositoryResponse putRepositoryResponse =

client.admin().cluster().preparePutRepository("test-repo")

.setType("s3").setSettings(ImmutableSettings.settingsBuilder()
.put("base_path", getBasePath())
.put("region", getRegion())
).get();

But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException:
Failed to deserialize exception response from stream

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)*
at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*
at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*
at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*
... 1 more*
Caused by: java.lang.ClassCastException: cannot assign instance of
com.amazonaws.AmazonServiceException$ErrorType to field
com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String
in instance of com.amazonaws.services.s3.model.AmazonS3Exception
at
java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)*
at
java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)*
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)*
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)*
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*
at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*
at java.lang.Throwable.readObject(Throwable.java:914)*
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*
at java.lang.reflect.Method.invoke(Method.java:606)*
at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*
at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*
at java.lang.Throwable.readObject(Throwable.java:914)*
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*
at java.lang.reflect.Method.invoke(Method.java:606)*
at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)*
at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)*
at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*
at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*
at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*
at java.lang.Thread.run(Thread.java:745)*

Weird part is that the S3 Repository is Created Successfully but
preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

dadoonet · February 17, 2015, 7:44am

Weird indeed. Are you mixing versions within the cluster?
I mean ES versions, Java versions and cloud-aws plugin versions. Could you give the output for GET _cat/plugins?v

If you are using exactly same versions, can you open an issue in cloud-aws plugin with all details you wrote?

David

Le 17 févr. 2015 à 03:43, sagarl sagarit2@gmail.com a écrit :

Hi,

We are seeing some weird exception while trying to run Snapshot backup using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES 1.4.1 clusters:
    PutRepositoryResponse putRepositoryResponse = client.admin().cluster().preparePutRepository("test-repo")
            .setType("s3").setSettings(ImmutableSettings.settingsBuilder()
                    .put("base_path", getBasePath())
                    .put("region", getRegion())
            ).get();
But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize exception response from stream
at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more
Caused by: java.lang.ClassCastException: cannot assign instance of com.amazonaws.AmazonServiceException$ErrorType to field com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String in instance of com.amazonaws.services.s3.model.AmazonS3Exception
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)
at java.lang.Throwable.readObject(Throwable.java:914)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)
at java.lang.Throwable.readObject(Throwable.java:914)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Weird part is that the S3 Repository is Created Successfully but preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/00A1F271-ED17-4FDB-A4CA-F08E8519F3F3%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

sagarit2 · February 17, 2015, 9:40am

Hi David,

Following is the output of plugins:

name component version type url
i-8a3f8d9d cloud-aws 2.4.1 j
i-8a3f8d9d river-jira 1.8.1 j
i-8a3f8d9d bigdesk NA s /_plugin/bigdesk/
i-8a3f8d9d kopf 1.4.5 s /_plugin/kopf/
i-8a3f8d9d head NA s /_plugin/head/
i-8a3f8d9d HQ NA s /_plugin/HQ/
i-8a3f8d9d inquisitor NA s /_plugin/inquisitor/
i-94ade4f6 cloud-aws 2.4.1 j
i-94ade4f6 river-jira 1.8.1 j
i-94ade4f6 bigdesk NA s /_plugin/bigdesk/
i-94ade4f6 kopf 1.4.5 s /_plugin/kopf/
i-94ade4f6 head NA s /_plugin/head/
i-94ade4f6 HQ NA s /_plugin/HQ/
i-94ade4f6 inquisitor NA s /_plugin/inquisitor/
i-4f409284 cloud-aws 2.4.1 j
i-4f409284 river-jira 1.8.1 j
i-4f409284 bigdesk NA s /_plugin/bigdesk/
i-4f409284 kopf 1.4.5 s /_plugin/kopf/
i-4f409284 head NA s /_plugin/head/
i-4f409284 HQ NA s /_plugin/HQ/
i-4f409284 inquisitor NA s /_plugin/inquisitor/
i-e1f1e899 cloud-aws 2.4.1 j
i-e1f1e899 river-jira 1.8.1 j
i-e1f1e899 bigdesk NA s /_plugin/bigdesk/
i-e1f1e899 kopf 1.4.5 s /_plugin/kopf/
i-e1f1e899 head NA s /_plugin/head/
i-e1f1e899 HQ NA s /_plugin/HQ/
i-e1f1e899 inquisitor NA s /_plugin/inquisitor/
i-4ga9477a cloud-aws 2.4.1 j
i-4ga9477a river-jira 1.8.1 j
i-4ga9477a bigdesk NA s /_plugin/bigdesk/
i-4ga9477a kopf 1.4.5 s /_plugin/kopf/
i-4ga9477a head NA s /_plugin/head/
i-4ga9477a HQ NA s /_plugin/HQ/
i-4ga9477a inquisitor NA s /_plugin/inquisitor/
i-3ba84685 cloud-aws 2.4.1 j
i-3ba84685 river-jira 1.8.1 j
i-3ba84685 bigdesk NA s /_plugin/bigdesk/
i-3ba84685 kopf 1.4.5 s /_plugin/kopf/
i-3ba84685 head NA s /_plugin/head/
i-3ba84685 HQ NA s /_plugin/HQ/
i-3ba84685 inquisitor NA s /_plugin/inquisitor/

ES Version is same across the cluster = 1.4.1

JVM Version across the cluster = 1.7.0_55

I'll still keep on debugging this issue, if I don't find anything; I'll
open an issue.

Thanks,

On Monday, February 16, 2015 at 11:44:55 PM UTC-8, David Pilato wrote:

Weird indeed. Are you mixing versions within the cluster?
I mean ES versions, Java versions and cloud-aws plugin versions. Could you
give the output for GET _cat/plugins?v

If you are using exactly same versions, can you open an issue in cloud-aws
plugin with all details you wrote?

David

Le 17 févr. 2015 à 03:43, sagarl <saga...@gmail.com <javascript:>> a
écrit :

Hi,

We are seeing some weird exception while trying to run Snapshot backup
using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES
1.4.1 clusters:
    PutRepositoryResponse putRepositoryResponse = 
client.admin().cluster().preparePutRepository("test-repo")

.setType("s3").setSettings(ImmutableSettings.settingsBuilder()
.put("base_path", getBasePath())
.put("region", getRegion())
).get();

But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException:
Failed to deserialize exception response from stream

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*

at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*

at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

... 1 more*
Caused by: java.lang.ClassCastException: cannot assign instance of
com.amazonaws.AmazonServiceException$ErrorType to field
com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String
in instance of com.amazonaws.services.s3.model.AmazonS3Exception

at
java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)*

at
java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)*

at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*

at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*

at java.lang.Throwable.readObject(Throwable.java:914)*

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*

at java.lang.reflect.Method.invoke(Method.java:606)*

at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*

at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*

at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*

at java.lang.Throwable.readObject(Throwable.java:914)*

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*

at java.lang.reflect.Method.invoke(Method.java:606)*

at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*

at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*

at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*

at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

at java.lang.Thread.run(Thread.java:745)*

Weird part is that the S3 Repository is Created Successfully but
preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

dadoonet · February 17, 2015, 9:51am

Is your Java client using as well elasticsearch 1.4.1 and cloud-aws 2.4.1?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs

Le 17 févr. 2015 à 10:40, sagarl sagarit2@gmail.com a écrit :

Hi David,

Following is the output of plugins:

name component version type url
i-8a3f8d9d cloud-aws 2.4.1 j
i-8a3f8d9d river-jira 1.8.1 j
i-8a3f8d9d bigdesk NA s /_plugin/bigdesk/
i-8a3f8d9d kopf 1.4.5 s /_plugin/kopf/
i-8a3f8d9d head NA s /_plugin/head/
i-8a3f8d9d HQ NA s /_plugin/HQ/
i-8a3f8d9d inquisitor NA s /_plugin/inquisitor/
i-94ade4f6 cloud-aws 2.4.1 j
i-94ade4f6 river-jira 1.8.1 j
i-94ade4f6 bigdesk NA s /_plugin/bigdesk/
i-94ade4f6 kopf 1.4.5 s /_plugin/kopf/
i-94ade4f6 head NA s /_plugin/head/
i-94ade4f6 HQ NA s /_plugin/HQ/
i-94ade4f6 inquisitor NA s /_plugin/inquisitor/
i-4f409284 cloud-aws 2.4.1 j
i-4f409284 river-jira 1.8.1 j
i-4f409284 bigdesk NA s /_plugin/bigdesk/
i-4f409284 kopf 1.4.5 s /_plugin/kopf/
i-4f409284 head NA s /_plugin/head/
i-4f409284 HQ NA s /_plugin/HQ/
i-4f409284 inquisitor NA s /_plugin/inquisitor/
i-e1f1e899 cloud-aws 2.4.1 j
i-e1f1e899 river-jira 1.8.1 j
i-e1f1e899 bigdesk NA s /_plugin/bigdesk/
i-e1f1e899 kopf 1.4.5 s /_plugin/kopf/
i-e1f1e899 head NA s /_plugin/head/
i-e1f1e899 HQ NA s /_plugin/HQ/
i-e1f1e899 inquisitor NA s /_plugin/inquisitor/
i-4ga9477a cloud-aws 2.4.1 j
i-4ga9477a river-jira 1.8.1 j
i-4ga9477a bigdesk NA s /_plugin/bigdesk/
i-4ga9477a kopf 1.4.5 s /_plugin/kopf/
i-4ga9477a head NA s /_plugin/head/
i-4ga9477a HQ NA s /_plugin/HQ/
i-4ga9477a inquisitor NA s /_plugin/inquisitor/
i-3ba84685 cloud-aws 2.4.1 j
i-3ba84685 river-jira 1.8.1 j
i-3ba84685 bigdesk NA s /_plugin/bigdesk/
i-3ba84685 kopf 1.4.5 s /_plugin/kopf/
i-3ba84685 head NA s /_plugin/head/
i-3ba84685 HQ NA s /_plugin/HQ/
i-3ba84685 inquisitor NA s /_plugin/inquisitor/

ES Version is same across the cluster = 1.4.1

JVM Version across the cluster = 1.7.0_55

I'll still keep on debugging this issue, if I don't find anything; I'll open an issue.

Thanks,

On Monday, February 16, 2015 at 11:44:55 PM UTC-8, David Pilato wrote:
Weird indeed. Are you mixing versions within the cluster?
I mean ES versions, Java versions and cloud-aws plugin versions. Could you give the output for GET _cat/plugins?v

If you are using exactly same versions, can you open an issue in cloud-aws plugin with all details you wrote?

David

Le 17 févr. 2015 à 03:43, sagarl <saga...@gmail.com <javascript:>> a écrit :
Hi,

We are seeing some weird exception while trying to run Snapshot backup using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES 1.4.1 clusters:
    PutRepositoryResponse putRepositoryResponse = client.admin().cluster().preparePutRepository("test-repo")
            .setType("s3").setSettings(ImmutableSettings.settingsBuilder()
                    .put("base_path", getBasePath())
                    .put("region", getRegion())
            ).get();
But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize exception response from stream
at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more
Caused by: java.lang.ClassCastException: cannot assign instance of com.amazonaws.AmazonServiceException$ErrorType to field com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String in instance of com.amazonaws.services.s3.model.AmazonS3Exception
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)
at java.lang.Throwable.readObject(Throwable.java:914)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)
at java.lang.Throwable.readObject(Throwable.java:914)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Weird part is that the S3 Repository is Created Successfully but preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3A1B0C70-7DA7-4DD5-9830-17A3560292DC%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

sagarit2 · February 17, 2015, 10:29am

Yes, that's correct.

Thanks

On Tuesday, February 17, 2015 at 1:51:15 AM UTC-8, David Pilato wrote:

Is your Java client using as well elasticsearch 1.4.1 and cloud-aws 2.4.1?

--
David Pilato | Technical Advocate | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr | @scrutmydocs
https://twitter.com/scrutmydocs

Le 17 févr. 2015 à 10:40, sagarl <saga...@gmail.com <javascript:>> a
écrit :

Hi David,

Following is the output of plugins:

name component version type url
i-8a3f8d9d cloud-aws 2.4.1 j
i-8a3f8d9d river-jira 1.8.1 j
i-8a3f8d9d bigdesk NA s /_plugin/bigdesk/
i-8a3f8d9d kopf 1.4.5 s /_plugin/kopf/
i-8a3f8d9d head NA s /_plugin/head/
i-8a3f8d9d HQ NA s /_plugin/HQ/
i-8a3f8d9d inquisitor NA s /_plugin/inquisitor/
i-94ade4f6 cloud-aws 2.4.1 j
i-94ade4f6 river-jira 1.8.1 j
i-94ade4f6 bigdesk NA s /_plugin/bigdesk/
i-94ade4f6 kopf 1.4.5 s /_plugin/kopf/
i-94ade4f6 head NA s /_plugin/head/
i-94ade4f6 HQ NA s /_plugin/HQ/
i-94ade4f6 inquisitor NA s /_plugin/inquisitor/
i-4f409284 cloud-aws 2.4.1 j
i-4f409284 river-jira 1.8.1 j
i-4f409284 bigdesk NA s /_plugin/bigdesk/
i-4f409284 kopf 1.4.5 s /_plugin/kopf/
i-4f409284 head NA s /_plugin/head/
i-4f409284 HQ NA s /_plugin/HQ/
i-4f409284 inquisitor NA s /_plugin/inquisitor/
i-e1f1e899 cloud-aws 2.4.1 j
i-e1f1e899 river-jira 1.8.1 j
i-e1f1e899 bigdesk NA s /_plugin/bigdesk/
i-e1f1e899 kopf 1.4.5 s /_plugin/kopf/
i-e1f1e899 head NA s /_plugin/head/
i-e1f1e899 HQ NA s /_plugin/HQ/
i-e1f1e899 inquisitor NA s /_plugin/inquisitor/
i-4ga9477a cloud-aws 2.4.1 j
i-4ga9477a river-jira 1.8.1 j
i-4ga9477a bigdesk NA s /_plugin/bigdesk/
i-4ga9477a kopf 1.4.5 s /_plugin/kopf/
i-4ga9477a head NA s /_plugin/head/
i-4ga9477a HQ NA s /_plugin/HQ/
i-4ga9477a inquisitor NA s /_plugin/inquisitor/
i-3ba84685 cloud-aws 2.4.1 j
i-3ba84685 river-jira 1.8.1 j
i-3ba84685 bigdesk NA s /_plugin/bigdesk/
i-3ba84685 kopf 1.4.5 s /_plugin/kopf/
i-3ba84685 head NA s /_plugin/head/
i-3ba84685 HQ NA s /_plugin/HQ/
i-3ba84685 inquisitor NA s /_plugin/inquisitor/

ES Version is same across the cluster = 1.4.1

JVM Version across the cluster = 1.7.0_55

I'll still keep on debugging this issue, if I don't find anything; I'll
open an issue.

Thanks,

On Monday, February 16, 2015 at 11:44:55 PM UTC-8, David Pilato wrote:
Weird indeed. Are you mixing versions within the cluster?
I mean ES versions, Java versions and cloud-aws plugin versions. Could
you give the output for GET _cat/plugins?v

If you are using exactly same versions, can you open an issue in
cloud-aws plugin with all details you wrote?

David

Le 17 févr. 2015 à 03:43, sagarl saga...@gmail.com a écrit :

Hi,

We are seeing some weird exception while trying to run Snapshot backup
using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES
1.4.1 clusters:
    PutRepositoryResponse putRepositoryResponse = 
client.admin().cluster().preparePutRepository("test-repo")

.setType("s3").setSettings(ImmutableSettings.settingsBuilder()
.put("base_path", getBasePath())
.put("region", getRegion())
).get();

But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException:
Failed to deserialize exception response from stream

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*

at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*

at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

... 1 more*
Caused by: java.lang.ClassCastException: cannot assign instance of
com.amazonaws.AmazonServiceException$ErrorType to field
com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String
in instance of com.amazonaws.services.s3.model.AmazonS3Exception

at
java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)*

at
java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)*

at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*

at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*

at java.lang.Throwable.readObject(Throwable.java:914)*

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*

at java.lang.reflect.Method.invoke(Method.java:606)*

at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*

at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*

at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*

at java.lang.Throwable.readObject(Throwable.java:914)*

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*

at java.lang.reflect.Method.invoke(Method.java:606)*

at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*

at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*

at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*

at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

at java.lang.Thread.run(Thread.java:745)*

Weird part is that the S3 Repository is Created Successfully but
preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e3ad5440-d0a5-4b64-aae4-56fb14e3f008%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

dadoonet · February 17, 2015, 11:38am

Thanks. Could you put all those details together and open an issue?
Will look at it.

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs

Le 17 févr. 2015 à 11:29, sagarl sagarit2@gmail.com a écrit :

Yes, that's correct.

Thanks

On Tuesday, February 17, 2015 at 1:51:15 AM UTC-8, David Pilato wrote:
Is your Java client using as well elasticsearch 1.4.1 and cloud-aws 2.4.1?

--
David Pilato | Technical Advocate | Elasticsearch.com http://elasticsearch.com/
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs
Le 17 févr. 2015 à 10:40, sagarl <saga...@gmail.com <javascript:>> a écrit :

Hi David,

Following is the output of plugins:

name component version type url
i-8a3f8d9d cloud-aws 2.4.1 j
i-8a3f8d9d river-jira 1.8.1 j
i-8a3f8d9d bigdesk NA s /_plugin/bigdesk/
i-8a3f8d9d kopf 1.4.5 s /_plugin/kopf/
i-8a3f8d9d head NA s /_plugin/head/
i-8a3f8d9d HQ NA s /_plugin/HQ/
i-8a3f8d9d inquisitor NA s /_plugin/inquisitor/
i-94ade4f6 cloud-aws 2.4.1 j
i-94ade4f6 river-jira 1.8.1 j
i-94ade4f6 bigdesk NA s /_plugin/bigdesk/
i-94ade4f6 kopf 1.4.5 s /_plugin/kopf/
i-94ade4f6 head NA s /_plugin/head/
i-94ade4f6 HQ NA s /_plugin/HQ/
i-94ade4f6 inquisitor NA s /_plugin/inquisitor/
i-4f409284 cloud-aws 2.4.1 j
i-4f409284 river-jira 1.8.1 j
i-4f409284 bigdesk NA s /_plugin/bigdesk/
i-4f409284 kopf 1.4.5 s /_plugin/kopf/
i-4f409284 head NA s /_plugin/head/
i-4f409284 HQ NA s /_plugin/HQ/
i-4f409284 inquisitor NA s /_plugin/inquisitor/
i-e1f1e899 cloud-aws 2.4.1 j
i-e1f1e899 river-jira 1.8.1 j
i-e1f1e899 bigdesk NA s /_plugin/bigdesk/
i-e1f1e899 kopf 1.4.5 s /_plugin/kopf/
i-e1f1e899 head NA s /_plugin/head/
i-e1f1e899 HQ NA s /_plugin/HQ/
i-e1f1e899 inquisitor NA s /_plugin/inquisitor/
i-4ga9477a cloud-aws 2.4.1 j
i-4ga9477a river-jira 1.8.1 j
i-4ga9477a bigdesk NA s /_plugin/bigdesk/
i-4ga9477a kopf 1.4.5 s /_plugin/kopf/
i-4ga9477a head NA s /_plugin/head/
i-4ga9477a HQ NA s /_plugin/HQ/
i-4ga9477a inquisitor NA s /_plugin/inquisitor/
i-3ba84685 cloud-aws 2.4.1 j
i-3ba84685 river-jira 1.8.1 j
i-3ba84685 bigdesk NA s /_plugin/bigdesk/
i-3ba84685 kopf 1.4.5 s /_plugin/kopf/
i-3ba84685 head NA s /_plugin/head/
i-3ba84685 HQ NA s /_plugin/HQ/
i-3ba84685 inquisitor NA s /_plugin/inquisitor/

ES Version is same across the cluster = 1.4.1

JVM Version across the cluster = 1.7.0_55

I'll still keep on debugging this issue, if I don't find anything; I'll open an issue.

Thanks,

On Monday, February 16, 2015 at 11:44:55 PM UTC-8, David Pilato wrote:
Weird indeed. Are you mixing versions within the cluster?
I mean ES versions, Java versions and cloud-aws plugin versions. Could you give the output for GET _cat/plugins?v

If you are using exactly same versions, can you open an issue in cloud-aws plugin with all details you wrote?

David

Le 17 févr. 2015 à 03:43, sagarl <saga...@gmail.com <>> a écrit :
Hi,

We are seeing some weird exception while trying to run Snapshot backup using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES 1.4.1 clusters:
    PutRepositoryResponse putRepositoryResponse = client.admin().cluster().preparePutRepository("test-repo")
            .setType("s3").setSettings(ImmutableSettings.settingsBuilder()
                    .put("base_path", getBasePath())
                    .put("region", getRegion())
            ).get();
But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize exception response from stream
at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more
Caused by: java.lang.ClassCastException: cannot assign instance of com.amazonaws.AmazonServiceException$ErrorType to field com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String in instance of com.amazonaws.services.s3.model.AmazonS3Exception
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)
at java.lang.Throwable.readObject(Throwable.java:914)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)
at java.lang.Throwable.readObject(Throwable.java:914)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Weird part is that the S3 Repository is Created Successfully but preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com <>.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/312df44d-6d47-41dd-97ff-5d1863170d56%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e3ad5440-d0a5-4b64-aae4-56fb14e3f008%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/e3ad5440-d0a5-4b64-aae4-56fb14e3f008%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/A4788550-973A-463D-ADB6-D14FD677B89A%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

sagarit2 · February 21, 2015, 12:11am

Hi David,

We finally figured out the issue. It was related to newly created IAM role
which did not have enough permissions to access S3 bucket.

Surprisingly, it was not even obvious from the logs that it was related to
bucket permissions.

Only when one node out of 6 node clusters was on new IAM role (without
access to S3 bucket) and other 5 nodes on old IAM role (with access to S3
bucket), we saw following message in the logs:

[com.amazonaws.request ] Received error response: Status Code: 403, AWS
Service: null, AWS Request ID: F4HOG2A6DBD984E4, AWS Error Code:
AccessDenied, AWS Error Message: Access Denied, S3 Extended Request ID:
S94r3N1

Thanks for you help.

On Tuesday, February 17, 2015 at 3:39:15 AM UTC-8, David Pilato wrote:

Thanks. Could you put all those details together and open an issue?
Will look at it.

--
David Pilato | Technical Advocate | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr | @scrutmydocs
https://twitter.com/scrutmydocs

Le 17 févr. 2015 à 11:29, sagarl <saga...@gmail.com <javascript:>> a
écrit :

Yes, that's correct.

Thanks

On Tuesday, February 17, 2015 at 1:51:15 AM UTC-8, David Pilato wrote:

Is your Java client using as well elasticsearch 1.4.1 and cloud-aws 2.4.1?

--
David Pilato | Technical Advocate | Elasticsearch.com
http://elasticsearch.com/
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr | @scrutmydocs
https://twitter.com/scrutmydocs

Le 17 févr. 2015 à 10:40, sagarl saga...@gmail.com a écrit :

Hi David,

Following is the output of plugins:

name component version type url
i-8a3f8d9d cloud-aws 2.4.1 j
i-8a3f8d9d river-jira 1.8.1 j
i-8a3f8d9d bigdesk NA s /_plugin/bigdesk/
i-8a3f8d9d kopf 1.4.5 s /_plugin/kopf/
i-8a3f8d9d head NA s /_plugin/head/
i-8a3f8d9d HQ NA s /_plugin/HQ/
i-8a3f8d9d inquisitor NA s /_plugin/inquisitor/
i-94ade4f6 cloud-aws 2.4.1 j
i-94ade4f6 river-jira 1.8.1 j
i-94ade4f6 bigdesk NA s /_plugin/bigdesk/
i-94ade4f6 kopf 1.4.5 s /_plugin/kopf/
i-94ade4f6 head NA s /_plugin/head/
i-94ade4f6 HQ NA s /_plugin/HQ/
i-94ade4f6 inquisitor NA s /_plugin/inquisitor/
i-4f409284 cloud-aws 2.4.1 j
i-4f409284 river-jira 1.8.1 j
i-4f409284 bigdesk NA s /_plugin/bigdesk/
i-4f409284 kopf 1.4.5 s /_plugin/kopf/
i-4f409284 head NA s /_plugin/head/
i-4f409284 HQ NA s /_plugin/HQ/
i-4f409284 inquisitor NA s /_plugin/inquisitor/
i-e1f1e899 cloud-aws 2.4.1 j
i-e1f1e899 river-jira 1.8.1 j
i-e1f1e899 bigdesk NA s /_plugin/bigdesk/
i-e1f1e899 kopf 1.4.5 s /_plugin/kopf/
i-e1f1e899 head NA s /_plugin/head/
i-e1f1e899 HQ NA s /_plugin/HQ/
i-e1f1e899 inquisitor NA s /_plugin/inquisitor/
i-4ga9477a cloud-aws 2.4.1 j
i-4ga9477a river-jira 1.8.1 j
i-4ga9477a bigdesk NA s /_plugin/bigdesk/
i-4ga9477a kopf 1.4.5 s /_plugin/kopf/
i-4ga9477a head NA s /_plugin/head/
i-4ga9477a HQ NA s /_plugin/HQ/
i-4ga9477a inquisitor NA s /_plugin/inquisitor/
i-3ba84685 cloud-aws 2.4.1 j
i-3ba84685 river-jira 1.8.1 j
i-3ba84685 bigdesk NA s /_plugin/bigdesk/
i-3ba84685 kopf 1.4.5 s /_plugin/kopf/
i-3ba84685 head NA s /_plugin/head/
i-3ba84685 HQ NA s /_plugin/HQ/
i-3ba84685 inquisitor NA s /_plugin/inquisitor/

ES Version is same across the cluster = 1.4.1

JVM Version across the cluster = 1.7.0_55

I'll still keep on debugging this issue, if I don't find anything; I'll
open an issue.

Thanks,

On Monday, February 16, 2015 at 11:44:55 PM UTC-8, David Pilato wrote:

Weird indeed. Are you mixing versions within the cluster?
I mean ES versions, Java versions and cloud-aws plugin versions. Could you
give the output for GET _cat/plugins?v

If you are using exactly same versions, can you open an issue in cloud-aws
plugin with all details you wrote?

David

Le 17 févr. 2015 à 03:43, sagarl saga...@gmail.com a écrit :

Hi,

We are seeing some weird exception while trying to run Snapshot backup
using elasticsearch-cloud-aws plugin.

We are running following code which was working fine on ES 1.1 and ES
1.4.1 clusters:
    PutRepositoryResponse putRepositoryResponse = 
client.admin().cluster().preparePutRepository("test-repo")

.setType("s3").setSettings(ImmutableSettings.settingsBuilder()
.put("base_path", getBasePath())
.put("region", getRegion())
).get();

But now it's throwing following exception on ES 1.4.1 cluster :

Caused by: org.elasticsearch.transport.TransportSerializationException:
Failed to deserialize exception response from stream

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:173)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*

at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*

at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

... 1 more*
Caused by: java.lang.ClassCastException: cannot assign instance of
com.amazonaws.AmazonServiceException$ErrorType to field
com.amazonaws.AmazonServiceException.errorMessage of type java.lang.String
in instance of com.amazonaws.services.s3.model.AmazonS3Exception

at
java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2083)*

at
java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1261)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1996)*

at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*

at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*

at java.lang.Throwable.readObject(Throwable.java:914)*

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*

at java.lang.reflect.Method.invoke(Method.java:606)*

at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*

at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)*

at
java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:500)*

at java.lang.Throwable.readObject(Throwable.java:914)*

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*

at java.lang.reflect.Method.invoke(Method.java:606)*

at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)*

at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)*

at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)*

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)*

at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171)*

at
org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:125)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)*

at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303)*

at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)*

at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)*

at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)*

at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)*

at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)*

at
org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)*

at
org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)*

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)*

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*

at java.lang.Thread.run(Thread.java:745)*

Weird part is that the S3 Repository is Created Successfully but
preparePutRepository call fails with an exception.

Not sure, what's going on, any help will be much appreciated ?

Thanks

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/62eed5de-3e0f-4ece-9422-24b2023d5672%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit

...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e6a74071-9aae-4d7f-b454-afe299f3d0a1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.