# ElasticSearch 0.19.11 -\> 0.20.6 **URL:** \ **Category:** Elasticsearch\ **Created:** [April 30, 2013, 10:16pm UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758 "2013-04-30T22:16:18Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Florian\_Grousset](https://avatars.discourse-cdn.com/v4/letter/f/f6c823/32.png) [@Florian\_Grousset](https://discuss.elastic.co/u/Florian_Grousset)\ **Post date:** [April 30, 2013, 10:16pm UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758/1 "2013-04-30T22:16:18Z")
Hi all, I have a running ES cluster composed of 15 hosts (3 dedicated masters / 12 dedicated data) and JSON documents CRUD are managed externally by Pentaho Data Integration a.k.a PDI. (Same as here [http://pedroalves-bi.blogspot.fr/2011/07/elasticsearch-kettle-and-ctools.html](http://pedroalves-bi.blogspot.fr/2011/07/elasticsearch-kettle-and-ctools.html)) Everything was running fine except that when I've done migration from v0.19.11 to 0.20.6, PDI wasn't able to communicate with ES. I've tried with only one small node with one index to isolate any cluster issue effect. I've also tried with the latest 0.90 release, same pain. I don't know how PDI ES connector client is implemented but I guess there should be a prococol version issue somewhere. PDI ES client seems to only allow communication using TCP on port 9300 post and not the HTTP protocol running on port 9200. Before posting to PDI mailing list, can someone tell me if the communication protocol has changed between 0.19 and 0.20 generations ? See below the logs I'm getting on ES 0.20.6 when trying to get a simple "status" from PDI. Thanks. Florian ----------8\<------------------------ [2013-04-28 14:17:20,233][WARN][transport.netty] [es1vm] exception caught on transport layer [[id: 0xee1090ef, /192.168.16.1:55531 =\> /192.168.16.192:9300]], closing connection java.io.StreamCorruptedException: invalid internal transport message format at org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:636) [2013-04-28 14:17:20,237][WARN][transport.netty] [es1vm] exception caught on transport layer [[id: 0xee1090ef, /192.168.16.1:55531 :\> /192.168.16.192:9300]], closing connection java.io.StreamCorruptedException: invalid internal transport message format at org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:482) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) at org.elasticsearch.common.netty.channel.Channels.fireChannelDisconnected(Channels.java:396) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:336) at org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:81) at org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:36) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:570) at org.elasticsearch.common.netty.channel.Channels.close(Channels.java:812) at org.elasticsearch.common.netty.channel.AbstractChannel.close(AbstractChannel.java:197) at org.elasticsearch.transport.netty.NettyTransport.exceptionCaught(NettyTransport.java:505) at org.elasticsearch.transport.netty.MessageChannelHandler.exceptionCaught(MessageChannelHandler.java:227) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.exceptionCaught(FrameDecoder.java:377) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) at org.elasticsearch.common.netty.channel.Channels.fireExceptionCaught(Channels.java:525) at org.elasticsearch.common.netty.channel.AbstractChannelSink.exceptionCaught(AbstractChannelSink.java:48) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.notifyHandlerException(DefaultChannelPipeline.java:654) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:562) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:636) ----------8\<------------------------ -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Paul\_Smith](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/paul_smith/32/1323_2.png) [@Paul\_Smith](https://discuss.elastic.co/u/Paul_Smith)\ **Post date:** [May 1, 2013, 9:31pm UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758/2 "2013-05-01T21:31:24Z")
A Major version bump, 0.19 -\> 0.20 for example, will always have protocol changes; the very least is a version property change. You can't have a 0.19.x jar client connect to a 0.20 server. The client jar needs to be updated as well. I would say PDI needs to be upgrade to match. If you were bold enough, you might just swap out the ES 0.19.x jar that ships with PDI and replace it with the corresponding correct ES version and see what you see... On 1 May 2013 08:16, Florian Grousset [florian.grousset@gmail.com](mailto:florian.grousset@gmail.com) wrote: > Hi all, > > I have a running ES cluster composed of 15 hosts (3 dedicated masters / 12 > dedicated data) and JSON documents CRUD are managed externally by Pentaho > Data Integration a.k.a PDI. > (Same as here > [Pedro Alves on Business Intelligence: Elasticsearch, Kettle and the CTools](http://pedroalves-bi.blogspot.fr/2011/07/elasticsearch-kettle-and-ctools.html) > ) > > Everything was running fine except that when I've done migration from > v0.19.11 to 0.20.6, PDI wasn't able to communicate with ES. > > I've tried with only one small node with one index to isolate any cluster > issue effect. I've also tried with the latest 0.90 release, same pain. > I don't know how PDI ES connector client is implemented but I guess there > should be a prococol version issue somewhere. > PDI ES client seems to only allow communication using TCP on port 9300 > post and not the HTTP protocol running on port 9200. > > Before posting to PDI mailing list, can someone tell me if the > communication protocol has changed between 0.19 and 0.20 generations ? > See below the logs I'm getting on ES 0.20.6 when trying to get a simple > "status" from PDI. > > Thanks. > > Florian > > ----------8\<------------------------ > [2013-04-28 14:17:20,233][WARN][transport.netty] [es1vm] > exception caught on transport layer [[id: 0xee1090ef, /192.168.16.1:55531=\> /192.168.16.192:9300]], > closing connection > java.io.StreamCorruptedException: invalid internal transport message format > at > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > at > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > at > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) > at > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > at > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > at > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > at > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > [2013-04-28 14:17:20,237][WARN][transport.netty] [es1vm] > exception caught on transport layer [[id: 0xee1090ef, /192.168.16.1:55531:\> /192.168.16.192:9300]], > closing connection > java.io.StreamCorruptedException: invalid internal transport message format > at > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > at > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > at > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:482) > at > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365) > at > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > at > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > at > org.elasticsearch.common.netty.channel.Channels.fireChannelDisconnected(Channels.java:396) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:336) > at > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:81) > at > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:36) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:570) > at org.elasticsearch.common.netty.channel.Channels.close(Channels.java:812) > at > org.elasticsearch.common.netty.channel.AbstractChannel.close(AbstractChannel.java:197) > at > org.elasticsearch.transport.netty.NettyTransport.exceptionCaught(NettyTransport.java:505) > at > org.elasticsearch.transport.netty.MessageChannelHandler.exceptionCaught(MessageChannelHandler.java:227) > at > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > at > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.exceptionCaught(FrameDecoder.java:377) > at > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > at > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > at > org.elasticsearch.common.netty.channel.Channels.fireExceptionCaught(Channels.java:525) > at > org.elasticsearch.common.netty.channel.AbstractChannelSink.exceptionCaught(AbstractChannelSink.java:48) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.notifyHandlerException(DefaultChannelPipeline.java:654) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:562) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > at > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > at > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > at > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > at > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > at > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > at > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > at > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > ----------8\<------------------------ > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Florian\_Grousset](https://avatars.discourse-cdn.com/v4/letter/f/f6c823/32.png) [@Florian\_Grousset](https://discuss.elastic.co/u/Florian_Grousset)\ **Post date:** [May 1, 2013, 11:17pm UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758/3 "2013-05-01T23:17:35Z")
Thanks Paul you for your answer! I changed all the ES jars embedded in pdi (pdi-ce-4.4.0-stable/libext/elasticsearch/\*) with the set of new ones from the 0.90.0 release and everything is working fine. Le mercredi 1 mai 2013 23:31:24 UTC+2, tallpsmith a écrit : > A Major version bump, 0.19 -\> 0.20 for example, will always have protocol > changes; the very least is a version property change. > > You can't have a 0.19.x jar client connect to a 0.20 server. The client > jar needs to be updated as well. I would say PDI needs to be upgrade to > match. > > If you were bold enough, you might just swap out the ES 0.19.x jar that > ships with PDI and replace it with the corresponding correct ES version and > see what you see... > > On 1 May 2013 08:16, Florian Grousset \<[florian....@gmail.com](mailto:florian....@gmail.com) \ > > > wrote: > > > Hi all, > > > > I have a running ES cluster composed of 15 hosts (3 dedicated masters / > > 12 dedicated data) and JSON documents CRUD are managed externally by > > Pentaho Data Integration a.k.a PDI. > > (Same as here > > [Pedro Alves on Business Intelligence: Elasticsearch, Kettle and the CTools](http://pedroalves-bi.blogspot.fr/2011/07/elasticsearch-kettle-and-ctools.html) > > ) > > > > Everything was running fine except that when I've done migration from > > v0.19.11 to 0.20.6, PDI wasn't able to communicate with ES. > > > > I've tried with only one small node with one index to isolate any cluster > > issue effect. I've also tried with the latest 0.90 release, same pain. > > I don't know how PDI ES connector client is implemented but I guess there > > should be a prococol version issue somewhere. > > PDI ES client seems to only allow communication using TCP on port 9300 > > post and not the HTTP protocol running on port 9200. > > > > Before posting to PDI mailing list, can someone tell me if the > > communication protocol has changed between 0.19 and 0.20 generations ? > > See below the logs I'm getting on ES 0.20.6 when trying to get a simple > > "status" from PDI. > > > > Thanks. > > > > Florian > > > > ----------8\<------------------------ > > [2013-04-28 14:17:20,233][WARN][transport.netty] [es1vm] > > exception caught on transport layer [[id: 0xee1090ef, /192.168.16.1:55531=\> /192.168.16.192:9300]], closing connection > > java.io.StreamCorruptedException: invalid internal transport message > > format > > at > > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > > at > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > > at > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) > > at > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > at > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > at > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > at > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > at > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > > at > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > at > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > at > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > at java.lang.Thread.run(Thread.java:636) > > [2013-04-28 14:17:20,237][WARN][transport.netty] [es1vm] > > exception caught on transport layer [[id: 0xee1090ef, /192.168.16.1:55531:\> /192.168.16.192:9300]], closing connection > > java.io.StreamCorruptedException: invalid internal transport message > > format > > at > > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > > at > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > > at > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:482) > > at > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365) > > at > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > at > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > at > > org.elasticsearch.common.netty.channel.Channels.fireChannelDisconnected(Channels.java:396) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:336) > > at > > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:81) > > at > > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:36) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:570) > > at > > org.elasticsearch.common.netty.channel.Channels.close(Channels.java:812) > > at > > org.elasticsearch.common.netty.channel.AbstractChannel.close(AbstractChannel.java:197) > > at > > org.elasticsearch.transport.netty.NettyTransport.exceptionCaught(NettyTransport.java:505) > > at > > org.elasticsearch.transport.netty.MessageChannelHandler.exceptionCaught(MessageChannelHandler.java:227) > > at > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > at > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.exceptionCaught(FrameDecoder.java:377) > > at > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > at > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > at > > org.elasticsearch.common.netty.channel.Channels.fireExceptionCaught(Channels.java:525) > > at > > org.elasticsearch.common.netty.channel.AbstractChannelSink.exceptionCaught(AbstractChannelSink.java:48) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.notifyHandlerException(DefaultChannelPipeline.java:654) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:562) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > at > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > at > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > at > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > at > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > at > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > > at > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > > at > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > at > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > at > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > at java.lang.Thread.run(Thread.java:636) > > ----------8\<------------------------ > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![lsk](https://avatars.discourse-cdn.com/v4/letter/l/a6a055/32.png) [@lsk](https://discuss.elastic.co/u/lsk)\ **Post date:** [August 3, 2013, 11:23pm UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758/4 "2013-08-03T23:23:52Z")
Even after replacing the old jars with jars from 0.9 version I get following error while running Elasticsearch. If possible please share your ktr ( I am using pentaho 4.4 ) 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : Unexpected error 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : java.lang.NoSuchMethodError: org.elasticsearch.client.Client.prepareBulk()Lorg/elasticsearch/client/action/bulk/BulkRequestBuilder; 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : at org.pentaho.di.trans.steps.elasticsearchbulk.ElasticSearchBulk.processRow(ElasticSearchBulk.java:134) 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50) 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : at java.lang.Thread.run(Thread.java:722) On Wednesday, May 1, 2013 7:17:35 PM UTC-4, Florian Grousset wrote: > Thanks Paul you for your answer! > > I changed all the ES jars embedded in pdi > (pdi-ce-4.4.0-stable/libext/elasticsearch/\*) with the set of new ones from > the 0.90.0 release and everything is working fine. > > Le mercredi 1 mai 2013 23:31:24 UTC+2, tallpsmith a écrit : > > > A Major version bump, 0.19 -\> 0.20 for example, will always have protocol > > changes; the very least is a version property change. > > > > You can't have a 0.19.x jar client connect to a 0.20 server. The client > > jar needs to be updated as well. I would say PDI needs to be upgrade to > > match. > > > > If you were bold enough, you might just swap out the ES 0.19.x jar that > > ships with PDI and replace it with the corresponding correct ES version and > > see what you see... > > > > On 1 May 2013 08:16, Florian Grousset [florian....@gmail.com](mailto:florian....@gmail.com) wrote: > > > > > Hi all, > > > > > > I have a running ES cluster composed of 15 hosts (3 dedicated masters / > > > 12 dedicated data) and JSON documents CRUD are managed externally by > > > Pentaho Data Integration a.k.a PDI. > > > (Same as here > > > [Pedro Alves on Business Intelligence: Elasticsearch, Kettle and the CTools](http://pedroalves-bi.blogspot.fr/2011/07/elasticsearch-kettle-and-ctools.html) > > > ) > > > > > > Everything was running fine except that when I've done migration from > > > v0.19.11 to 0.20.6, PDI wasn't able to communicate with ES. > > > > > > I've tried with only one small node with one index to isolate any > > > cluster issue effect. I've also tried with the latest 0.90 release, same > > > pain. > > > I don't know how PDI ES connector client is implemented but I guess > > > there should be a prococol version issue somewhere. > > > PDI ES client seems to only allow communication using TCP on port 9300 > > > post and not the HTTP protocol running on port 9200. > > > > > > Before posting to PDI mailing list, can someone tell me if the > > > communication protocol has changed between 0.19 and 0.20 generations ? > > > See below the logs I'm getting on ES 0.20.6 when trying to get a simple > > > "status" from PDI. > > > > > > Thanks. > > > > > > Florian > > > > > > ----------8\<------------------------ > > > [2013-04-28 14:17:20,233][WARN][transport.netty] [es1vm] > > > exception caught on transport layer [[id: 0xee1090ef, / > > > 192.168.16.1:55531 =\> /192.168.16.192:9300]], closing connection > > > java.io.StreamCorruptedException: invalid internal transport message > > > format > > > at > > > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > > > at > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > > > at > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) > > > at > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > at > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > at > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > > at > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > > at > > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > > at > > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > > at > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > > at java.lang.Thread.run(Thread.java:636) > > > [2013-04-28 14:17:20,237][WARN][transport.netty] [es1vm] > > > exception caught on transport layer [[id: 0xee1090ef, / > > > 192.168.16.1:55531 :\> /192.168.16.192:9300]], closing connection > > > java.io.StreamCorruptedException: invalid internal transport message > > > format > > > at > > > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > > > at > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > > > at > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:482) > > > at > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365) > > > at > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > at > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > at > > > org.elasticsearch.common.netty.channel.Channels.fireChannelDisconnected(Channels.java:396) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:336) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:81) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:36) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:570) > > > at > > > org.elasticsearch.common.netty.channel.Channels.close(Channels.java:812) > > > at > > > org.elasticsearch.common.netty.channel.AbstractChannel.close(AbstractChannel.java:197) > > > at > > > org.elasticsearch.transport.netty.NettyTransport.exceptionCaught(NettyTransport.java:505) > > > at > > > org.elasticsearch.transport.netty.MessageChannelHandler.exceptionCaught(MessageChannelHandler.java:227) > > > at > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > at > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.exceptionCaught(FrameDecoder.java:377) > > > at > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > at > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > at > > > org.elasticsearch.common.netty.channel.Channels.fireExceptionCaught(Channels.java:525) > > > at > > > org.elasticsearch.common.netty.channel.AbstractChannelSink.exceptionCaught(AbstractChannelSink.java:48) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.notifyHandlerException(DefaultChannelPipeline.java:654) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:562) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > at > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > at > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > at > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > > at > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > > > at > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > > at > > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > > at > > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > > at > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > > at java.lang.Thread.run(Thread.java:636) > > > ----------8\<------------------------ > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Florian\_Grousset](https://avatars.discourse-cdn.com/v4/letter/f/f6c823/32.png) [@Florian\_Grousset](https://discuss.elastic.co/u/Florian_Grousset)\ **Post date:** [August 12, 2013, 4:28pm UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758/5 "2013-08-12T16:28:09Z")
Hi Isk, Unfortunately I can't share the PDI script as it's owned by my company. The Exception you are raising is different than mine so I guess there may be another issue. Anyway, have you replaced the legacy Elasticsearch jar embedded in PDI by the new one? Here is the location: /.../pdi-ce-4.4.0-stable/libext/elasticsearch/ Just in case, you must replace it and not only add the new jar to avoid classloader to eventualy put the old one on top of the newer... Florian Le samedi 3 août 2013 19:23:52 UTC-4, lsk a écrit : > Even after replacing the old jars with jars from 0.9 version I get > following error while running Elasticsearch. > > If possible please share your ktr ( I am using pentaho 4.4 ) > > 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version > 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : > Unexpected error > 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version > 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : > java.lang.NoSuchMethodError: > org.elasticsearch.client.Client.prepareBulk()Lorg/elasticsearch/client/action/bulk/BulkRequestBuilder; > 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version > 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : at > org.pentaho.di.trans.steps.elasticsearchbulk.ElasticSearchBulk.processRow(ElasticSearchBulk.java:134) > 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version > 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : at > org.pentaho.di.trans.step.RunThread.run(RunThread.java:50) > 2013/08/03 19:21:25 - Elasticsearch Bulk Insert.0 - ERROR (version > 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 by buildguy) : at > java.lang.Thread.run(Thread.java:722) > > On Wednesday, May 1, 2013 7:17:35 PM UTC-4, Florian Grousset wrote: > > > Thanks Paul you for your answer! > > > > I changed all the ES jars embedded in pdi > > (pdi-ce-4.4.0-stable/libext/elasticsearch/\*) with the set of new ones from > > the 0.90.0 release and everything is working fine. > > > > Le mercredi 1 mai 2013 23:31:24 UTC+2, tallpsmith a écrit : > > > > > A Major version bump, 0.19 -\> 0.20 for example, will always have > > > protocol changes; the very least is a version property change. > > > > > > You can't have a 0.19.x jar client connect to a 0.20 server. The client > > > jar needs to be updated as well. I would say PDI needs to be upgrade to > > > match. > > > > > > If you were bold enough, you might just swap out the ES 0.19.x jar that > > > ships with PDI and replace it with the corresponding correct ES version and > > > see what you see... > > > > > > On 1 May 2013 08:16, Florian Grousset [florian....@gmail.com](mailto:florian....@gmail.com) wrote: > > > > > > > Hi all, > > > > > > > > I have a running ES cluster composed of 15 hosts (3 dedicated masters / > > > > 12 dedicated data) and JSON documents CRUD are managed externally by > > > > Pentaho Data Integration a.k.a PDI. > > > > (Same as here > > > > [Pedro Alves on Business Intelligence: Elasticsearch, Kettle and the CTools](http://pedroalves-bi.blogspot.fr/2011/07/elasticsearch-kettle-and-ctools.html) > > > > ) > > > > > > > > Everything was running fine except that when I've done migration from > > > > v0.19.11 to 0.20.6, PDI wasn't able to communicate with ES. > > > > > > > > I've tried with only one small node with one index to isolate any > > > > cluster issue effect. I've also tried with the latest 0.90 release, same > > > > pain. > > > > I don't know how PDI ES connector client is implemented but I guess > > > > there should be a prococol version issue somewhere. > > > > PDI ES client seems to only allow communication using TCP on port 9300 > > > > post and not the HTTP protocol running on port 9200. > > > > > > > > Before posting to PDI mailing list, can someone tell me if the > > > > communication protocol has changed between 0.19 and 0.20 generations ? > > > > See below the logs I'm getting on ES 0.20.6 when trying to get a simple > > > > "status" from PDI. > > > > > > > > Thanks. > > > > > > > > Florian > > > > > > > > ----------8\<------------------------ > > > > [2013-04-28 14:17:20,233][WARN][transport.netty] [es1vm] > > > > exception caught on transport layer [[id: 0xee1090ef, / > > > > 192.168.16.1:55531 =\> /192.168.16.192:9300]], closing connection > > > > java.io.StreamCorruptedException: invalid internal transport message > > > > format > > > > at > > > > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > > > > at > > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > > > > at > > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) > > > > at > > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > > at > > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > > > at > > > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > > > at > > > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > > > at > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > > > at > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > > > at java.lang.Thread.run(Thread.java:636) > > > > [2013-04-28 14:17:20,237][WARN][transport.netty] [es1vm] > > > > exception caught on transport layer [[id: 0xee1090ef, / > > > > 192.168.16.1:55531 :\> /192.168.16.192:9300]], closing connection > > > > java.io.StreamCorruptedException: invalid internal transport message > > > > format > > > > at > > > > org.elasticsearch.transport.netty.SizeHeaderFrameDecoder.decode(SizeHeaderFrameDecoder.java:27) > > > > at > > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) > > > > at > > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:482) > > > > at > > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365) > > > > at > > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > > at > > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.fireChannelDisconnected(Channels.java:396) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:336) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:81) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:36) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:570) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.close(Channels.java:812) > > > > at > > > > org.elasticsearch.common.netty.channel.AbstractChannel.close(AbstractChannel.java:197) > > > > at > > > > org.elasticsearch.transport.netty.NettyTransport.exceptionCaught(NettyTransport.java:505) > > > > at > > > > org.elasticsearch.transport.netty.MessageChannelHandler.exceptionCaught(MessageChannelHandler.java:227) > > > > at > > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > > at > > > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.exceptionCaught(FrameDecoder.java:377) > > > > at > > > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > > at > > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.fireExceptionCaught(Channels.java:525) > > > > at > > > > org.elasticsearch.common.netty.channel.AbstractChannelSink.exceptionCaught(AbstractChannelSink.java:48) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.notifyHandlerException(DefaultChannelPipeline.java:654) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:562) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787) > > > > at > > > > org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) > > > > at > > > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > > > at > > > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) > > > > at > > > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > > > at > > > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > > > at > > > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > > > at > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > > > at > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > > > at java.lang.Thread.run(Thread.java:636) > > > > ----------8\<------------------------ > > > > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:21am UTC](https://discuss.elastic.co/t/elasticsearch-0-19-11-0-20-6/11758/6 "2017-07-06T02:21:31Z")