Unresolved adddress exception

We are using zen discovery within ec2. I tried to restart one of the instances and I ended up with the exceptions below. The instance throws a 500 whenever i execute any command against it. All of the other instances are functioning properly. Is this because it cannot connect to just one peer instance?

Thx.

ava.lang.String]
[18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute TcpKeepAlive[r=true,w=false,is=false,type=jav
a.lang.Boolean][18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute PublishHost[r=true,w=false,is=false,type=java
.lang.String][18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute TcpSendBufferSize[r=true,w=false,is=false,typ
e=java.lang.String]
[18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute BindHost[r=true,w=false,is=false,type=java.la
ng.String]
[18:56:57,040][DEBUG][index.shard.recovery ] [Quentin Quire] using concurrent_streams [5], file_chunk_size [100kb],
translog_size [100kb], translog_ops [1000], and compress [true]
[18:56:57,041][DEBUG][indices.memory ] [Quentin Quire] using index_buffer_size [99.5mb], with min_shard_index_
buffer_size [4mb], max_shard_index_buffer_size [512mb], shard_inactive_time [30m]
[18:56:57,143][DEBUG][indices.cache.filter ] [Quentin Quire] using [node] filter cache with size [199.1mb]
[18:56:57,146][INFO ][node ] [Quentin Quire] {elasticsearch/0.16.2}[17047]: initialized
[18:56:57,147][INFO ][node ] [Quentin Quire] {elasticsearch/0.16.2}[17047]: starting ...
[18:56:57,175][DEBUG][netty.channel.socket.nio.NioProviderMetadata] Using the autodetected NIO constraint level: 0
[18:56:57,304][DEBUG][transport.netty ] [Quentin Quire] Bound to address [/0.0.0.0:9300]
[18:56:57,306][INFO ][transport ] [Quentin Quire] bound_address {inet[/0.0.0.0:9300]}, publish_address {i
net[/10.110.34.26:9300]}
[18:56:57,333][TRACE][discovery ] [Quentin Quire] waiting for 30s for the initial state to be set by the
discovery
[18:56:57,397][DEBUG][transport.netty ] [Quentin Quire] Connected to node [[Quentin Quire][AxXecX8PTbaMEJZs5RZX4g][inet[/10.110.34.26:9300]]]
[18:56:57,399][TRACE][discovery.zen.ping.unicast] [Quentin Quire] [1] connecting to [Quentin Quire][AxXecX8PTbaMEJZs5RZX4g][inet[/10.110.34.26:9300]], disconnect[false]
[18:56:57,423][WARN ][transport.netty ] [Quentin Quire] Exception caught on netty layer [[id: 0x322b2057]]
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:30)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:487)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipeline
Sink.java:140)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipeli
neSink.java:103)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:555)
at org.elasticsearch.common.netty.channel.Channels.connect(Channels.java:541)
at org.elasticsearch.common.netty.channel.AbstractChannel.connect(AbstractChannel.java:218)
at org.elasticsearch.common.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:227)
at org.elasticsearch.common.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:188)
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:501)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)
[18:56:57,424][WARN ][transport.netty ] [Quentin Quire] Exception caught on netty layer [[id: 0x3c4178d0]]
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:30)

I found the problem. I had the host:port of the current elasticsearch instance within the config. Another words, the loopback to self was failing. I removed that and things seem to work.

thx
On Jun 22, 2011, at 10:00 PM, Karl Baum wrote:

We are using zen discovery within ec2. I tried to restart one of the instances and I ended up with the exceptions below. The instance throws a 500 whenever i execute any command against it. All of the other instances are functioning properly. Is this because it cannot connect to just one peer instance?

Thx.

ava.lang.String]
[18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute TcpKeepAlive[r=true,w=false,is=false,type=jav
a.lang.Boolean][18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute PublishHost[r=true,w=false,is=false,type=java
.lang.String][18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute TcpSendBufferSize[r=true,w=false,is=false,typ
e=java.lang.String]
[18:56:56,989][TRACE][jmx ] [Quentin Quire] Attribute BindHost[r=true,w=false,is=false,type=java.la
ng.String]
[18:56:57,040][DEBUG][index.shard.recovery ] [Quentin Quire] using concurrent_streams [5], file_chunk_size [100kb],
translog_size [100kb], translog_ops [1000], and compress [true]
[18:56:57,041][DEBUG][indices.memory ] [Quentin Quire] using index_buffer_size [99.5mb], with min_shard_index_
buffer_size [4mb], max_shard_index_buffer_size [512mb], shard_inactive_time [30m]
[18:56:57,143][DEBUG][indices.cache.filter ] [Quentin Quire] using [node] filter cache with size [199.1mb]
[18:56:57,146][INFO ][node ] [Quentin Quire] {elasticsearch/0.16.2}[17047]: initialized
[18:56:57,147][INFO ][node ] [Quentin Quire] {elasticsearch/0.16.2}[17047]: starting ...
[18:56:57,175][DEBUG][netty.channel.socket.nio.NioProviderMetadata] Using the autodetected NIO constraint level: 0
[18:56:57,304][DEBUG][transport.netty ] [Quentin Quire] Bound to address [/0.0.0.0:9300]
[18:56:57,306][INFO ][transport ] [Quentin Quire] bound_address {inet[/0.0.0.0:9300]}, publish_address {i
net[/10.110.34.26:9300]}
[18:56:57,333][TRACE][discovery ] [Quentin Quire] waiting for 30s for the initial state to be set by the
discovery
[18:56:57,397][DEBUG][transport.netty ] [Quentin Quire] Connected to node [[Quentin Quire][AxXecX8PTbaMEJZs5RZX4g][inet[/10.110.34.26:9300]]]
[18:56:57,399][TRACE][discovery.zen.ping.unicast] [Quentin Quire] [1] connecting to [Quentin Quire][AxXecX8PTbaMEJZs5RZX4g][inet[/10.110.34.26:9300]], disconnect[false]
[18:56:57,423][WARN ][transport.netty ] [Quentin Quire] Exception caught on netty layer [[id: 0x322b2057]]
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:30)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:487)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipeline
Sink.java:140)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipeli
neSink.java:103)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:555)
at org.elasticsearch.common.netty.channel.Channels.connect(Channels.java:541)
at org.elasticsearch.common.netty.channel.AbstractChannel.connect(AbstractChannel.java:218)
at org.elasticsearch.common.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:227)
at org.elasticsearch.common.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:188)
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:501)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)
[18:56:57,424][WARN ][transport.netty ] [Quentin Quire] Exception caught on netty layer [[id: 0x3c4178d0]]
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:30)