# How to get my java client to discover an entire cluster **URL:** \ **Category:** Elasticsearch\ **Created:** [February 7, 2012, 4:19pm UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623 "2012-02-07T16:19:14Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![MikeNereson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mikenereson/32/2632_2.png) [@MikeNereson](https://discuss.elastic.co/u/MikeNereson)\ **Post date:** [February 7, 2012, 4:19pm UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623/1 "2012-02-07T16:19:14Z")
Been using ES for a few days now - replacing compass+lucene embedded into our app toward this distributed model as we rewrite parts of our app to move into AWS EC2. I've just got an EC2 instance setup, backed to S3 and finally got the connection from my local development box to the EC2 instance to work (darn you client.transport.sniff). So now I have a question. My java client connects to this EC2 instance explicitly. ``` final Client client = new TransportClient(settings) .addTransportAddress(new InetSocketTransportAddress(*some.ip.address ``` \*, _custom.port_)); That is fine when there is one node, but when I bring on additional instances, how does my client find out about the other instances? Is it communicated from the ES that I connect to or does my client need to discover them? Thanks. ---
**Author:** ![MikeNereson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mikenereson/32/2632_2.png) [@MikeNereson](https://discuss.elastic.co/u/MikeNereson)\ **Post date:** [February 7, 2012, 6:29pm UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623/2 "2012-02-07T18:29:36Z")
This configuration seems incorrect. I think I read that giving my client client.transport.sniff=true would allow the client to discover other nodes. With true it won't connect at all, with false it doesn't appear to use the second node. Could anyone confirm my setup is valid or invalid. I created an EC2 instance with this config cluster: name: es-dev-cluster node: master: true data: true transport.tcp.port: 9300 http.port: 9200 action.auto\_create\_index: true index.mapper.dynamic: false discovery: type: ec2 gateway: type: s3 s3.bucket: es-dev-cluster cloud: aws: access\_key: \*\*\*\*\*\*\*\*\* secret\_key: \*\*\*\*\*\*\*\*\* cloud.aws.s3.endpoint: [s3.amazonaws.com](http://s3.amazonaws.com) cloud.aws.ec2.endpoint: [ec2.us-east-1.amazonaws.com](http://ec2.us-east-1.amazonaws.com) I then snapshotted it and created an AMI. I started up two of this AMI. I assigned one of the two a static IP. Using [http://staticip:9200/\_plugin/head/](http://staticip:9200/_plugin/head/) I can see both of these nodes. My client connects explicitly to the static ``` final Settings settings = ImmutableSettings.settingsBuilder() .put("cluster.name", clusterName) .put("discovery.type", "ec2") .put("node.name", clientRandomNodeName) .put("node.master", false) .put("node.data", false) .put("client.transport.sniff", false) .build(); final String endpoint = theStaticIp final int port = 9300; final Client client = new TransportClient(settings) .addTransportAddress(new ``` InetSocketTransportAddress(endpoint, port)); So now my client is connecting to the static ip and I can index new data. I shutdown the node with the static ip and expected the second node thats on to get the work. Instead my client is throwing No Node Found. I have a couple suspicions as to whats I am doing wrong, but am not sure what else I should do. - Is it valid for both of these EC2 instances to have the given config? - Is the method I am using to connect my client to the static ip ES node valid? Thanks, Mike ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [February 7, 2012, 7:07pm UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623/3 "2012-02-07T19:07:01Z")
I got lost at the state you are at, so I will just explain how TransportClient works: - When sniff is not enabled, it will just use the list of IPs you provided. You can add several of those to the transport client, and it will just use those to communicate with the cluster. In this case, it will use the IP address you provided in the construction. - When sniff is enabled, it will use the address provided to sniff all the nodes in the cluster. It will then use \*their publish address" to try and connect to them. So, if the publish address of the node (logged when elasticsearch starts up, or exposed in the nodes info API) is the private IP address, you won't be able to connect to it from the outside world. You can control the publish address and bind address of elasticsearch, the simplest is to just set network.host setting in the config. On Tuesday, February 7, 2012 at 8:29 PM, MikeNereson wrote: > This configuration seems incorrect. > > I think I read that giving my client client.transport.sniff=true would allow the client to discover other nodes. > With true it won't connect at all, with false it doesn't appear to use the second node. > > Could anyone confirm my setup is valid or invalid. > > > I created an EC2 instance with this config > > > > cluster: > > name: es-dev-cluster > > > > node: > > > > ``` > > master: true > > > > ``` > > > > data: true > > > > transport.tcp.port: 9300 > > http.port: 9200 > > > > action.auto\_create\_index: true > > index.mapper.dynamic: false > > > > discovery: > > type: ec2 > > > > gateway: > > type: s3 > > > > ``` > > s3.bucket: es-dev-cluster > > > > ``` > > > > cloud: > > aws: > > > > ``` > > access_key: ********* > > > > secret_key: ********* > > > > ``` > > > > cloud.aws.s3.endpoint: [s3.amazonaws.com](http://s3.amazonaws.com) ([http://s3.amazonaws.com](http://s3.amazonaws.com)) > > cloud.aws.ec2.endpoint: [ec2.us-east-1.amazonaws.com](http://ec2.us-east-1.amazonaws.com) ([http://ec2.us-east-1.amazonaws.com](http://ec2.us-east-1.amazonaws.com)) > > I then snapshotted it and created an AMI. I started up two of this AMI. I assigned one of the two a static IP. > > Using [http://staticip:9200/\_plugin/head/](http://staticip:9200/_plugin/head/) I can see both of these nodes. > > My client connects explicitly to the static > > > ``` > > final Settings settings = ImmutableSettings.settingsBuilder() > > .put("cluster.name (http://cluster.name)", clusterName) > > > > .put("discovery.type", "ec2") > > > > .put("node.name (http://node.name)", clientRandomNodeName) > > > > .put("node.master", false) > > > > .put("node.data", false) > > > > .put("client.transport.sniff", false) > > > > .build(); > > > > final String endpoint = theStaticIp > > final int port = 9300; > > > > final Client client = new TransportClient(settings) > > .addTransportAddress(new InetSocketTransportAddress(endpoint, port)); > > > > ``` > > So now my client is connecting to the static ip and I can index new data. I shutdown the node with the static ip and expected the second node thats on to get the work. Instead my client is throwing No Node Found. > > I have a couple suspicions as to whats I am doing wrong, but am not sure what else I should do. > > - Is it valid for both of these EC2 instances to have the given config? > - Is the method I am using to connect my client to the static ip ES node valid? > > Thanks, Mike ---
**Author:** ![MikeNereson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mikenereson/32/2632_2.png) [@MikeNereson](https://discuss.elastic.co/u/MikeNereson)\ **Post date:** [February 7, 2012, 8:02pm UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623/4 "2012-02-07T20:02:17Z")
This is relevant and specifically answers my original question. [http://elasticsearch-users.115913.n3.nabble.com/NoNodeAvailableException-No-node-available-on-Elastic-Beanstalk-tp3550240p3551676.html](http://elasticsearch-users.115913.n3.nabble.com/NoNodeAvailableException-No-node-available-on-Elastic-Beanstalk-tp3550240p3551676.html) "sniff will not go and find the cluster automatically. You need to add the > address of at least one node in the cluster to the transport client. What > sniff will do when enabled, is that it will get from that node the rest of > the nodes in the cluster, and use all of those when round robin requests. > " -- kimchy ---
**Author:** ![MikeNereson](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mikenereson/32/2632_2.png) [@MikeNereson](https://discuss.elastic.co/u/MikeNereson)\ **Post date:** [February 7, 2012, 9:00pm UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623/5 "2012-02-07T21:00:16Z")
Just to be clear regarding the "outside world ": > So, if the publish address of the node (logged when elasticsearch starts > up, or exposed in the nodes info API) is the private IP address, you won't > be able to connect to it from the outside world (1) If the publish address is the EC2 instance's private IP address, it will only be accessible from other EC2 nodes. Presumable they need to be in the same AWS region or even in the same availability zone. So my elastic bean-stalked applications should be able to access it. (2) Networks external to AWS, my dev box, can not access it. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:40am UTC](https://discuss.elastic.co/t/how-to-get-my-java-client-to-discover-an-entire-cluster/6623/6 "2017-07-06T03:40:11Z")