Unable to connect to Elastic search cloud with Transport client API

Shyju_M · January 23, 2019, 9:14am

Please help me to connect to the elastic cloud from the transport client

pom.xml

 <dependency>
        <groupId>org.elasticsearch</groupId>
        <artifactId>elasticsearch</artifactId>
    </dependency>

    <dependency>
        <groupId>org.elasticsearch.client</groupId>
        <artifactId>transport</artifactId>
        <version>6.0.0</version>
    </dependency>

Code in JAVA Spring BOOT

      boolean enableSsl = true;
    Settings settings = Settings.builder()
            .put("client.transport.nodes_sampler_interval", "5s")
            .put("client.transport.sniff", false)
            .put("transport.tcp.compress", true)
            .put("cluster.name", clusterName)
            .put("xpack.security.transport.ssl.enabled", enableSsl)
            .put("request.headers.X-Found-Cluster", "${cluster.name}")
            .put("xpack.security.user", System.getProperty("xpack.security.user"))
            .put("xpack.security.transport.ssl.verification_mode", insecure ? "none" : "full")
            .build();

    String hostname = "7c12baf8da6b4c1da553c7557a004844.us-east-1.aws.found.io";
    try {

        System.out.println("CONNECT");
        TransportClient myclient = new PreBuiltTransportClient(settings)
                .addTransportAddress(new TransportAddress(InetAddress.getByName(hostname), 9343));

    }catch (Exception e){
        e.printStackTrace();
    }

getting the exception

java.lang.NullPointerException
at org.elasticsearch.node.InternalSettingsPreparer.replacePromptPlaceholders(InternalSettingsPreparer.java:160)
at org.elasticsearch.node.InternalSettingsPreparer.finalizeSettings(InternalSettingsPreparer.java:153)
at org.elasticsearch.node.InternalSettingsPreparer.prepareSettings(InternalSettingsPreparer.java:52)
at org.elasticsearch.client.transport.TransportClient.newPluginService(TransportClient.java:97)
at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:125)
at org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:259)
at org.elasticsearch.transport.client.PreBuiltTransportClient.<init>(PreBuiltTransportClient.java:125)
at org.elasticsearch.transport.client.PreBuiltTransportClient.<init>(PreBuiltTransportClient.java:111)
at org.elasticsearch.transport.client.PreBuiltTransportClient.<init>(PreBuiltTransportClient.java:101)
at com.fms.eventurbo.etelastic.service.EventService.<init>(EventService.java:79)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:172)
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:87)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1262)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1164)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:538)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:498)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:277)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1244)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1164)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:593)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:90)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:374)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1378)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:575)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:498)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:846)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:863)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:546)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:142)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:775)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:397)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:316)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1260)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1248)

dadoonet · January 23, 2019, 9:26am

What gives

GET /

Shyju_M · January 23, 2019, 9:52am

dadoonet · January 23, 2019, 10:33am

First you need to use the same client version as the server. 6.5.4 and not 6.0.0.

Shyju_M · January 23, 2019, 10:33am

Getting another exception with the below code changes

 boolean enableSsl = true;
    String clusterId = "7c12baf8da6b4c1da553c7557a004844"; // Your cluster ID here

    String region = "us-east-1";
    Settings settings = Settings.builder()
            .put("client.transport.nodes_sampler_interval", "5s")
            .put("client.transport.sniff", false)
            .put("transport.tcp.compress", true)
            .put("cluster.name", clusterName)
            .put("xpack.security.transport.ssl.enabled", enableSsl)
            .put("request.headers.X-Found-Cluster", clusterId)
            .put("xpack.security.user", "elastic:pass")
            .put("xpack.security.transport.ssl.verification_mode", insecure ? "none" : "full")
            .build();
    String hostname = clusterId + "." + region + ".aws.found.io";
    try {

        System.out.println("CONNECT");
        TransportClient myclient = new PreBuiltTransportClient(settings)
                .addTransportAddress(new TransportAddress(InetAddress.getByName(hostname), 9343));

    }catch (Exception e){
        e.printStackTrace();
    }

exception

java.lang.IllegalArgumentException: unknown setting [xpack.security.transport.ssl.enabled] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:293)
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:256)
at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:135)
at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:137)
at org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:259)
at org.elasticsearch.transport.client.PreBuiltTransportClient.<init>(PreBuiltTransportClient.java:125)

Kindly Help @dadoonet

Shyju_M · January 23, 2019, 10:35am

@dadoonet. Thank you, I will update the same but it was working fine with the local elastic server

dadoonet · January 23, 2019, 10:36am

Then you need to read: https://www.elastic.co/guide/en/elasticsearch/reference/6.5/setup-xpack-client.html

https://www.elastic.co/guide/en/elastic-stack-overview/6.5/java-clients.html

Shyju_M · January 23, 2019, 10:47am

That is already added to the pom.xml file The version is correct or not please

	<dependency>
		<groupId>org.elasticsearch.client</groupId>
		<artifactId>x-pack-transport</artifactId>
		<version>6.5.4</version>
	</dependency>

error

java.lang.IllegalArgumentException: unknown setting [xpack.security.transport.ssl.enabled] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:476)
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:421)
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:392)
at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:363)
at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:148)

Shyju_M · January 23, 2019, 11:02am

@dadoonet I could see the below item in the documentation

Kindly have a look and guide me to resolve the same

 java.lang.IllegalArgumentException: empty text

The exception is typically seen when a https request is made to a node that is not using https. If https is desired, please ensure the following setting is in elasticsearch.yml:

xpack.security.http.ssl.enabled: true

https://www.elastic.co/guide/en/x-pack/5.4/security-troubleshooting.html

dadoonet · January 23, 2019, 11:09am

Don't read old documentation. https://www.elastic.co/guide/en/x-pack/5.4/security-troubleshooting.html is for 5.4.

There is an example of a 6.2 version which I hope is still accurate:

But you should NOT be using the transport client anyway but the REST Client instead.

Shyju_M · January 24, 2019, 9:51am

Thank you very much I could connect with the below code

public class ElasticsearchConfig {


@Value("${elasticsearch.host}")
private String host;

@Value("${elasticsearch.port}")
private int port;

@Value("${elasticsearch.username}")
private String userName;

@Value("${elasticsearch.password}")
private String password;

@Bean(destroyMethod = "close")
public RestHighLevelClient client() {

    final CredentialsProvider credentialsProvider = new BasicCredentialsProvider();
    credentialsProvider.setCredentials(AuthScope.ANY,
            new UsernamePasswordCredentials(userName, password));

    RestClientBuilder builder = RestClient.builder(new HttpHost(host, port))
            .setHttpClientConfigCallback(httpClientBuilder -> httpClientBuilder.setDefaultCredentialsProvider(credentialsProvider));

    RestHighLevelClient client = new RestHighLevelClient(builder);


    return client;

}

}

system · February 21, 2019, 9:51am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Not abe to connect to elastic search cloud cluster from Transport Client Elasticsearch	2	593	January 19, 2018
Elasticsearch java API[5.0] using problem Elasticsearch	18	4375	January 4, 2017
Error while connecting to Elastic Cloud using RestClient or Transport Client Elasticsearch	6	1024	October 12, 2017
Unable to connect ES cloud Elasticsearch	6	1966	April 9, 2018
Transport Client issue with ES cloud Elasticsearch	6	2038	April 9, 2018

Unable to connect to Elastic search cloud with Transport client API

Related Topics