TCP load-balancer with client nodes

Elastic Stack Elasticsearch
1

We are separating our cluster into data and client nodes and plan to have client nodes behind a TCP load balancer so that applications can connect to the cluster via TransportClient. We have multiple applications, each with multiple hosts, persisting data at different rate into the same cluster.

Is it a good approach to route requests via TCP load balancer or can there be any concerns?

2

Just a note. We are moving to the REST Client which means that Transport layer will be deprecated for a client usage in the future.
You should start to consider load balancing the REST layer instead.

Is it a good approach? Yes. I don't see anything bad with that.

3

What will be with performance?

  • JSON-serialized data has greater size in bytes than binary serialized data
  • More time is needed to [de]serialize to JSON then to binary

And it is strange that Elasticsearch 5.x has no NodeClient. We used it to send data directly to shards instead of sending to each node in round robin manner

4

@dadoonet I searched about TCP load-balancing more and found this - Transport client makes 14 connections to a host and it's possible that the load-balancer may not map all the 14 connections to the same host behind the load-balancer but I guess the transport client assumes that it will be connected to the same host with 14 connections, please correct me if I'm wrong?

5

You can still do something similar with: Connecting a Client to a Coordinating Only Node | Java Transport Client (deprecated) [7.17] | Elastic

1 Like
6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.