Setup Elasticsearch cluster on Multi-Cloud(AWS and GCP)

Elastic Stack Elasticsearch
1

Hello? I'm newbie to Elasticsearch.

I'm planning to manage Multi-Cloud logs using Elasticsearch.

Some of nodes are in AWS and other nodes are in GCP. (Let's assume each public cloud's instances are in same vpc)

I came here to get advise of how to make cluster. I have 2 options.

  1. Make all multi cloud nodes in one elastic cluster.
  • Add one Master node to AWS and set all other nodes to data nodes in aws and gcp.
  • Add all those nodes(AWS and GCP) to one elastic cluster.
  1. Set each public cloud to each cluster and use cross-cluster join.
  • Add Master node to each aws and gcp cluster. And then make each cluster in each public cloud.
  • So this scenario have 2 different elastic cluster in AWS and GCP.
  • Use Cross-cluster query when we want all of documents.

Which one is better? Does each option have pros and cons?
Or is there any good option for managing multi-cloud logs using one cluster?

2
  1. Nope, you'll run into a tonne of issues with latency and network issues.
  2. Ideally, yes.

You could, also, have the Elasticsearch cluster in a totally different provider, eg Azure.

1 Like
3

Thank you for your reply.

So it means that.. now there is no solution for mutli-cloud or multi-region(which communicate with public network) right?

So then best alternative solution is to construct cluster to each public cloud(aws, gcp) and query on cross cluster right?

4

The solution is cross cluster search :slight_smile:

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.