is it possible to deploy elk on aws ecs with fargate as launch type not ec2 ?
how would be the node discovery ?
we have discovery plugin for ec2 .. similarly do we have something for fargate ?
AWS tell me that it's possible but I haven't actually tried it, and discovery (and more generally networking) would be one of the obstacles that I'd expect to have to overcome. There is no discovery plugin specifically for Fargate but the discovery-file plugin is quite a flexible way to do dynamic discovery so I'd suggest trying that on the dedicated master nodes. Once you've got the master nodes to discover each other, I would try to use Fargate's own DNS-based service discovery to get the data nodes to discover the masters.
Please do let us know how you get on and if you get stuck maybe we can help.
Getting this error,
[3]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
is there a way to fix it using fargate ?
https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html#docker-cli-run-prod-mode solution provided here needs host which i think is not there on fargate
I do not know if this is possible to change in Fargate itself - you will need to seek AWS's help with that. However it looks like in 6.5.0 you will be able to disable mmapfs and avoid the corresponding bootstrap check:
i think 6.5.0 docker image is not yet published https://www.docker.elastic.co/
Yes, 6.5.0 is not yet released.
any idea when it will get released ?
The latest release today is 6.4.2 so 6.5.0 will be the the next minor version released, but we unfortunately cannot say when this will happen yet.
@musabqamri just to let you know that 6.5.0 is now released.
1 Like
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.