I have a few machines that provide web services, and they use ES as a backend. Specifically, I install a node on the service machine (
node.ingest: true) so I need not worry about what node to connect to. i just connect to
Can I do this at a larger scale, about 200+ machines?
I currently have 200+ ETL machines submitting their logs to a single ES node. There are numerous times that ES is taking over 5 minutes to respond (my timeout is set to 5min). If each ETL machine had their own node localhost node, then ingestion will not have this problem, but other problems my appear because the number of nodes.
My alternative is to have the ETL machines randomly choose a node to submit logs to, but this is not ideal: I will have to write code that will identify what nodes are available, and manage that over time, because most nodes are ephemeral.