Hello guys, I have an application that collects twits / reddit posts and other kind of informations. let's say 1000 documents are around 1mb of size.
I recently bought 2 servers with the following specs:
CPU: Intel® Xeon® Gold 6140 (2 dedicated cores)
RAM: 8 GB DDR4 RAM (ECC)
HDD: 320 GB SAS
I need some help for the configuration part like how many shards, replicas, how to scale, how many master nodes and similar stuff. I will need to install kibana on one of those servers to monitor constantly the documents. This dashboard will be accessed by many other memebrs too.
I would also appreciate to know if I need to buy more servers or or a server only for kibana etc etc...
Also, do I need to use logstash or filebeat to have an atomatic queue or should I send the data directly to elastic?
Thank you so much!