Tuning Elasticsearch system to again lost data


(Nguyễn Văn Tân) #1

Hello everybody
I'm Tan and I come from Vietnam.
You know, I would like to sent data from Syslog-ng to Elasticsearch with around 1 thousand message lines, but in ES side, I just see 515 docs. It means ES just received and processed haft past of the number messages that sent from Syslog-ng.
I changed configuration and did sometimes and one of the case, I just saw the number of docs equal 10% the number of message come.

I have 5 ES node and 2 of them are data node with the configuration: 4GB RAM, 4 cores and data folder mount from NAS device.
Of course, I also checked the bandwidth, hdd, ram and cpu. They worked well and just used around 50% their capacity.

I would like everyone give me some your experiences about that.
Does has any parameters that I have to config for tuning my system?

Turning my system makes me spending alot of time. :frowning:
Thank you very much!


(system) #2