using Elasticsearch , logstash and kibana on 16vcore linux azure server and approx 300 micro service logs pushing through logback to logstash.
i observed sometimes logs not storing to Elasticsearch and sometimes delay.
can someone provide solution
approx log size per day 500gb
Which version of Elasticsearch are you using?
How many different indices are you actively indexing into?
What does your Logstash config look like? How many distinct pipelines to you have? How may Elasticsearch outputs do you have? What types of inputs are you using?
Do you have all components running on the same server? What is the full specification of this server in terms of RAM, heap sizes, size and type of storage used?
What retention period do you have configured?