How to tune elasticsearch performance

Elastic Stack Elasticsearch
1

I am using ES to ingest flow data from other application, but I found that the ES speed isn't high enough, so sometimes it would drop flow.
How can I change the setting of ES performance ?
I have seen the elasticsearch.yml, jvm.options and log4j2.properties, but there seems no setting about ES performance.

Thanks a lot.

2

image
image.png1366×460 29.8 KB

3

What does your collection pipeline look like? What does your Elasticsearch cluster look like, e.g. Elasticsearch version, number of nodes, number of CPU cores, type of storage and heap size?

4

ES version: 5.6.2
CPU:2 cores
RAM:8G

image
image.png1220×591 53.6 KB

image
image.png1221×193 14 KB

thanks for your reply!

5

image
image.png666×590 34.2 KB

6

this is the command from the input application:
ntopng /c -F "es;ntopng;ntopng-%Y.%m.%d;http://192.168.0.159:9200/_bulk;"

7

What does your collection pipeline look like? How have you determined that it is Elasticsearch, and not your collection pipeline, that is the bottleneck? How large are your documents?

8

I think it's the same thread as you already opened at

9

As it seems you already have another thread open, I suggest we continue the discussion there. Please do not open multiple threads for the same issue.

10

sorry for that

11

Please see Tuning the ES performance