We are using fluentd to send data to Elasticsearch and fluentd is transmitting data to Elasticsearch using the HTTP layer. We want to compute the ingestion rate to the Elasticsearch cluster, but there are no metrics available to get the ingestion rate to an Elasticsearch cluster. Kindly please help here to compute the ingestion rate to the Elasticsearch cluster.
Hi @warkolm ,
Thanks for your reply, In the link that is shared there are no metrics related to ingestion rate. Can you please help to get the ingestion rate metrics.
Do you want to see Event Per Second EPS?
This is a part of stack monitoring feature that you need to enable first
Thanks for your reply, We want to see at what rate data is getting ingested into Elasticsearch and the Elasticsearch used here is not enterprise edition.
It seems you can do this in basic license too, have you tried?
this might block you, im not sure, didnt tested it with basic license : "centralized pipeline management"
You can also try visualizations to create an EPS dashboard
- Go to Panel Options > Index pattern and choose the right index pattern
- Go back to Data and configure Count, then Math, then type
params.count / params._interval * 1000
- You'll start seeing average values per second
- Switch to Metric to reduce this to a single number
Important : Go back to Panel Options > Data timerange mode > Entire time range
source: Viewing EPS graph in Kibana - #9 by Falikou1
if you use Stack monitoring whether legacy or using metricbeat you will see this data in the free and open stack as well. Just click on Stack Monitoring in Kibana and it will walk you through the process of setting things up.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.