Is there a way to track the overall data ingest rate of an ECE deployment? I'd also like to create a visualization that does the same with a specific index so that I can maintain a good idea of what the daily ingest rate looks like. The problem that I'm running into is that we don't have a field like system.network.in.bytes populating since the data we are ingesting is not from a Beat which has fields like that. I've deconstructed the Inbound Traffic [Metircbeat] ECS visualization so I have an idea of how this could be done I'm just not sure there's even a way to do this with the data that we are getting.
Did you try to look at monitoring? Here is a screenshot where I am running filebeat to ingest elasticsearch logs:
Here are our docs: https://www.elastic.co/guide/en/elasticsearch/reference/7.6/monitor-elasticsearch-cluster.html
https://www.elastic.co/guide/en/kibana/current/kibana-page.html
Let me know if this helps?
Thanks,
Bhavya
It looks like this could be an option as I could utilize the indexing rate and disk to get a rough idea of where things are headed. Thanks for the insight. 
1 Like
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.