# Determination Filebeat -\> Elasticsearch performance
**URL:** https://discuss.elastic.co/t/determination-filebeat-elasticsearch-performance/165800
**Category:** Beats
**Tags:** elastic-stack-monitoring, filebeat
**Created:** [January 25, 2019, 3:47pm UTC](https://discuss.elastic.co/t/determination-filebeat-elasticsearch-performance/165800 "2019-01-25T15:47:28Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@Daniel\_Dalacort](https://discuss.elastic.co/u/Daniel_Dalacort)
#### Post date: [January 25, 2019, 3:47pm UTC](https://discuss.elastic.co/t/determination-filebeat-elasticsearch-performance/165800/1 "2019-01-25T15:47:28Z")
Hello!
I understand that throughput of filebeat to elastic depends on many things, and before optimization I want to know it's really necessary.
I have a high load app that generates huge amount of logs, so I want to make sure that Filebeat send logs (directly to Elasticsearch) faster than logfile grows. Can I get information about amount of not processed lines in file or delta between processed and total number of lines? Does filebeat provides this kind of metrics out of the box? If not is it right way to compare offsets from registry file with total amount of lines in files for getting this kind of metric?
---
### Author:  [@Brett\_Larson](https://discuss.elastic.co/u/Brett_Larson)
#### Post date: [January 29, 2019, 4:44am UTC](https://discuss.elastic.co/t/determination-filebeat-elasticsearch-performance/165800/2 "2019-01-29T04:44:16Z")
I think you should be able to get this from the monitoring when viewing filebeat's output in STDout (filebeat -e)
As an example, I think these metrics shown may be of interest (this is all one line, so you may need to clean it up in a JSON formatting tool).
```
"filebeat": {
"events": {
"added": 944,
"done": 944
},
"harvester": {
"open_files": 0,
"running": 0
}
```
---
### Author:  [@Daniel\_Dalacort](https://discuss.elastic.co/u/Daniel_Dalacort)
#### Post date: [February 5, 2019, 12:32pm UTC](https://discuss.elastic.co/t/determination-filebeat-elasticsearch-performance/165800/3 "2019-02-05T12:32:06Z")
I didn't find this metrics out of the box, so I implement it by parsing registry file and compare offsets (already processed bytes) with current logfile sizes and it's works more or less accurate.
Now I have information about particular file growth and processing speed. Also this info let me manage file rotation and remove file as soon as they've been read fully and keep "slow" files longer.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 5, 2019, 12:45pm UTC](https://discuss.elastic.co/t/determination-filebeat-elasticsearch-performance/165800/4 "2019-03-05T12:45:09Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.